-- Logs begin at Fri 2022-07-15 14:39:21 UTC, end at Fri 2022-07-15 15:42:50 UTC. -- Jul 15 15:10:16.923961 dv-cinder-850015-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 15 15:10:16.936434 dv-cinder-850015-1-smb devstack@keystone.service[80226]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 15:10:16 2022] *** Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: nodename: dv-cinder-850015-1-smb Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: machine: x86_64 Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: clock source: unix Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: pcre jit disabled Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: detected number of CPU cores: 4 Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: current working directory: / Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: detected binary path: /usr/bin/uwsgi-core Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: your processes number limit is 47680 Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: your memory page size is 4096 bytes Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: detected max file descriptor number: 2048 Jul 15 15:10:16.938225 dv-cinder-850015-1-smb devstack@keystone.service[80226]: lock engine: pthread robust mutexes Jul 15 15:10:16.939152 dv-cinder-850015-1-smb devstack@keystone.service[80226]: thunder lock: enabled Jul 15 15:10:16.939152 dv-cinder-850015-1-smb devstack@keystone.service[80226]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 15 15:10:16.939152 dv-cinder-850015-1-smb devstack@keystone.service[80226]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 15:10:16.981126 dv-cinder-850015-1-smb devstack@keystone.service[80226]: Python main interpreter initialized at 0x561911dc09c0 Jul 15 15:10:16.981126 dv-cinder-850015-1-smb devstack@keystone.service[80226]: python threads support enabled Jul 15 15:10:16.981126 dv-cinder-850015-1-smb devstack@keystone.service[80226]: your server socket listen backlog is limited to 100 connections Jul 15 15:10:16.981126 dv-cinder-850015-1-smb devstack@keystone.service[80226]: your mercy for graceful operations on workers is 90 seconds Jul 15 15:10:16.981525 dv-cinder-850015-1-smb devstack@keystone.service[80226]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 15:10:16.981602 dv-cinder-850015-1-smb devstack@keystone.service[80226]: *** Operational MODE: preforking *** Jul 15 15:10:16.981871 dv-cinder-850015-1-smb devstack@keystone.service[80226]: *** uWSGI is running in multiple interpreter mode *** Jul 15 15:10:16.981871 dv-cinder-850015-1-smb devstack@keystone.service[80226]: spawned uWSGI master process (pid: 80226) Jul 15 15:10:16.982098 dv-cinder-850015-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 15 15:10:16.987935 dv-cinder-850015-1-smb devstack@keystone.service[80226]: spawned uWSGI worker 1 (pid: 80236, cores: 1) Jul 15 15:10:16.987935 dv-cinder-850015-1-smb devstack@keystone.service[80226]: spawned uWSGI worker 2 (pid: 80237, cores: 1) Jul 15 15:10:16.987935 dv-cinder-850015-1-smb devstack@keystone.service[80226]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 15:10:22.554225 dv-cinder-850015-1-smb devstack@keystone.service[80237]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:10:22.554225 dv-cinder-850015-1-smb devstack@keystone.service[80237]: from cryptography.utils import int_from_bytes Jul 15 15:10:22.555093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:10:22.555093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: from cryptography.utils import int_from_bytes Jul 15 15:10:22.560783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:10:22.560783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: from cryptography.utils import int_from_bytes Jul 15 15:10:22.561360 dv-cinder-850015-1-smb devstack@keystone.service[80236]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:10:22.561360 dv-cinder-850015-1-smb devstack@keystone.service[80236]: from cryptography.utils import int_from_bytes Jul 15 15:10:22.605243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 15:10:22.605438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 15:10:22.605640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] command line args: [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 15:10:22.605917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 15:10:22.606103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ================================================================================ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 15:10:22.606361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] admin_token = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.606617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] config_dir = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.606809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.606995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] config_source = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.607181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] debug = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.607387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.608589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.608589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.608589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.608589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.608847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.608943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 15:10:22.609021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_config_append = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.609144 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 15:10:22.609221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.609313 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] command line args: [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 15:10:22.609428 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_dir = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.609428 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_file = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.609553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 15:10:22.609553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ================================================================================ {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 15:10:22.609660 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.609829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] admin_token = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.609914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.610054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.610144 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] config_dir = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.610285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.610388 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.610483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] config_source = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.610564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.610644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] debug = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.610716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.610786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.610888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.611021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.611132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.611195 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.611347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.611439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.611584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.611697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.611817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.611968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.612086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.612164 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_config_append = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.612282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.612397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.612475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_dir = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.612542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.612630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_file = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.612808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.612904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.613129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.613346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.613435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.613519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] publish_errors = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.613616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.613756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.613840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.613961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.614050 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.614159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.614234 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.614412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.614489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.614649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.614738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.614891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.614992 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] standard_threads = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.615110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.615183 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.615348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.615436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.615528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.615698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.615784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_journal = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.615862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.615949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_json = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.616027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_stderr = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.616096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.616209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_syslog = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.616444 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.616583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.616716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.616790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] publish_errors = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.616943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.617021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.617236 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.617316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.618014 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.618178 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.618255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.618324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.618459 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.618553 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.618757 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] standard_threads = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.618835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.618996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.619097 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.619248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.619328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.619453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.619554 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.619631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] use_journal = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.619748 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.619831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] use_json = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.619967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] use_stderr = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.620048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.620148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] use_syslog = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.620231 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.620385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:10:22.620462 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.620652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.620740 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.620927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.621010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.621196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.621278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.621459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.621536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.621761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.621897 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.621980 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.622051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.622199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.622276 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.622448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.622524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.622689 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.622767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.622942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.623021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.623196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.623273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.623435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.623522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.623687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.623769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.623933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.624057 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.624220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.624307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.624467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.624559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.624723 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.624800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.624969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.625054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.625231 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.625308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.625504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.625599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.625752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.625870 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.626010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.626145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.626280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.626425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.626561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.626678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.626786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.626896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.627038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.627136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.627267 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.627343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.627517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.627601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.627759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.627847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.628017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.628095 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.628274 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.628355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.628509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.628667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.628740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.628854 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.628985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.629081 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.629266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.629361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.629511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.629587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.629768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.629888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.629987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.630096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.630231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.630341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.630505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.630628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.630735 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.630847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.630945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.631161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.631286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.631435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.631581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.631688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.631800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.632196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.632288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.632475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.633995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.633995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.634371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.634553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.634683 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.634814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.634944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.635085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.635229 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.635419 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.635544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.635670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.635834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.636006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.636175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.636339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.636511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.636623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.636727 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.636840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.636956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.637083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.637191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.637309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.637415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.637576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.637700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.637808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.637913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.638033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.638193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.638349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.638469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.638586 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.638694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.638798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.638904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.639009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.639117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.639233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.639349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.639474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.639591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.639742 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.639860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.639986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.640104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.640104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.640320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.640320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.640525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.640525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.640723 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.640723 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.640925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.641045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.641240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.641240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.641444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.641552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.641669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.641787 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.641923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.642044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.642165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.642287 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.642406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.642523 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.642759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.642882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.643001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.643119 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.643119 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.643347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.643480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.643698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.643843 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.643964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.644081 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.644203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.644329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.644458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.644601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.644722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.644722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.644932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.645088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.645222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.645366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.645493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.external = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.645626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.645752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.645878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.645972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646136 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.password = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646418 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.token = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.646930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647685 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.external = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.647947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.648089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.648159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.648240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.648311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.648387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.password = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.648465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.648536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.token = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.648623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.648790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.648870 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.648950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.649022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.649138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.649261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.649337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.649408 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.649486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.649560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.649630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.649700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.649844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.649924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.650092 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.650175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.650349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.650429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.650621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.650705 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.650876 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.650955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.651128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.651210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.651366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.651445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.651616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.651695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.651858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.651974 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.652129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.652264 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.652405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.652549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.652679 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.652804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.652931 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.653102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.653254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.653385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.653509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.653632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.653761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.653891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.654031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.654163 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.654295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.654422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.654536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.654645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.654767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.654880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.654990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.655109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.655306 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.655417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.655630 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.655747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.655872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.655872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.656088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.656202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.656323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.656433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.656543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.656651 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.656753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.656870 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.656998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.657268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.657403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.657527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.657656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.657806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.657934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.658053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.658172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.658254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.658316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.658404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.658508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.658629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.658711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.658809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.658941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.659073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.659186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.659294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.659294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.659477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.659594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.659731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.659858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.659996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.660115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.660231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.660349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.660480 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.660598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.660716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.660834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.660939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.661039 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.661183 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.661310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.661420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.661531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.661637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.661738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.661865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.661976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.662084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.662206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.662328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.662448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.662574 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.662681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.662805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.662921 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.663035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.663160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.663281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.663402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.663517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.663633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.663751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.663868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.663993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.664109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.664805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.664938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.665156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.665329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.665459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.665575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.665686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.665798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.665917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.666033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.666165 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.666282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.666399 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.666518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.666518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.666736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.666864 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.666986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.667098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.667209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.667317 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.667429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.667557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.667672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.667786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.667895 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.668016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.668125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.668210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.668273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.668333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.668392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.668450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.668508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.668652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.668743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.668877 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.669043 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.669236 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.669384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.669384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.669648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.669781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.669914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.670054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.670206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.670336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.670467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.670722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.670890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.671006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.671127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.671238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.671347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.671454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.671561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.671670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.671914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.672084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.672197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.672306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.672420 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.672535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.672796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.672918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.672918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.673151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.673151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.673343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.673483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.673606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.673726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.673836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.674052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.674214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.674345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.674463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.674575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.674693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.674811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.674933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.675068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.675189 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.675309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.675430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.675552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.675670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.675801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.675923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.676178 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.676332 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.676476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.676616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.676769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.676909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.677028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.677168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.677304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.677439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.677592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.677592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.677845 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.677978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.678110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.678243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] role.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.678243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] role.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.678496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.678628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.678628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.678866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.678998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.678998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.679263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.679396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.679527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.679655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.679655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.680745 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.680885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.680885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.681185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.681319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.681319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.681578 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.681712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.681712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.681954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.682087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.682219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.682363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.682363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.682603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.682732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.682863 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.683008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.683008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.683247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.683379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.683379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.683617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.683763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.683763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.684001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.684131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.684131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.684373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.684516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.684516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.684755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.684885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.685017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.685174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.685325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.685456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.685589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.685760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.685895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] role.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.686012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.686230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.686376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] role.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.686509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.686685 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.686825 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.686956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.687137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.687278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.687416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.687591 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.687733 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.687894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.688041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.688173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.688385 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.688524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.688657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.688859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.689021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.689188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.689319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.689449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.689590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.689773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.689935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.690069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.690229 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.690369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.690613 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.690770 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.690917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.691058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.691193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.691323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.691496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.691637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.691770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.691950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.692091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.692231 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.692400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.692540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.692715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.692960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.693125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.693260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.693467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.693605 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.693736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.693956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.694098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.694230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.694406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.694547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.694681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.694862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.695001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.695132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 15:10:22.695315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.695674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.696025 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.696381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.696733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.697161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.697444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.697776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.698123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.698487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.698838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.699216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.699554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.699886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.700222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.700568 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.700915 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.701281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.701636 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.701983 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.702320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.702765 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.703116 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.703599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.703950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.704284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.704883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.705153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.705492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.706342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.706342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.706801 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.707163 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.connection = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.707524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.707886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.708226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.708569 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.708905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.709277 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.709621 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.709964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.710308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.710641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.710986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.711871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.712220 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.712563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.712907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.713275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.713619 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.713952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:10:22.714215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 15:10:22.728069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.728307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.728519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.737375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.742514 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.742881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.742977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.751718 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.766800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.767022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.771121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.771356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.919594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.920864 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.970467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.970710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.971145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:22.971390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.039322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.039559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.039779 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.039902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.039984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.040053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.040201 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.040290 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.040418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.040505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.040651 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.040871 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.067023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.067241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.067326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.067492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.067587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.067685 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.067768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.067907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.067992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.068124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.068207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.068339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.068430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.068557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.080502 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.080777 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.094317 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.094637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.094794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.095019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.095169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.095259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.095407 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.095504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.095635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.095722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.095860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.096082 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.096301 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.096520 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:10:23.113691 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.113924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 15:10:23.114232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.114447 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 15:10:23.114583 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.114712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 15:10:23.114943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.115075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.115205 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.115343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 15:10:23.115466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.115600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.115713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.115821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.116001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.116264 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.127231 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.127519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.127750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.127843 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.128042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.128129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.128311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.128592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.136653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.137244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.139986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.140272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.140536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.140625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.140821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.140922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.141126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.141213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.141395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.141477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.141674 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.141774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.141946 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.142026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.142218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.142306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.142493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.142588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.142764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.142844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.143035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.143307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.170074 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.170407 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.171652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.171941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.172074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.172364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.177281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.177564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.177657 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.177849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.177937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.178200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.185949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.186243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.186349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.186583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.190841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.191174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.191304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.191472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.191686 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.191855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.192109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.192243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.192410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.192554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.192677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.192938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.193100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.193357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.193696 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.194030 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.211926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.212217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.213007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.213326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.216793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.217940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.221219 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.221520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.221701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.222000 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.227191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.227669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.230854 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.231303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.234511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.234814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.234950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.235106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.235251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.235399 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.235543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.235691 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.235838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.235984 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.236132 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.236422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.256180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.256468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.256690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.256806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.257281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.257368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.257568 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.257866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.265316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.266374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.267046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.267323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.268045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.268325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.270593 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.270875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.271162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.271459 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.271608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.271815 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.271944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.272147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.272449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.272736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.285375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.285667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.285955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.286240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.286524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.286768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.286854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.287075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.287160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.287367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.287657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.287962 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.288257 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.288543 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.308538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.309426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.311876 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.312744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.315221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.316084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.316903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.317742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.318744 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.319007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.319292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.319536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.319823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.320115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.326669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.327484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.328269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.329133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.331587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.331878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.332166 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.332440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.332547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.332734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.333021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.333330 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.341781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.342077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.342361 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.342624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.342925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.343214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.350678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.350965 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.351107 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:10:23.351247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.351399 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.351524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.352217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.352349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.352503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.352651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.352812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.352936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.353092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.353213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.353357 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.353585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.353782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.353901 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.354048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.354168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.354289 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.354422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.354556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.354671 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.354790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.354910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.355062 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.355340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:10:23.393688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561911dc09c0 pid: 80236 (default app) Jul 15 15:10:23.393928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561911dc09c0 pid: 80237 (default app) Jul 15 15:10:23.397328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4934d76-50b4-43ce-8823-486e0e2fd97a None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:23.397624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4934d76-50b4-43ce-8823-486e0e2fd97a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:23.397914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4934d76-50b4-43ce-8823-486e0e2fd97a None None] PATH_INFO: `/v3` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:23.402212 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Fri Jul 15 15:10:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:31.433499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf0223-58fd-49f5-962d-b036f8dc5fe4 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:31.434067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf0223-58fd-49f5-962d-b036f8dc5fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:31.434067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf0223-58fd-49f5-962d-b036f8dc5fe4 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:31.438399 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:10:31.444557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d794b-1304-4513-9d3b-0b38d8fe12fa None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:31.445614 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d794b-1304-4513-9d3b-0b38d8fe12fa None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:31.445734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d794b-1304-4513-9d3b-0b38d8fe12fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:31.526835 dv-cinder-850015-1-smb devstack@keystone.service[80236]: INFO dbcounter [None req-b67d794b-1304-4513-9d3b-0b38d8fe12fa None None] Registered counter for database keystone Jul 15 15:10:31.550114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG oslo_db.sqlalchemy.engines [None req-b67d794b-1304-4513-9d3b-0b38d8fe12fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:10:31.559251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writer thread running {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:10:31.744683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG passlib.handlers.bcrypt [None req-b67d794b-1304-4513-9d3b-0b38d8fe12fa None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80236) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 15:10:31.745015 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG passlib.handlers.bcrypt [None req-b67d794b-1304-4513-9d3b-0b38d8fe12fa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80236) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 15:10:31.802367 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b67d794b-1304-4513-9d3b-0b38d8fe12fa None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:31.803982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b67d794b-1304-4513-9d3b-0b38d8fe12fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:31.941341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 15 15:10:32.131529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf0223-58fd-49f5-962d-b036f8dc5fe4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:32.205723 dv-cinder-850015-1-smb devstack@keystone.service[80237]: INFO dbcounter [None req-08bf0223-58fd-49f5-962d-b036f8dc5fe4 None None] Registered counter for database keystone Jul 15 15:10:32.225556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG oslo_db.sqlalchemy.engines [None req-08bf0223-58fd-49f5-962d-b036f8dc5fe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:10:32.232531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writer thread running {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:10:32.358820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf0223-58fd-49f5-962d-b036f8dc5fe4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:32.363127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ef5bf-589d-4cf0-a187-ee9f6ef86da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:32.363792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ef5bf-589d-4cf0-a187-ee9f6ef86da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:32.364076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ef5bf-589d-4cf0-a187-ee9f6ef86da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:32.364352 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ef5bf-589d-4cf0-a187-ee9f6ef86da9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:32.373513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ef5bf-589d-4cf0-a187-ee9f6ef86da9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:32.428502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: WARNING keystone.common.rbac_enforcer.enforcer [None req-249ef5bf-589d-4cf0-a187-ee9f6ef86da9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 15:10:32.428821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ef5bf-589d-4cf0-a187-ee9f6ef86da9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:32.442836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Fri Jul 15 15:10:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:10:32.448887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d794b-1304-4513-9d3b-0b38d8fe12fa None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:32.464339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d794b-1304-4513-9d3b-0b38d8fe12fa None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:32.468903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5fe5-3328-47ed-be81-9b97b60f8289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:32.470142 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5fe5-3328-47ed-be81-9b97b60f8289 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:32.470431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5fe5-3328-47ed-be81-9b97b60f8289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:32.470713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5fe5-3328-47ed-be81-9b97b60f8289 admin admin] PATH_INFO: `/v3/projects/71c3490c70ac4566897a6b15fddccf92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:32.474996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5fe5-3328-47ed-be81-9b97b60f8289 admin admin] RBAC: Authorizing `identity:get_project(project_id=71c3490c70ac4566897a6b15fddccf92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:32.532836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a06a5fe5-3328-47ed-be81-9b97b60f8289 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 15:10:32.533310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5fe5-3328-47ed-be81-9b97b60f8289 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:32.540231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Fri Jul 15 15:10:32 2022] GET /identity/v3/projects/71c3490c70ac4566897a6b15fddccf92 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:10:34.632703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb484c3a-0ece-454f-8d1d-9c7628051afc None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:34.633281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb484c3a-0ece-454f-8d1d-9c7628051afc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:34.633281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb484c3a-0ece-454f-8d1d-9c7628051afc None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:34.637616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:10:34.646701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c54e5-0efb-47de-b255-ac444aa26439 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:34.647259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c54e5-0efb-47de-b255-ac444aa26439 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:34.647368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c54e5-0efb-47de-b255-ac444aa26439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:34.668456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d98c54e5-0efb-47de-b255-ac444aa26439 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:34.670054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d98c54e5-0efb-47de-b255-ac444aa26439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:34.678316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 15:10:34.702324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb484c3a-0ece-454f-8d1d-9c7628051afc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:34.715686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb484c3a-0ece-454f-8d1d-9c7628051afc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:34.720409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17394676-871f-4422-952d-b6c66b101b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:34.721358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17394676-871f-4422-952d-b6c66b101b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:34.721754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17394676-871f-4422-952d-b6c66b101b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:34.722282 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17394676-871f-4422-952d-b6c66b101b27 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:34.732376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17394676-871f-4422-952d-b6c66b101b27 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:34.734366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17394676-871f-4422-952d-b6c66b101b27 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:34.744335 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Fri Jul 15 15:10:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:10:34.750234 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c54e5-0efb-47de-b255-ac444aa26439 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:34.760215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c54e5-0efb-47de-b255-ac444aa26439 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:34.764953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a580a1-6c14-4cfe-8d4f-bc7a78630152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:34.766771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a580a1-6c14-4cfe-8d4f-bc7a78630152 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:34.767066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a580a1-6c14-4cfe-8d4f-bc7a78630152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:34.767352 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a580a1-6c14-4cfe-8d4f-bc7a78630152 admin admin] PATH_INFO: `/v3/users/635c975960e84510ab325ac63758c0a9` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:34.768849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a580a1-6c14-4cfe-8d4f-bc7a78630152 admin admin] RBAC: Authorizing `identity:get_user(user_id=635c975960e84510ab325ac63758c0a9)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:34.770774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a580a1-6c14-4cfe-8d4f-bc7a78630152 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:34.772427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Fri Jul 15 15:10:34 2022] GET /identity/v3/users/635c975960e84510ab325ac63758c0a9 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:36.961467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b6a88-99ae-46fc-982d-bebbca407a9d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:36.961968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b6a88-99ae-46fc-982d-bebbca407a9d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:36.961968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b6a88-99ae-46fc-982d-bebbca407a9d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:36.963397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:36.968944 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c1c2-15e0-4f9c-bd75-5f1a773b3639 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:36.969460 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c1c2-15e0-4f9c-bd75-5f1a773b3639 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:36.969681 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c1c2-15e0-4f9c-bd75-5f1a773b3639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:36.988458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2ec3c1c2-15e0-4f9c-bd75-5f1a773b3639 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:36.989720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2ec3c1c2-15e0-4f9c-bd75-5f1a773b3639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:36.998428 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a8c86-b98a-4d5f-80d2-a9dbb998dcdc None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:36.998902 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a8c86-b98a-4d5f-80d2-a9dbb998dcdc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:36.999344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a8c86-b98a-4d5f-80d2-a9dbb998dcdc None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:37.001285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:37.008726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0619d-2323-4bd3-82c1-58abb546c3e0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:37.009013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0619d-2323-4bd3-82c1-58abb546c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:37.009322 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0619d-2323-4bd3-82c1-58abb546c3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:37.051729 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG passlib.handlers.bcrypt [None req-43d0619d-2323-4bd3-82c1-58abb546c3e0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80237) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 15:10:37.052206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG passlib.handlers.bcrypt [None req-43d0619d-2323-4bd3-82c1-58abb546c3e0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80237) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 15:10:37.096905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:37.098751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-43d0619d-2323-4bd3-82c1-58abb546c3e0 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:37.100523 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-43d0619d-2323-4bd3-82c1-58abb546c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:37.119270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3c1c2-15e0-4f9c-bd75-5f1a773b3639 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:37.147466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:37.214531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:10:37.237529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0619d-2323-4bd3-82c1-58abb546c3e0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:37.264281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3c1c2-15e0-4f9c-bd75-5f1a773b3639 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:37.315187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478bdcc-f21b-4028-af0f-2f3ba025c59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:37.316346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478bdcc-f21b-4028-af0f-2f3ba025c59d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:37.316873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478bdcc-f21b-4028-af0f-2f3ba025c59d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:37.317438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478bdcc-f21b-4028-af0f-2f3ba025c59d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:37.357363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0619d-2323-4bd3-82c1-58abb546c3e0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:37.363816 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:37.407858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258cf9c-1196-4816-9641-fb53ad7deb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:37.408922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258cf9c-1196-4816-9641-fb53ad7deb30 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:37.409310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258cf9c-1196-4816-9641-fb53ad7deb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:37.409523 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258cf9c-1196-4816-9641-fb53ad7deb30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:37.412654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478bdcc-f21b-4028-af0f-2f3ba025c59d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:37.414854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478bdcc-f21b-4028-af0f-2f3ba025c59d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:37.423508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258cf9c-1196-4816-9641-fb53ad7deb30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3258cf9c-1196-4816-9641-fb53ad7deb30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:10:37.435712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:10:37.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:10:37.438104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 8/14] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:10:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:10:37.443311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258cf9c-1196-4816-9641-fb53ad7deb30 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:37.445367 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:37.537193 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 7/15] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 15:10:37.543259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478bdcc-f21b-4028-af0f-2f3ba025c59d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:37.555608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258cf9c-1196-4816-9641-fb53ad7deb30 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:37.592996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b55ce-2383-435d-9781-ad69fb40e9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:37.593819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b55ce-2383-435d-9781-ad69fb40e9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:37.594106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b55ce-2383-435d-9781-ad69fb40e9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:37.594381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b55ce-2383-435d-9781-ad69fb40e9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:37.595148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b55ce-2383-435d-9781-ad69fb40e9f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:37.595462 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b55ce-2383-435d-9781-ad69fb40e9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:37.596987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b55ce-2383-435d-9781-ad69fb40e9f1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:37.611196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 9/16] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:10:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:10:37.617502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b55ce-2383-435d-9781-ad69fb40e9f1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:37.647553 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:37.664976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478bdcc-f21b-4028-af0f-2f3ba025c59d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:37.690568 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:37.703200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562200f0-c220-450b-8a51-cd59f5c13032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:37.704132 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562200f0-c220-450b-8a51-cd59f5c13032 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:37.704463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562200f0-c220-450b-8a51-cd59f5c13032 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:37.704750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562200f0-c220-450b-8a51-cd59f5c13032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:37.717004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562200f0-c220-450b-8a51-cd59f5c13032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:37.718654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562200f0-c220-450b-8a51-cd59f5c13032 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:37.735095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b55ce-2383-435d-9781-ad69fb40e9f1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-562200f0-c220-450b-8a51-cd59f5c13032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:10:37.748056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:10:37.749020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:10:37.750026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:10:37.750026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:10:37.750026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:10:37.750026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:10:37.750026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 8/17] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:10:37.755885 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562200f0-c220-450b-8a51-cd59f5c13032 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:37.775300 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b058fc9-7d91-47f9-9705-92160b94b7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:37.776182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b058fc9-7d91-47f9-9705-92160b94b7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:37.776477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b058fc9-7d91-47f9-9705-92160b94b7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:37.776745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b058fc9-7d91-47f9-9705-92160b94b7c7 None admin] PATH_INFO: `/v3/users/635c975960e84510ab325ac63758c0a9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:37.778800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b058fc9-7d91-47f9-9705-92160b94b7c7 None admin] RBAC: Authorizing `identity:get_user(user_id=635c975960e84510ab325ac63758c0a9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:37.779856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b058fc9-7d91-47f9-9705-92160b94b7c7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:37.781549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:10:37 2022] GET /identity/v3/users/635c975960e84510ab325ac63758c0a9 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:10:37.790854 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b058fc9-7d91-47f9-9705-92160b94b7c7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:37.872735 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562200f0-c220-450b-8a51-cd59f5c13032 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:37.900661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:37.911139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b058fc9-7d91-47f9-9705-92160b94b7c7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:37.914979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43b16c-0d5f-4591-9493-c209d1f831e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:37.915669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43b16c-0d5f-4591-9493-c209d1f831e1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:37.915958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43b16c-0d5f-4591-9493-c209d1f831e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:37.916240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43b16c-0d5f-4591-9493-c209d1f831e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:37.916990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43b16c-0d5f-4591-9493-c209d1f831e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:37.917340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43b16c-0d5f-4591-9493-c209d1f831e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:37.919443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43b16c-0d5f-4591-9493-c209d1f831e1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:37.952193 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:10:37.952473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c330210-6111-4c53-9596-115c83293bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:37.952473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330210-6111-4c53-9596-115c83293bbe None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:37.952473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330210-6111-4c53-9596-115c83293bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:37.952473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330210-6111-4c53-9596-115c83293bbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:37.953009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c330210-6111-4c53-9596-115c83293bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:37.954542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c330210-6111-4c53-9596-115c83293bbe None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:37.956983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:10:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:10:37.963981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43b16c-0d5f-4591-9493-c209d1f831e1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:38.006900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:38.096011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43b16c-0d5f-4591-9493-c209d1f831e1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:38.135139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdc354-8c65-4c68-81a8-059517cf9c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:38.135831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc354-8c65-4c68-81a8-059517cf9c74 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:38.136238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc354-8c65-4c68-81a8-059517cf9c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:38.136407 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc354-8c65-4c68-81a8-059517cf9c74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:38.137349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdc354-8c65-4c68-81a8-059517cf9c74 None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.domain.id=default, user.id=635c975960e84510ab325ac63758c0a9) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:38.137636 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdc354-8c65-4c68-81a8-059517cf9c74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:38.139132 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdc354-8c65-4c68-81a8-059517cf9c74 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:38.146701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1322 bytes} [Fri Jul 15 15:10:37 2022] GET /identity/v3/role_assignments?user.id=635c975960e84510ab325ac63758c0a9&scope.domain.id=default&role.id=87593f63c4744eac870c07b006022e77 => generated 233 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:40.651166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54b10a-a5f7-42c7-ad63-940ad3706b8d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:40.652322 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54b10a-a5f7-42c7-ad63-940ad3706b8d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:40.653132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54b10a-a5f7-42c7-ad63-940ad3706b8d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:40.655748 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:40.663311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5e2a2-c7b8-40af-a680-7189c6f32576 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:40.664358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5e2a2-c7b8-40af-a680-7189c6f32576 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:40.664847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5e2a2-c7b8-40af-a680-7189c6f32576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:40.684152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6ea5e2a2-c7b8-40af-a680-7189c6f32576 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:40.686642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6ea5e2a2-c7b8-40af-a680-7189c6f32576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:40.791430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:10:40.842705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54b10a-a5f7-42c7-ad63-940ad3706b8d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:41.033127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54b10a-a5f7-42c7-ad63-940ad3706b8d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:41.039601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43aa88-a957-48d4-a33e-36d3ae37d08f None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:41.040266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43aa88-a957-48d4-a33e-36d3ae37d08f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:41.040757 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43aa88-a957-48d4-a33e-36d3ae37d08f None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:41.046659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 12/24] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:10:41.053761 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba710-ea7a-4c83-9a49-f456659fc9cd None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:41.054459 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba710-ea7a-4c83-9a49-f456659fc9cd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:41.054998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba710-ea7a-4c83-9a49-f456659fc9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:41.091042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da06ed-6a05-49d9-89eb-e200d49e3ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:41.092239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da06ed-6a05-49d9-89eb-e200d49e3ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:41.092679 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da06ed-6a05-49d9-89eb-e200d49e3ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:41.092800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-06cba710-ea7a-4c83-9a49-f456659fc9cd None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:41.093309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da06ed-6a05-49d9-89eb-e200d49e3ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:41.094590 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-06cba710-ea7a-4c83-9a49-f456659fc9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:41.124979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da06ed-6a05-49d9-89eb-e200d49e3ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:41.126585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da06ed-6a05-49d9-89eb-e200d49e3ba9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:41.147029 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-01da06ed-6a05-49d9-89eb-e200d49e3ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:10:41.163391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:10:41.164297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:10:41.165148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:10:41.165148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:10:41.165148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:10:41.165148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:10:41.169266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 13/25] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:10:41.169266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a71aa-a075-4014-a35b-f4f2f19b420d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:41.169266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a71aa-a075-4014-a35b-f4f2f19b420d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:41.169266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a71aa-a075-4014-a35b-f4f2f19b420d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:41.169742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 14/26] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:41.177734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d1f06-d4b8-453b-82e6-ec14b40c00c3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:41.178044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d1f06-d4b8-453b-82e6-ec14b40c00c3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:41.178313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d1f06-d4b8-453b-82e6-ec14b40c00c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:41.234987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-633d1f06-d4b8-453b-82e6-ec14b40c00c3 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:41.237588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-633d1f06-d4b8-453b-82e6-ec14b40c00c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:41.244610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 13/27] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:41.246721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cba710-ea7a-4c83-9a49-f456659fc9cd None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:41.281014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:41.425421 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 15/28] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:41.427523 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d1f06-d4b8-453b-82e6-ec14b40c00c3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:41.549781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cba710-ea7a-4c83-9a49-f456659fc9cd None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:41.596297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f5c26-2ec2-415f-b8e3-2d67e61519e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:41.596999 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f5c26-2ec2-415f-b8e3-2d67e61519e2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:41.597319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f5c26-2ec2-415f-b8e3-2d67e61519e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:41.597677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f5c26-2ec2-415f-b8e3-2d67e61519e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:41.598452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f5c26-2ec2-415f-b8e3-2d67e61519e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:41.598874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f5c26-2ec2-415f-b8e3-2d67e61519e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:41.600408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f5c26-2ec2-415f-b8e3-2d67e61519e2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:41.628452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 14/29] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:41.633819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f5c26-2ec2-415f-b8e3-2d67e61519e2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:41.649822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d1f06-d4b8-453b-82e6-ec14b40c00c3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:41.671918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:41.708459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026f10d-0433-42af-9ead-3bfc198d6581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:41.710069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026f10d-0433-42af-9ead-3bfc198d6581 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:41.710640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026f10d-0433-42af-9ead-3bfc198d6581 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:41.711321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026f10d-0433-42af-9ead-3bfc198d6581 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:41.723584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026f10d-0433-42af-9ead-3bfc198d6581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e026f10d-0433-42af-9ead-3bfc198d6581 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:10:41.732240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:10:41.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:10:41.734046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:10:41.734046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:10:41.734046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:10:41.734046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:10:41.734046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:10:41.734046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:10:41.734046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:10:41.734046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:10:41.734046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:10:41.734046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:10:41.734046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:10:41.734046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:10:41.736739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 16/30] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:10:41.738572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8167d-29b6-410a-91f5-8a8d6acda78b None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:41.739105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8167d-29b6-410a-91f5-8a8d6acda78b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:41.739622 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8167d-29b6-410a-91f5-8a8d6acda78b None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:41.741783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 17/31] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:41.742973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8167d-29b6-410a-91f5-8a8d6acda78b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:41.747733 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:41.792251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f5c26-2ec2-415f-b8e3-2d67e61519e2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:41.854640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf98233-a2cb-4cd3-b39e-c864ceaf3cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:41.855531 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98233-a2cb-4cd3-b39e-c864ceaf3cb0 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:41.856411 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98233-a2cb-4cd3-b39e-c864ceaf3cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:41.856803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98233-a2cb-4cd3-b39e-c864ceaf3cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:41.857730 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf98233-a2cb-4cd3-b39e-c864ceaf3cb0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:41.860061 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf98233-a2cb-4cd3-b39e-c864ceaf3cb0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:41.890741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8167d-29b6-410a-91f5-8a8d6acda78b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:41.934448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0017c4-535b-4c4b-8cf4-42b02ea359ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:41.935854 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0017c4-535b-4c4b-8cf4-42b02ea359ac None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:41.936382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0017c4-535b-4c4b-8cf4-42b02ea359ac None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:41.936863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0017c4-535b-4c4b-8cf4-42b02ea359ac None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:41.937803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0017c4-535b-4c4b-8cf4-42b02ea359ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:41.939562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0017c4-535b-4c4b-8cf4-42b02ea359ac None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:42.024543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 15/32] 10.222.0.64 () {60 vars in 1131 bytes} [Fri Jul 15 15:10:41 2022] POST /identity/v3/roles => generated 225 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:10:42.025863 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf98233-a2cb-4cd3-b39e-c864ceaf3cb0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:42.128109 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 18/33] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:10:41 2022] POST /identity/v3/projects => generated 301 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:10:42.130195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119350fa-2a43-49e5-b493-0daa834a4017 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:42.130668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119350fa-2a43-49e5-b493-0daa834a4017 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:42.131148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119350fa-2a43-49e5-b493-0daa834a4017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:42.147861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:42.165777 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-119350fa-2a43-49e5-b493-0daa834a4017 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:42.168040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-119350fa-2a43-49e5-b493-0daa834a4017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:42.208022 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf98233-a2cb-4cd3-b39e-c864ceaf3cb0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:42.302959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed005d8b-4518-4004-9a65-7b5dd7858ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:42.304071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed005d8b-4518-4004-9a65-7b5dd7858ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:42.304432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed005d8b-4518-4004-9a65-7b5dd7858ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:42.304950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed005d8b-4518-4004-9a65-7b5dd7858ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:42.306038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed005d8b-4518-4004-9a65-7b5dd7858ae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:42.306616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed005d8b-4518-4004-9a65-7b5dd7858ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:42.314432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed005d8b-4518-4004-9a65-7b5dd7858ae6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:42.314671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:42.331189 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 16/34] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:10:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:42.333182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ead555-9acd-4b70-af67-5755b11e41ba None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:42.339812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ead555-9acd-4b70-af67-5755b11e41ba None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:42.341423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ead555-9acd-4b70-af67-5755b11e41ba None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:42.343302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 17/35] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:42.347531 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ead555-9acd-4b70-af67-5755b11e41ba None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:42.370547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 19/36] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:42.371834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122082d2-9a85-4993-a722-87ee490410d8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:42.372168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122082d2-9a85-4993-a722-87ee490410d8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:42.372483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122082d2-9a85-4993-a722-87ee490410d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:42.393041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-122082d2-9a85-4993-a722-87ee490410d8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:42.394738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-122082d2-9a85-4993-a722-87ee490410d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:42.485994 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 20/37] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:42.486838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122082d2-9a85-4993-a722-87ee490410d8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:42.510485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ead555-9acd-4b70-af67-5755b11e41ba None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:42.548403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81477e88-7da4-46c6-8eca-8ace4fe3514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:42.549489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81477e88-7da4-46c6-8eca-8ace4fe3514c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:42.549858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81477e88-7da4-46c6-8eca-8ace4fe3514c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:42.550208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81477e88-7da4-46c6-8eca-8ace4fe3514c None admin] PATH_INFO: `/v3/users/635c975960e84510ab325ac63758c0a9` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:42.551813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81477e88-7da4-46c6-8eca-8ace4fe3514c None admin] RBAC: Authorizing `identity:get_user(user_id=635c975960e84510ab325ac63758c0a9)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:42.553500 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81477e88-7da4-46c6-8eca-8ace4fe3514c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:42.559717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 18/38] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:10:42 2022] GET /identity/v3/users/635c975960e84510ab325ac63758c0a9 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:42.559717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddbcb4-3509-47ed-b483-252b8100e5ff None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:42.559717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddbcb4-3509-47ed-b483-252b8100e5ff None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:42.559717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddbcb4-3509-47ed-b483-252b8100e5ff None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:42.559717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 19/39] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:42.559717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddbcb4-3509-47ed-b483-252b8100e5ff None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:42.575529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:42.611992 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122082d2-9a85-4993-a722-87ee490410d8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:42.632922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:42.655263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5055ea-96e7-44ca-bd3f-2615424b66cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:42.655960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5055ea-96e7-44ca-bd3f-2615424b66cb None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:42.656248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5055ea-96e7-44ca-bd3f-2615424b66cb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:42.656533 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5055ea-96e7-44ca-bd3f-2615424b66cb None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:42.657347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5055ea-96e7-44ca-bd3f-2615424b66cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:42.658906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5055ea-96e7-44ca-bd3f-2615424b66cb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:42.675354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1131 bytes} [Fri Jul 15 15:10:42 2022] POST /identity/v3/roles => generated 219 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:10:42.676217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5055ea-96e7-44ca-bd3f-2615424b66cb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:42.703432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddbcb4-3509-47ed-b483-252b8100e5ff None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:42.748975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b6766-a4f7-4815-aed4-b78addcb7647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:42.750111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6766-a4f7-4815-aed4-b78addcb7647 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:42.750634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6766-a4f7-4815-aed4-b78addcb7647 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:42.751220 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6766-a4f7-4815-aed4-b78addcb7647 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:42.753510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b6766-a4f7-4815-aed4-b78addcb7647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:42.755271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b6766-a4f7-4815-aed4-b78addcb7647 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:42.757988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 20/41] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:10:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:42.759533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d77a-57b3-4464-a77b-d03895ec957e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:42.759834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d77a-57b3-4464-a77b-d03895ec957e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:42.760125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d77a-57b3-4464-a77b-d03895ec957e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:42.862824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5055ea-96e7-44ca-bd3f-2615424b66cb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:42.891480 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b827d77a-57b3-4464-a77b-d03895ec957e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:42.893108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b827d77a-57b3-4464-a77b-d03895ec957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:42.915500 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac542535-7737-42ec-b9a7-19557e7ef06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:42.916624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac542535-7737-42ec-b9a7-19557e7ef06b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:42.917097 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac542535-7737-42ec-b9a7-19557e7ef06b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:42.917683 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac542535-7737-42ec-b9a7-19557e7ef06b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:42.919701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac542535-7737-42ec-b9a7-19557e7ef06b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:42.921730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac542535-7737-42ec-b9a7-19557e7ef06b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:42.923965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 22/42] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:10:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:42.925169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac542535-7737-42ec-b9a7-19557e7ef06b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:42.983479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:42.987646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 21/43] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:42.988513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d77a-57b3-4464-a77b-d03895ec957e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:42.998469 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:43.063670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac542535-7737-42ec-b9a7-19557e7ef06b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:43.107648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbfdd2-8a9b-44c0-a4a1-9d090cfbce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:43.108316 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbfdd2-8a9b-44c0-a4a1-9d090cfbce02 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:43.108604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbfdd2-8a9b-44c0-a4a1-9d090cfbce02 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:43.108889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbfdd2-8a9b-44c0-a4a1-9d090cfbce02 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:43.109647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbfdd2-8a9b-44c0-a4a1-9d090cfbce02 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:43.111113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbfdd2-8a9b-44c0-a4a1-9d090cfbce02 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:43.113732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d77a-57b3-4464-a77b-d03895ec957e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:43.147840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:10:42 2022] POST /identity/v3/projects => generated 312 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:10:43.149584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbfdd2-8a9b-44c0-a4a1-9d090cfbce02 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:43.158012 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a4b9a-91d0-4a1e-b1d7-38569b8acbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:43.159472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a4b9a-91d0-4a1e-b1d7-38569b8acbc8 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:43.159946 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a4b9a-91d0-4a1e-b1d7-38569b8acbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:43.160429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a4b9a-91d0-4a1e-b1d7-38569b8acbc8 None admin] PATH_INFO: `/v3/domains/default/users/635c975960e84510ab325ac63758c0a9/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:43.164684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a4b9a-91d0-4a1e-b1d7-38569b8acbc8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=635c975960e84510ab325ac63758c0a9, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:43.167266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a4b9a-91d0-4a1e-b1d7-38569b8acbc8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:43.191358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 22/45] 10.222.0.64 () {58 vars in 1361 bytes} [Fri Jul 15 15:10:42 2022] PUT /identity/v3/domains/default/users/635c975960e84510ab325ac63758c0a9/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:10:43.333773 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:43.343441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbfdd2-8a9b-44c0-a4a1-9d090cfbce02 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:43.403435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05a71f-a112-4a04-827b-29d1a15a45af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:43.404046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05a71f-a112-4a04-827b-29d1a15a45af None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:43.404336 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05a71f-a112-4a04-827b-29d1a15a45af None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:43.404618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05a71f-a112-4a04-827b-29d1a15a45af None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:43.405436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05a71f-a112-4a04-827b-29d1a15a45af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:43.406865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05a71f-a112-4a04-827b-29d1a15a45af None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:43.423209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1131 bytes} [Fri Jul 15 15:10:43 2022] POST /identity/v3/roles => generated 223 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:10:45.343843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2112acd-2494-4fa4-b3a5-f65ac353435b None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:45.344585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2112acd-2494-4fa4-b3a5-f65ac353435b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:45.344585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2112acd-2494-4fa4-b3a5-f65ac353435b None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:45.345827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 23/47] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:45.351023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d2089-b3ba-4900-95d6-6b035f1ceb8a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:45.351454 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d2089-b3ba-4900-95d6-6b035f1ceb8a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:45.351607 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d2089-b3ba-4900-95d6-6b035f1ceb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:45.369128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-656d2089-b3ba-4900-95d6-6b035f1ceb8a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:45.370347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-656d2089-b3ba-4900-95d6-6b035f1ceb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:45.438915 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0587b2-524a-44bb-9a9f-b1c4ef024527 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:45.439209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0587b2-524a-44bb-9a9f-b1c4ef024527 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:45.439498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0587b2-524a-44bb-9a9f-b1c4ef024527 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:45.440917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 24/48] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:10:45.448547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78706d0c-357b-4935-9bbd-2175f3a1db97 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:45.448858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78706d0c-357b-4935-9bbd-2175f3a1db97 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:45.449291 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78706d0c-357b-4935-9bbd-2175f3a1db97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:45.464425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 25/49] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:45.476163 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-78706d0c-357b-4935-9bbd-2175f3a1db97 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:45.477446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-78706d0c-357b-4935-9bbd-2175f3a1db97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:45.488720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d2089-b3ba-4900-95d6-6b035f1ceb8a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:45.567021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:45.577309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 25/50] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:10:45.601969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78706d0c-357b-4935-9bbd-2175f3a1db97 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:45.606690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:45.626909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d2089-b3ba-4900-95d6-6b035f1ceb8a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:45.668084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa933cd-a8f8-4432-912f-3dd34331466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:45.668894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa933cd-a8f8-4432-912f-3dd34331466f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:45.669214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa933cd-a8f8-4432-912f-3dd34331466f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:45.669494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa933cd-a8f8-4432-912f-3dd34331466f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:45.681666 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa933cd-a8f8-4432-912f-3dd34331466f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9fa933cd-a8f8-4432-912f-3dd34331466f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:10:45.689750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:10:45.690645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:10:45.691389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 26/51] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:10:45.697651 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa933cd-a8f8-4432-912f-3dd34331466f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:45.734983 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78706d0c-357b-4935-9bbd-2175f3a1db97 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:45.779801 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d01fbb-2784-4641-9a77-d6010a61ae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:45.780789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01fbb-2784-4641-9a77-d6010a61ae07 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:45.781242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01fbb-2784-4641-9a77-d6010a61ae07 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:45.781658 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01fbb-2784-4641-9a77-d6010a61ae07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:45.783267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d01fbb-2784-4641-9a77-d6010a61ae07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:45.785366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d01fbb-2784-4641-9a77-d6010a61ae07 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:45.787091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 26/52] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:10:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:10:45.794680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d01fbb-2784-4641-9a77-d6010a61ae07 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:45.819159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa933cd-a8f8-4432-912f-3dd34331466f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:45.871186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b40e3-267e-4760-9cb6-7bf95e09f68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:45.871901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b40e3-267e-4760-9cb6-7bf95e09f68a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:45.872221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b40e3-267e-4760-9cb6-7bf95e09f68a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:45.873167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b40e3-267e-4760-9cb6-7bf95e09f68a None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:45.873917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b40e3-267e-4760-9cb6-7bf95e09f68a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:45.874384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b40e3-267e-4760-9cb6-7bf95e09f68a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:45.874909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:45.875989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b40e3-267e-4760-9cb6-7bf95e09f68a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:45.885655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 27/53] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:10:45.891968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b40e3-267e-4760-9cb6-7bf95e09f68a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:45.925175 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d01fbb-2784-4641-9a77-d6010a61ae07 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:45.970211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1f99a-4b79-4701-98d8-e03d02781108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:45.970917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1f99a-4b79-4701-98d8-e03d02781108 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:45.971213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1f99a-4b79-4701-98d8-e03d02781108 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:45.971492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1f99a-4b79-4701-98d8-e03d02781108 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:45.972237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1f99a-4b79-4701-98d8-e03d02781108 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:45.973832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1f99a-4b79-4701-98d8-e03d02781108 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:46.021095 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 27/54] 10.222.0.64 () {60 vars in 1140 bytes} [Fri Jul 15 15:10:45 2022] POST /identity/v3/projects => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:10:46.021320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:46.155011 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b40e3-267e-4760-9cb6-7bf95e09f68a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:46.205299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a97640-d9eb-46b9-a2e1-7b072e405886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:46.206218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a97640-d9eb-46b9-a2e1-7b072e405886 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:46.206512 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a97640-d9eb-46b9-a2e1-7b072e405886 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:46.206802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a97640-d9eb-46b9-a2e1-7b072e405886 None admin] PATH_INFO: `/v3/users/635c975960e84510ab325ac63758c0a9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:46.208101 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a97640-d9eb-46b9-a2e1-7b072e405886 None admin] RBAC: Authorizing `identity:get_user(user_id=635c975960e84510ab325ac63758c0a9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:46.210219 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a97640-d9eb-46b9-a2e1-7b072e405886 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:46.212237 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 28/55] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:10:45 2022] GET /identity/v3/users/635c975960e84510ab325ac63758c0a9 => generated 247 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:10:46.218529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1f99a-4b79-4701-98d8-e03d02781108 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:46.345269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1f99a-4b79-4701-98d8-e03d02781108 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:46.363525 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:46.385620 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412b05f-9936-46f2-b2b3-32e4d4541d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:46.386443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412b05f-9936-46f2-b2b3-32e4d4541d35 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:46.386738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412b05f-9936-46f2-b2b3-32e4d4541d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:46.387026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412b05f-9936-46f2-b2b3-32e4d4541d35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:46.388880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412b05f-9936-46f2-b2b3-32e4d4541d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:46.390655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412b05f-9936-46f2-b2b3-32e4d4541d35 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:46.392351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 28/56] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:10:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:46.399008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a97640-d9eb-46b9-a2e1-7b072e405886 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:46.499746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:46.528951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a97640-d9eb-46b9-a2e1-7b072e405886 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:46.566266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f366d7-2aaf-425a-93ab-99d696e002f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:46.566941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f366d7-2aaf-425a-93ab-99d696e002f7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:46.567236 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f366d7-2aaf-425a-93ab-99d696e002f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:46.567520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f366d7-2aaf-425a-93ab-99d696e002f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:46.568390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f366d7-2aaf-425a-93ab-99d696e002f7 None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.domain.id=default, user.id=635c975960e84510ab325ac63758c0a9) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:46.568710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f366d7-2aaf-425a-93ab-99d696e002f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:46.571495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f366d7-2aaf-425a-93ab-99d696e002f7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:46.583242 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 29/57] 10.222.0.64 () {56 vars in 1322 bytes} [Fri Jul 15 15:10:46 2022] GET /identity/v3/role_assignments?user.id=635c975960e84510ab325ac63758c0a9&scope.domain.id=default&role.id=87593f63c4744eac870c07b006022e77 => generated 530 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:48.129170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4804b5-e4c4-4d1d-8a63-09a9588babdf None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:48.129743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4804b5-e4c4-4d1d-8a63-09a9588babdf None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:48.129743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4804b5-e4c4-4d1d-8a63-09a9588babdf None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:48.131935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 29/58] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:48.137637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbec0c8-1512-4305-ac12-65b508c1f940 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:48.138073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbec0c8-1512-4305-ac12-65b508c1f940 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:48.138186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbec0c8-1512-4305-ac12-65b508c1f940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:48.155354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7dbec0c8-1512-4305-ac12-65b508c1f940 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:48.156563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7dbec0c8-1512-4305-ac12-65b508c1f940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:48.233028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 30/59] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:48.257513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4804b5-e4c4-4d1d-8a63-09a9588babdf None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:48.358323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4804b5-e4c4-4d1d-8a63-09a9588babdf None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:48.396037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffeeba-a630-4640-b5ef-68c769e54ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:48.396756 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffeeba-a630-4640-b5ef-68c769e54ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:48.397115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffeeba-a630-4640-b5ef-68c769e54ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:48.397453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffeeba-a630-4640-b5ef-68c769e54ec0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:48.399100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffeeba-a630-4640-b5ef-68c769e54ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:48.401354 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffeeba-a630-4640-b5ef-68c769e54ec0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:48.403008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 30/60] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:10:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:48.409656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbec0c8-1512-4305-ac12-65b508c1f940 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:48.485156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:48.520040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbec0c8-1512-4305-ac12-65b508c1f940 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:48.555286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12b26d-c7de-442c-954e-f20205e529f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:48.555978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12b26d-c7de-442c-954e-f20205e529f7 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:48.556269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12b26d-c7de-442c-954e-f20205e529f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:48.556549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12b26d-c7de-442c-954e-f20205e529f7 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:48.557306 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12b26d-c7de-442c-954e-f20205e529f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:48.558810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12b26d-c7de-442c-954e-f20205e529f7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:48.585988 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 31/61] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:10:48 2022] POST /identity/v3/users => generated 275 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:10:52.104033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4836b75-7878-4956-a9a1-826730d8fae6 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.104549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4836b75-7878-4956-a9a1-826730d8fae6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.104968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4836b75-7878-4956-a9a1-826730d8fae6 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.107386 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 31/62] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:52.127269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b981c-e727-4a6c-9eee-85a1b61ab740 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.128241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b981c-e727-4a6c-9eee-85a1b61ab740 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.128729 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b981c-e727-4a6c-9eee-85a1b61ab740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.153601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c37b981c-e727-4a6c-9eee-85a1b61ab740 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:52.155193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c37b981c-e727-4a6c-9eee-85a1b61ab740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:52.254352 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 32/63] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:10:52.325736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4836b75-7878-4956-a9a1-826730d8fae6 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:52.338007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10bcc3-91d3-4d10-b4d0-cd653c427edb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.338885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10bcc3-91d3-4d10-b4d0-cd653c427edb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.341438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10bcc3-91d3-4d10-b4d0-cd653c427edb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.343207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 33/64] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:52.353950 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410789-e799-4493-a801-7c39922ad804 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.354626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410789-e799-4493-a801-7c39922ad804 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.355116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410789-e799-4493-a801-7c39922ad804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.380398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-69410789-e799-4493-a801-7c39922ad804 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:52.382850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-69410789-e799-4493-a801-7c39922ad804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:52.444723 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:52.452414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:52.486469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 34/65] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:52.511645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410789-e799-4493-a801-7c39922ad804 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:52.550984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4836b75-7878-4956-a9a1-826730d8fae6 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:52.597013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7045355-3522-4ff2-a6c5-5e9b2867e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:52.598614 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7045355-3522-4ff2-a6c5-5e9b2867e675 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.599280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7045355-3522-4ff2-a6c5-5e9b2867e675 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.599961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7045355-3522-4ff2-a6c5-5e9b2867e675 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.614707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7045355-3522-4ff2-a6c5-5e9b2867e675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c7045355-3522-4ff2-a6c5-5e9b2867e675 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:10:52.624071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:10:52.625357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:10:52.626346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 32/66] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:10:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:10:52.626980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81020b-9751-4730-8021-1b3c0fdb6053 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.627043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81020b-9751-4730-8021-1b3c0fdb6053 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.627283 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81020b-9751-4730-8021-1b3c0fdb6053 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.628880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 33/67] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:52.630251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38372b0-72a8-4ec4-9345-1a7c60488835 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.630690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38372b0-72a8-4ec4-9345-1a7c60488835 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.631910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38372b0-72a8-4ec4-9345-1a7c60488835 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.633583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 34/68] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:52.635070 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eac6ea-eaa4-44c8-85a9-712acd5d565f None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.635501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eac6ea-eaa4-44c8-85a9-712acd5d565f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.635911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eac6ea-eaa4-44c8-85a9-712acd5d565f None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.637448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 35/69] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:52.638291 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eac6ea-eaa4-44c8-85a9-712acd5d565f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:52.650806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410789-e799-4493-a801-7c39922ad804 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:52.694482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654290e2-82a5-455e-b8a5-3c9de8ea09db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:52.695302 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654290e2-82a5-455e-b8a5-3c9de8ea09db None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.695743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654290e2-82a5-455e-b8a5-3c9de8ea09db None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.695913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654290e2-82a5-455e-b8a5-3c9de8ea09db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.707132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654290e2-82a5-455e-b8a5-3c9de8ea09db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-654290e2-82a5-455e-b8a5-3c9de8ea09db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:10:52.715635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:10:52.716612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:10:52.717891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 35/70] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:10:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:10:52.719090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16bb27-e9c2-4e8f-9137-e46a2ab76448 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.719090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16bb27-e9c2-4e8f-9137-e46a2ab76448 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.719090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16bb27-e9c2-4e8f-9137-e46a2ab76448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.740537 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5d16bb27-e9c2-4e8f-9137-e46a2ab76448 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:52.742301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5d16bb27-e9c2-4e8f-9137-e46a2ab76448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:52.778032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eac6ea-eaa4-44c8-85a9-712acd5d565f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:52.794257 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:52.808143 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:52.825771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d2d46-9a21-4052-98a6-2d11e35b8217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:52.830884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d2d46-9a21-4052-98a6-2d11e35b8217 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.830884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d2d46-9a21-4052-98a6-2d11e35b8217 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.830884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d2d46-9a21-4052-98a6-2d11e35b8217 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.830884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d2d46-9a21-4052-98a6-2d11e35b8217 None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:52.830884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d2d46-9a21-4052-98a6-2d11e35b8217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:52.830884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d2d46-9a21-4052-98a6-2d11e35b8217 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:52.840229 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 36/71] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:10:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:52.841560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf030abe-303f-4cf9-bcce-7de165ebf4e5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.841856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf030abe-303f-4cf9-bcce-7de165ebf4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.842143 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf030abe-303f-4cf9-bcce-7de165ebf4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.847441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 36/72] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:52.849652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04761130-9107-4b87-a948-1d58b53c1a1e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:52.850791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04761130-9107-4b87-a948-1d58b53c1a1e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:52.851148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04761130-9107-4b87-a948-1d58b53c1a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:52.863394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-cf030abe-303f-4cf9-bcce-7de165ebf4e5 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:52.865136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cf030abe-303f-4cf9-bcce-7de165ebf4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:52.871687 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-04761130-9107-4b87-a948-1d58b53c1a1e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:52.872928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-04761130-9107-4b87-a948-1d58b53c1a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:52.943849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 37/73] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:52.944727 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf030abe-303f-4cf9-bcce-7de165ebf4e5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:52.965201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 37/74] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:52.965201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04761130-9107-4b87-a948-1d58b53c1a1e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:53.063152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf030abe-303f-4cf9-bcce-7de165ebf4e5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:53.065802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:53.074101 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04761130-9107-4b87-a948-1d58b53c1a1e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:53.083923 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:53.110786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e110dc-3bbe-4707-8c1b-1ff97c56abf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:53.111471 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e110dc-3bbe-4707-8c1b-1ff97c56abf3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:53.111760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e110dc-3bbe-4707-8c1b-1ff97c56abf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:53.112037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e110dc-3bbe-4707-8c1b-1ff97c56abf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:53.112813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e110dc-3bbe-4707-8c1b-1ff97c56abf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:53.113153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e110dc-3bbe-4707-8c1b-1ff97c56abf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:53.114054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a9a47-ee2d-461f-9035-7d7f64c9bb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:53.114560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e110dc-3bbe-4707-8c1b-1ff97c56abf3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:53.114874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a9a47-ee2d-461f-9035-7d7f64c9bb8b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:53.115160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a9a47-ee2d-461f-9035-7d7f64c9bb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:53.115438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a9a47-ee2d-461f-9035-7d7f64c9bb8b None admin] PATH_INFO: `/v3/users/3564ee5cf4b74d50a0faeae97059d272` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:53.123307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 38/75] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:53.124166 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e110dc-3bbe-4707-8c1b-1ff97c56abf3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:53.135424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a9a47-ee2d-461f-9035-7d7f64c9bb8b None admin] RBAC: Authorizing `identity:get_user(user_id=3564ee5cf4b74d50a0faeae97059d272)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:53.136935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a9a47-ee2d-461f-9035-7d7f64c9bb8b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:53.138931 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 38/76] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:10:52 2022] GET /identity/v3/users/3564ee5cf4b74d50a0faeae97059d272 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:53.139812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a9a47-ee2d-461f-9035-7d7f64c9bb8b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:53.258349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e110dc-3bbe-4707-8c1b-1ff97c56abf3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:53.278627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a9a47-ee2d-461f-9035-7d7f64c9bb8b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:53.299041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338680de-7267-4171-a9bc-e400b4d7b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:53.299866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338680de-7267-4171-a9bc-e400b4d7b122 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:53.300160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338680de-7267-4171-a9bc-e400b4d7b122 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:53.300493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338680de-7267-4171-a9bc-e400b4d7b122 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:53.311777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338680de-7267-4171-a9bc-e400b4d7b122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:10:53.316633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e010cc-1e98-4006-8f54-d2fd1dc8a7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:53.317404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e010cc-1e98-4006-8f54-d2fd1dc8a7cd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:53.317703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e010cc-1e98-4006-8f54-d2fd1dc8a7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:53.317991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e010cc-1e98-4006-8f54-d2fd1dc8a7cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:53.319728 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e010cc-1e98-4006-8f54-d2fd1dc8a7cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-338680de-7267-4171-a9bc-e400b4d7b122 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:10:53.320692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:10:53.321762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:10:53.328008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:10:53.328008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:10:53.328008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:10:53.328008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:10:53.328008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:10:53.328008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:10:53.328008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:10:53.328008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:10:53.328008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:10:53.328008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:10:53.328008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:10:53.328008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:10:53.328766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e010cc-1e98-4006-8f54-d2fd1dc8a7cd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:53.328857 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 39/77] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:10:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:10:53.328857 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338680de-7267-4171-a9bc-e400b4d7b122 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:53.329005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 39/78] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:10:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:53.329005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e010cc-1e98-4006-8f54-d2fd1dc8a7cd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:53.363206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:53.365194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:53.454382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338680de-7267-4171-a9bc-e400b4d7b122 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:53.457717 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e010cc-1e98-4006-8f54-d2fd1dc8a7cd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:53.494120 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de77200-1c8e-45ac-89f7-5fecb913510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:53.495026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de77200-1c8e-45ac-89f7-5fecb913510d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:53.495309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de77200-1c8e-45ac-89f7-5fecb913510d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:53.495591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de77200-1c8e-45ac-89f7-5fecb913510d None admin] PATH_INFO: `/v3/users/635c975960e84510ab325ac63758c0a9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:53.496823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de77200-1c8e-45ac-89f7-5fecb913510d None admin] RBAC: Authorizing `identity:get_user(user_id=635c975960e84510ab325ac63758c0a9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:53.498360 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de77200-1c8e-45ac-89f7-5fecb913510d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:53.500046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 40/79] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:10:53 2022] GET /identity/v3/users/635c975960e84510ab325ac63758c0a9 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:53.500845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de77200-1c8e-45ac-89f7-5fecb913510d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:53.510556 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73340462-854c-4e5d-9e37-fc74c30b10b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:53.511450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73340462-854c-4e5d-9e37-fc74c30b10b3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:53.511745 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73340462-854c-4e5d-9e37-fc74c30b10b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:53.512032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73340462-854c-4e5d-9e37-fc74c30b10b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:53.523308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73340462-854c-4e5d-9e37-fc74c30b10b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-73340462-854c-4e5d-9e37-fc74c30b10b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:10:53.531263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:10:53.532302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 40/80] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:10:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:10:53.533303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73340462-854c-4e5d-9e37-fc74c30b10b3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:53.613494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:53.617742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de77200-1c8e-45ac-89f7-5fecb913510d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:53.635627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:53.652665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73340462-854c-4e5d-9e37-fc74c30b10b3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:53.666038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41eac0f-1ae1-4d08-9db0-323f2a644e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:53.666740 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41eac0f-1ae1-4d08-9db0-323f2a644e70 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:53.667036 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41eac0f-1ae1-4d08-9db0-323f2a644e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:53.667324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41eac0f-1ae1-4d08-9db0-323f2a644e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:53.688004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64b32f-55d9-4f34-a2a2-5be067b3b571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:53.688704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64b32f-55d9-4f34-a2a2-5be067b3b571 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:53.688993 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64b32f-55d9-4f34-a2a2-5be067b3b571 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:53.689311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64b32f-55d9-4f34-a2a2-5be067b3b571 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:53.690095 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64b32f-55d9-4f34-a2a2-5be067b3b571 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:53.690412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64b32f-55d9-4f34-a2a2-5be067b3b571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:53.691856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64b32f-55d9-4f34-a2a2-5be067b3b571 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:53.700622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 41/81] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:10:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:53.701583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64b32f-55d9-4f34-a2a2-5be067b3b571 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:53.759877 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41eac0f-1ae1-4d08-9db0-323f2a644e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:53.761422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41eac0f-1ae1-4d08-9db0-323f2a644e70 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:53.830076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64b32f-55d9-4f34-a2a2-5be067b3b571 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:53.865658 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641e633-f693-4203-97ff-c165148be252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:53.866350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641e633-f693-4203-97ff-c165148be252 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:53.866644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641e633-f693-4203-97ff-c165148be252 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:53.866934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641e633-f693-4203-97ff-c165148be252 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:53.867656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641e633-f693-4203-97ff-c165148be252 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:53.869242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641e633-f693-4203-97ff-c165148be252 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:53.873133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:53.877765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 41/82] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:10:53.884413 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41eac0f-1ae1-4d08-9db0-323f2a644e70 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:53.917091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 42/83] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:10:53 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:10:53.917091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641e633-f693-4203-97ff-c165148be252 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:53.919733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:54.015279 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41eac0f-1ae1-4d08-9db0-323f2a644e70 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:54.062669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641e633-f693-4203-97ff-c165148be252 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:54.064393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c90bdd-840b-422f-a842-6cbeeca7d308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:54.065315 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c90bdd-840b-422f-a842-6cbeeca7d308 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:54.065610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c90bdd-840b-422f-a842-6cbeeca7d308 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:54.065901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c90bdd-840b-422f-a842-6cbeeca7d308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:54.104972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84738f14-f217-4d8c-9f50-05f6c3a1fa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:54.105699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84738f14-f217-4d8c-9f50-05f6c3a1fa0c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:54.105989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84738f14-f217-4d8c-9f50-05f6c3a1fa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:54.106272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84738f14-f217-4d8c-9f50-05f6c3a1fa0c None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:54.107124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84738f14-f217-4d8c-9f50-05f6c3a1fa0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:54.107364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84738f14-f217-4d8c-9f50-05f6c3a1fa0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:54.108780 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84738f14-f217-4d8c-9f50-05f6c3a1fa0c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:54.125950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 43/84] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:10:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:54.127274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84738f14-f217-4d8c-9f50-05f6c3a1fa0c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:54.197395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:54.201639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c90bdd-840b-422f-a842-6cbeeca7d308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:54.204516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c90bdd-840b-422f-a842-6cbeeca7d308 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:54.254159 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:54.302337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84738f14-f217-4d8c-9f50-05f6c3a1fa0c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:54.343201 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761564d9-074f-4d33-b931-e88875d72082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:54.344187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761564d9-074f-4d33-b931-e88875d72082 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:54.344481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761564d9-074f-4d33-b931-e88875d72082 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:54.344762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761564d9-074f-4d33-b931-e88875d72082 None admin] PATH_INFO: `/v3/users/3564ee5cf4b74d50a0faeae97059d272` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:54.346127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761564d9-074f-4d33-b931-e88875d72082 None admin] RBAC: Authorizing `identity:get_user(user_id=3564ee5cf4b74d50a0faeae97059d272)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:54.347710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761564d9-074f-4d33-b931-e88875d72082 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:54.349799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 44/85] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:10:54 2022] GET /identity/v3/users/3564ee5cf4b74d50a0faeae97059d272 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:54.350425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761564d9-074f-4d33-b931-e88875d72082 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:54.360890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 42/86] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:10:54.361802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c90bdd-840b-422f-a842-6cbeeca7d308 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:54.498189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:54.503015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c90bdd-840b-422f-a842-6cbeeca7d308 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:54.511102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761564d9-074f-4d33-b931-e88875d72082 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:54.555558 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdffd8-cdf4-48eb-80c9-19b897b16fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:54.556810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdffd8-cdf4-48eb-80c9-19b897b16fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:54.557224 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80118b-f679-4962-9fcf-4fe29f0d7a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:54.557485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdffd8-cdf4-48eb-80c9-19b897b16fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:54.557906 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdffd8-cdf4-48eb-80c9-19b897b16fb0 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:54.558331 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80118b-f679-4962-9fcf-4fe29f0d7a86 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:54.558694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80118b-f679-4962-9fcf-4fe29f0d7a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:54.559155 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80118b-f679-4962-9fcf-4fe29f0d7a86 None admin] PATH_INFO: `/v3/users/3564ee5cf4b74d50a0faeae97059d272` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:54.559810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdffd8-cdf4-48eb-80c9-19b897b16fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:54.560689 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80118b-f679-4962-9fcf-4fe29f0d7a86 None admin] RBAC: Authorizing `identity:get_user(user_id=3564ee5cf4b74d50a0faeae97059d272)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:54.561707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdffd8-cdf4-48eb-80c9-19b897b16fb0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:54.562506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80118b-f679-4962-9fcf-4fe29f0d7a86 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:54.563992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 45/87] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:10:54 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:54.564440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 43/88] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:10:54 2022] GET /identity/v3/users/3564ee5cf4b74d50a0faeae97059d272 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:54.565124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdffd8-cdf4-48eb-80c9-19b897b16fb0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:54.569932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:54.570159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80118b-f679-4962-9fcf-4fe29f0d7a86 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:54.719992 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80118b-f679-4962-9fcf-4fe29f0d7a86 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:54.729926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdffd8-cdf4-48eb-80c9-19b897b16fb0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:54.765842 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fe3d3-9e68-4bf0-9558-82c0d4fe1519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:54.767276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fe3d3-9e68-4bf0-9558-82c0d4fe1519 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:54.767884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fe3d3-9e68-4bf0-9558-82c0d4fe1519 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:54.768329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fe3d3-9e68-4bf0-9558-82c0d4fe1519 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:54.770488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fe3d3-9e68-4bf0-9558-82c0d4fe1519 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:54.772859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fe3d3-9e68-4bf0-9558-82c0d4fe1519 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:54.775018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 44/89] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:10:54 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:54.776330 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fe3d3-9e68-4bf0-9558-82c0d4fe1519 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:54.789630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8af70-76d5-4fd3-a374-bc525a60d06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:54.790777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8af70-76d5-4fd3-a374-bc525a60d06d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:54.791268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8af70-76d5-4fd3-a374-bc525a60d06d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:54.791760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8af70-76d5-4fd3-a374-bc525a60d06d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:54.836495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:54.899669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8af70-76d5-4fd3-a374-bc525a60d06d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:54.901278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8af70-76d5-4fd3-a374-bc525a60d06d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:54.903490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:54.944082 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fe3d3-9e68-4bf0-9558-82c0d4fe1519 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:54.996582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cb500-a778-4989-9c90-c1fb2def6a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:54.997611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cb500-a778-4989-9c90-c1fb2def6a8b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:54.998084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cb500-a778-4989-9c90-c1fb2def6a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:54.998545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cb500-a778-4989-9c90-c1fb2def6a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:54.999630 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cb500-a778-4989-9c90-c1fb2def6a8b None admin] RBAC: Adding query filter params (role.id=b670784e829b4bffb77b03422132634a, scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a, user.id=3564ee5cf4b74d50a0faeae97059d272) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:55.000960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cb500-a778-4989-9c90-c1fb2def6a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:55.003406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cb500-a778-4989-9c90-c1fb2def6a8b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:55.013757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 45/90] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:10:54 2022] GET /identity/v3/role_assignments?user.id=3564ee5cf4b74d50a0faeae97059d272&scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a&role.id=b670784e829b4bffb77b03422132634a => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:55.015027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cb500-a778-4989-9c90-c1fb2def6a8b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:55.066200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 46/91] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:10:55.067107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8af70-76d5-4fd3-a374-bc525a60d06d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:55.155667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:55.162253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cb500-a778-4989-9c90-c1fb2def6a8b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:55.225558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c94ef-7987-4f1a-8454-a94c8f332173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:55.233047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c94ef-7987-4f1a-8454-a94c8f332173 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:55.236599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c94ef-7987-4f1a-8454-a94c8f332173 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:55.238243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c94ef-7987-4f1a-8454-a94c8f332173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:55.359942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8af70-76d5-4fd3-a374-bc525a60d06d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:55.369525 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:55.401665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c94ef-7987-4f1a-8454-a94c8f332173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:55.404341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c94ef-7987-4f1a-8454-a94c8f332173 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:55.429395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620622d0-e0b7-44ae-b44d-5ea08cacf668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:55.430083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620622d0-e0b7-44ae-b44d-5ea08cacf668 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:55.430378 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620622d0-e0b7-44ae-b44d-5ea08cacf668 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:55.430664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620622d0-e0b7-44ae-b44d-5ea08cacf668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:55.431536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620622d0-e0b7-44ae-b44d-5ea08cacf668 None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a, user.id=635c975960e84510ab325ac63758c0a9) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:55.431860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620622d0-e0b7-44ae-b44d-5ea08cacf668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:55.433442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620622d0-e0b7-44ae-b44d-5ea08cacf668 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:55.451040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 47/92] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:10:55 2022] GET /identity/v3/role_assignments?user.id=635c975960e84510ab325ac63758c0a9&scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a&role.id=87593f63c4744eac870c07b006022e77 => generated 259 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:55.451940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620622d0-e0b7-44ae-b44d-5ea08cacf668 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:55.688513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620622d0-e0b7-44ae-b44d-5ea08cacf668 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:55.710867 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:55.720372 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 46/93] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:10:55.727054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c94ef-7987-4f1a-8454-a94c8f332173 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:55.763851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d023d2e-129d-47d8-ab28-a8dce2467f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:55.764766 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d023d2e-129d-47d8-ab28-a8dce2467f35 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:55.765185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d023d2e-129d-47d8-ab28-a8dce2467f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:55.765474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d023d2e-129d-47d8-ab28-a8dce2467f35 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:55.767662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d023d2e-129d-47d8-ab28-a8dce2467f35 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:55.769343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d023d2e-129d-47d8-ab28-a8dce2467f35 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:55.771163 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 48/94] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:10:55 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:55.778151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d023d2e-129d-47d8-ab28-a8dce2467f35 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:55.849571 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:55.949557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c94ef-7987-4f1a-8454-a94c8f332173 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:56.024930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0d470-dbbb-44f4-8676-19bfec904cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:56.025903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0d470-dbbb-44f4-8676-19bfec904cec None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:56.026370 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0d470-dbbb-44f4-8676-19bfec904cec None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:56.026653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0d470-dbbb-44f4-8676-19bfec904cec None admin] PATH_INFO: `/v3/projects/3e116fb0bb0d4d42af1708686206ab88` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:56.028151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0d470-dbbb-44f4-8676-19bfec904cec None admin] RBAC: Authorizing `identity:get_project(project_id=3e116fb0bb0d4d42af1708686206ab88)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:56.029947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0d470-dbbb-44f4-8676-19bfec904cec None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:56.033171 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 47/95] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:10:55 2022] GET /identity/v3/projects/3e116fb0bb0d4d42af1708686206ab88 => generated 312 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:56.042249 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0d470-dbbb-44f4-8676-19bfec904cec None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:56.049409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d023d2e-129d-47d8-ab28-a8dce2467f35 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:56.158794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a1663-14c3-4a45-950b-8166ce8f21b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:56.159482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a1663-14c3-4a45-950b-8166ce8f21b6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:56.159776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a1663-14c3-4a45-950b-8166ce8f21b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:56.160067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a1663-14c3-4a45-950b-8166ce8f21b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:56.160930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a1663-14c3-4a45-950b-8166ce8f21b6 None admin] RBAC: Adding query filter params (role.id=f5fb67c95c834bc9b359a5141ae0f60c, scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a, user.id=3564ee5cf4b74d50a0faeae97059d272) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:56.161279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a1663-14c3-4a45-950b-8166ce8f21b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:56.163366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a1663-14c3-4a45-950b-8166ce8f21b6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:56.179621 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 49/96] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:10:55 2022] GET /identity/v3/role_assignments?user.id=3564ee5cf4b74d50a0faeae97059d272&scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a&role.id=f5fb67c95c834bc9b359a5141ae0f60c => generated 259 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:56.230385 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:56.281511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0d470-dbbb-44f4-8676-19bfec904cec None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:56.322996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05208bb9-95ac-467b-8d4b-b6839ef67630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:56.323679 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05208bb9-95ac-467b-8d4b-b6839ef67630 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:56.323968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05208bb9-95ac-467b-8d4b-b6839ef67630 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:56.324343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05208bb9-95ac-467b-8d4b-b6839ef67630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:56.325233 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05208bb9-95ac-467b-8d4b-b6839ef67630 None admin] RBAC: Adding query filter params (role.id=b670784e829b4bffb77b03422132634a, scope.project.id=3e116fb0bb0d4d42af1708686206ab88, user.id=3564ee5cf4b74d50a0faeae97059d272) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:56.325552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05208bb9-95ac-467b-8d4b-b6839ef67630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:56.327026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05208bb9-95ac-467b-8d4b-b6839ef67630 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:56.333375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 48/97] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:10:56 2022] GET /identity/v3/role_assignments?user.id=3564ee5cf4b74d50a0faeae97059d272&scope.project.id=3e116fb0bb0d4d42af1708686206ab88&role.id=b670784e829b4bffb77b03422132634a => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:56.417403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e703c88-e493-4503-91b5-5907011df541 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:56.418442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e703c88-e493-4503-91b5-5907011df541 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:56.418960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e703c88-e493-4503-91b5-5907011df541 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:56.420712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 50/98] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:56.427010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122fdf8-d303-4301-974e-4ee6d9b37179 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:56.427316 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122fdf8-d303-4301-974e-4ee6d9b37179 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:56.427587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122fdf8-d303-4301-974e-4ee6d9b37179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:56.454504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d122fdf8-d303-4301-974e-4ee6d9b37179 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:56.455770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d122fdf8-d303-4301-974e-4ee6d9b37179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:56.555148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 49/99] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:56.579288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e703c88-e493-4503-91b5-5907011df541 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:56.736450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:56.742601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e703c88-e493-4503-91b5-5907011df541 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:56.797143 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51162d98-9a74-4f3b-a011-866f7f2989ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:56.798085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51162d98-9a74-4f3b-a011-866f7f2989ac None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:56.798371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51162d98-9a74-4f3b-a011-866f7f2989ac None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:56.798700 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51162d98-9a74-4f3b-a011-866f7f2989ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:56.816542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51162d98-9a74-4f3b-a011-866f7f2989ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-51162d98-9a74-4f3b-a011-866f7f2989ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:10:56.825507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:10:56.826647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:10:56.827499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:10:56.827499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:10:56.827499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:10:56.827499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:10:56.827499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:10:56.827499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:10:56.827499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:10:56.827499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:10:56.827499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:10:56.827499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:10:56.827499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:10:56.827499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:10:56.829917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 51/100] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:10:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:10:56.843232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122fdf8-d303-4301-974e-4ee6d9b37179 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:56.928502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:56.989371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122fdf8-d303-4301-974e-4ee6d9b37179 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:56.997549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d67a3-a0ac-4e04-aefc-b3213d327789 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:56.997887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d67a3-a0ac-4e04-aefc-b3213d327789 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:56.998150 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d67a3-a0ac-4e04-aefc-b3213d327789 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:56.999720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 52/101] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:57.005248 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41cc9c-9fcb-4db4-9d87-7c8b9e202aa0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:57.005559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41cc9c-9fcb-4db4-9d87-7c8b9e202aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:57.006088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41cc9c-9fcb-4db4-9d87-7c8b9e202aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:57.030068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2d41cc9c-9fcb-4db4-9d87-7c8b9e202aa0 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:57.031316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2d41cc9c-9fcb-4db4-9d87-7c8b9e202aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:57.050307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf4853-b3d1-464e-a0c8-8ee0f6b974ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:57.051006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf4853-b3d1-464e-a0c8-8ee0f6b974ba None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:57.051290 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf4853-b3d1-464e-a0c8-8ee0f6b974ba None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:57.051567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf4853-b3d1-464e-a0c8-8ee0f6b974ba None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:57.052350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf4853-b3d1-464e-a0c8-8ee0f6b974ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:57.052662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf4853-b3d1-464e-a0c8-8ee0f6b974ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:57.055189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf4853-b3d1-464e-a0c8-8ee0f6b974ba None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:57.075745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 50/102] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:10:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:57.081179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf4853-b3d1-464e-a0c8-8ee0f6b974ba None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:57.165034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 53/103] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:10:57.236406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41cc9c-9fcb-4db4-9d87-7c8b9e202aa0 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:57.293195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf4853-b3d1-464e-a0c8-8ee0f6b974ba None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:57.331963 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:57.354074 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d5a0a-002e-44cf-b32c-bcabff7e1588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:57.355362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d5a0a-002e-44cf-b32c-bcabff7e1588 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:57.355869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d5a0a-002e-44cf-b32c-bcabff7e1588 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:57.356352 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d5a0a-002e-44cf-b32c-bcabff7e1588 None admin] PATH_INFO: `/v3/users/827eafcf3aa34ae89beeb798f466e590` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:57.379440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d5a0a-002e-44cf-b32c-bcabff7e1588 None admin] RBAC: Authorizing `identity:get_user(user_id=827eafcf3aa34ae89beeb798f466e590)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:57.381813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d5a0a-002e-44cf-b32c-bcabff7e1588 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:57.389092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 51/104] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:10:57 2022] GET /identity/v3/users/827eafcf3aa34ae89beeb798f466e590 => generated 289 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:10:57.399792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d5a0a-002e-44cf-b32c-bcabff7e1588 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:57.540246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:57.604027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41cc9c-9fcb-4db4-9d87-7c8b9e202aa0 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:57.708227 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d5a0a-002e-44cf-b32c-bcabff7e1588 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:57.734462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016ea02-8bad-459a-883f-996d92e14d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:57.735825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016ea02-8bad-459a-883f-996d92e14d79 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:57.736328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016ea02-8bad-459a-883f-996d92e14d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:57.736817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016ea02-8bad-459a-883f-996d92e14d79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:57.742205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016ea02-8bad-459a-883f-996d92e14d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:57.744927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016ea02-8bad-459a-883f-996d92e14d79 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:57.757947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 54/105] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:10:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:57.762668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016ea02-8bad-459a-883f-996d92e14d79 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:57.840911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c141384-9e5a-41a2-9176-5b35ae5fcd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:57.841629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c141384-9e5a-41a2-9176-5b35ae5fcd9a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:57.841917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c141384-9e5a-41a2-9176-5b35ae5fcd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:57.842201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c141384-9e5a-41a2-9176-5b35ae5fcd9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:57.970122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:58.001434 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c141384-9e5a-41a2-9176-5b35ae5fcd9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:58.003280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c141384-9e5a-41a2-9176-5b35ae5fcd9a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:58.043370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016ea02-8bad-459a-883f-996d92e14d79 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:58.113988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3474b0-6576-4f7d-83fa-be30f18e4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:58.114943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3474b0-6576-4f7d-83fa-be30f18e4360 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:58.115463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3474b0-6576-4f7d-83fa-be30f18e4360 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:58.115890 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3474b0-6576-4f7d-83fa-be30f18e4360 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:58.116771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3474b0-6576-4f7d-83fa-be30f18e4360 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:58.119495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3474b0-6576-4f7d-83fa-be30f18e4360 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:58.148928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 52/106] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 15:10:58.155000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c141384-9e5a-41a2-9176-5b35ae5fcd9a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:58.196992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 55/107] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:10:57 2022] POST /identity/v3/projects => generated 302 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:10:58.260659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:58.285084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c141384-9e5a-41a2-9176-5b35ae5fcd9a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:58.331605 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15da3ca-32ad-4092-8293-c6d6da0620ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:58.333375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15da3ca-32ad-4092-8293-c6d6da0620ec None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:58.333853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15da3ca-32ad-4092-8293-c6d6da0620ec None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:58.334847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15da3ca-32ad-4092-8293-c6d6da0620ec None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:58.336648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15da3ca-32ad-4092-8293-c6d6da0620ec None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:58.339614 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15da3ca-32ad-4092-8293-c6d6da0620ec None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:58.341852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 53/108] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:10:58 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:10:58.348258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3474b0-6576-4f7d-83fa-be30f18e4360 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:58.366136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:58.514638 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3474b0-6576-4f7d-83fa-be30f18e4360 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:58.569342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a43277-91b5-458a-a0b0-5a1e8eb6aaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:58.570114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a43277-91b5-458a-a0b0-5a1e8eb6aaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:58.570313 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a43277-91b5-458a-a0b0-5a1e8eb6aaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:58.570597 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a43277-91b5-458a-a0b0-5a1e8eb6aaa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:58.571453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a43277-91b5-458a-a0b0-5a1e8eb6aaa1 None admin] RBAC: Adding query filter params (role.id=0af3acb37467488c9ef322c203b98fd9, scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a, user.id=827eafcf3aa34ae89beeb798f466e590) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:58.571768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a43277-91b5-458a-a0b0-5a1e8eb6aaa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:58.573279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a43277-91b5-458a-a0b0-5a1e8eb6aaa1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:58.581837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 56/109] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:10:58 2022] GET /identity/v3/role_assignments?user.id=827eafcf3aa34ae89beeb798f466e590&scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a&role.id=0af3acb37467488c9ef322c203b98fd9 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:58.609355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d626-4e63-436f-bda9-63bd12b339c9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:58.609685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d626-4e63-436f-bda9-63bd12b339c9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:58.609935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d626-4e63-436f-bda9-63bd12b339c9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:58.611521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 54/110] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:10:58.617759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cb9ae-e4b4-4860-bd16-7d33807c341e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:58.618067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cb9ae-e4b4-4860-bd16-7d33807c341e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:58.618341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cb9ae-e4b4-4860-bd16-7d33807c341e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:58.645904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-358cb9ae-e4b4-4860-bd16-7d33807c341e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:58.647985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-358cb9ae-e4b4-4860-bd16-7d33807c341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:58.750433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 57/111] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:10:58.774744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d626-4e63-436f-bda9-63bd12b339c9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:58.849843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2e40d-7660-4d8b-8801-dc5a369c8215 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:58.850194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2e40d-7660-4d8b-8801-dc5a369c8215 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:58.850662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2e40d-7660-4d8b-8801-dc5a369c8215 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:58.852492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 58/112] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:10:58.863224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077a14e-9a0b-4021-a663-3060457fb644 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:58.863537 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077a14e-9a0b-4021-a663-3060457fb644 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:58.863796 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077a14e-9a0b-4021-a663-3060457fb644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:58.870066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:58.896074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7077a14e-9a0b-4021-a663-3060457fb644 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:10:58.897373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7077a14e-9a0b-4021-a663-3060457fb644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:10:58.960559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d626-4e63-436f-bda9-63bd12b339c9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:59.030875 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea73d8-1d24-4212-accb-23ece68ad501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:59.032788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea73d8-1d24-4212-accb-23ece68ad501 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:59.033092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea73d8-1d24-4212-accb-23ece68ad501 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:59.033390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea73d8-1d24-4212-accb-23ece68ad501 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:59.056726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 59/113] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:10:59.057601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea73d8-1d24-4212-accb-23ece68ad501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-31ea73d8-1d24-4212-accb-23ece68ad501 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:10:59.065892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:10:59.066846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:10:59.067609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 55/114] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:10:59.078638 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077a14e-9a0b-4021-a663-3060457fb644 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:59.106011 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea73d8-1d24-4212-accb-23ece68ad501 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:59.126673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:59.339897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea73d8-1d24-4212-accb-23ece68ad501 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:59.383064 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077a14e-9a0b-4021-a663-3060457fb644 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:59.418007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d7c61-5ce8-4537-8b8d-fc6cc8f4d091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:59.418994 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d7c61-5ce8-4537-8b8d-fc6cc8f4d091 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:59.419667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d7c61-5ce8-4537-8b8d-fc6cc8f4d091 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:59.420054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d7c61-5ce8-4537-8b8d-fc6cc8f4d091 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:59.446075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d7c61-5ce8-4537-8b8d-fc6cc8f4d091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9d2d7c61-5ce8-4537-8b8d-fc6cc8f4d091 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:10:59.455169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:10:59.456281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:10:59.457201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 56/115] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:10:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:10:59.466115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d7c61-5ce8-4537-8b8d-fc6cc8f4d091 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:59.467511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:59.476251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f2a34-b8db-4aaa-b5a8-fad82e1925aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:59.476962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f2a34-b8db-4aaa-b5a8-fad82e1925aa None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:59.477337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f2a34-b8db-4aaa-b5a8-fad82e1925aa None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:59.477629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f2a34-b8db-4aaa-b5a8-fad82e1925aa None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:59.478415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f2a34-b8db-4aaa-b5a8-fad82e1925aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:59.478733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f2a34-b8db-4aaa-b5a8-fad82e1925aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:59.480216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f2a34-b8db-4aaa-b5a8-fad82e1925aa None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:59.501040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 60/116] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:10:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:10:59.507998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f2a34-b8db-4aaa-b5a8-fad82e1925aa None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:59.669208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f2a34-b8db-4aaa-b5a8-fad82e1925aa None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:59.672161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:59.725527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd426653-7dbf-47fa-9077-1613a7f9a95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:59.726895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd426653-7dbf-47fa-9077-1613a7f9a95d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:59.727396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd426653-7dbf-47fa-9077-1613a7f9a95d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:59.727876 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd426653-7dbf-47fa-9077-1613a7f9a95d None admin] PATH_INFO: `/v3/users/3564ee5cf4b74d50a0faeae97059d272` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:59.730943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd426653-7dbf-47fa-9077-1613a7f9a95d None admin] RBAC: Authorizing `identity:get_user(user_id=3564ee5cf4b74d50a0faeae97059d272)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:59.732717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd426653-7dbf-47fa-9077-1613a7f9a95d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:59.734947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 61/117] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:10:59 2022] GET /identity/v3/users/3564ee5cf4b74d50a0faeae97059d272 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:59.742935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd426653-7dbf-47fa-9077-1613a7f9a95d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:59.753893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d7c61-5ce8-4537-8b8d-fc6cc8f4d091 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:10:59.834550 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f178ee2-0e96-4def-b827-734ff95a9c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:10:59.835257 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f178ee2-0e96-4def-b827-734ff95a9c57 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:59.835544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f178ee2-0e96-4def-b827-734ff95a9c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:59.835824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f178ee2-0e96-4def-b827-734ff95a9c57 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:59.836835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f178ee2-0e96-4def-b827-734ff95a9c57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:10:59.837244 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f178ee2-0e96-4def-b827-734ff95a9c57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:10:59.839125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f178ee2-0e96-4def-b827-734ff95a9c57 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:10:59.856671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 57/118] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:10:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:10:59.862497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667f546-0a45-4fd6-b868-b8e964c465cb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:10:59.863013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667f546-0a45-4fd6-b868-b8e964c465cb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:10:59.863690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667f546-0a45-4fd6-b868-b8e964c465cb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:10:59.866384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 58/119] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:10:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:10:59.867475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667f546-0a45-4fd6-b868-b8e964c465cb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:10:59.881730 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:10:59.950116 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd426653-7dbf-47fa-9077-1613a7f9a95d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:00.016834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b24dfc-4b9d-4f00-9756-79c3bb00cf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:00.018036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b24dfc-4b9d-4f00-9756-79c3bb00cf57 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:00.018509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b24dfc-4b9d-4f00-9756-79c3bb00cf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:00.019051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b24dfc-4b9d-4f00-9756-79c3bb00cf57 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:00.020600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b24dfc-4b9d-4f00-9756-79c3bb00cf57 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:00.027493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667f546-0a45-4fd6-b868-b8e964c465cb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:00.029578 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b24dfc-4b9d-4f00-9756-79c3bb00cf57 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:00.031778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 62/120] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:10:59 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:00.033481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99515-dbf3-4f44-bcfa-374b832b79b7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:00.034072 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99515-dbf3-4f44-bcfa-374b832b79b7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:00.034644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99515-dbf3-4f44-bcfa-374b832b79b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:00.062365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-48a99515-dbf3-4f44-bcfa-374b832b79b7 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:00.063981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-48a99515-dbf3-4f44-bcfa-374b832b79b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:00.076385 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:00.082760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a6b00-429e-4db0-a9e0-d885edf9a01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:00.084511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a6b00-429e-4db0-a9e0-d885edf9a01b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:00.084965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a6b00-429e-4db0-a9e0-d885edf9a01b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:00.085454 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a6b00-429e-4db0-a9e0-d885edf9a01b None admin] PATH_INFO: `/v3/users/635c975960e84510ab325ac63758c0a9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:00.086859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a6b00-429e-4db0-a9e0-d885edf9a01b None admin] RBAC: Authorizing `identity:get_user(user_id=635c975960e84510ab325ac63758c0a9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:00.088510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a6b00-429e-4db0-a9e0-d885edf9a01b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:00.091286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 59/121] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:10:59 2022] GET /identity/v3/users/635c975960e84510ab325ac63758c0a9 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:00.092718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49417dde-0b5a-4c05-8ff8-0752e11c90bb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:00.093219 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49417dde-0b5a-4c05-8ff8-0752e11c90bb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:00.093649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49417dde-0b5a-4c05-8ff8-0752e11c90bb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:00.095148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 60/122] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:00.096035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49417dde-0b5a-4c05-8ff8-0752e11c90bb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:00.155086 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 63/123] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:00.156366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99515-dbf3-4f44-bcfa-374b832b79b7 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:00.242857 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:00.272198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49417dde-0b5a-4c05-8ff8-0752e11c90bb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:00.310819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99515-dbf3-4f44-bcfa-374b832b79b7 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:00.318451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c0c48-a7a9-4184-859f-53bcc3ef1324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:00.319567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c0c48-a7a9-4184-859f-53bcc3ef1324 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:00.319931 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c0c48-a7a9-4184-859f-53bcc3ef1324 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:00.320296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c0c48-a7a9-4184-859f-53bcc3ef1324 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a/users/3564ee5cf4b74d50a0faeae97059d272/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:00.323320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c0c48-a7a9-4184-859f-53bcc3ef1324 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf7151ce6284a59851d3c6ec893ff7a, user_id=3564ee5cf4b74d50a0faeae97059d272, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:00.326021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c0c48-a7a9-4184-859f-53bcc3ef1324 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:00.352926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 61/124] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:11:00 2022] PUT /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a/users/3564ee5cf4b74d50a0faeae97059d272/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:00.352926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d1c94-4b22-41b1-b342-68e27a1da86f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:00.352926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d1c94-4b22-41b1-b342-68e27a1da86f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:00.352926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d1c94-4b22-41b1-b342-68e27a1da86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:00.379518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860916-214f-4489-896c-d5724d2f60ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:00.382724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860916-214f-4489-896c-d5724d2f60ad None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:00.383031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860916-214f-4489-896c-d5724d2f60ad None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:00.384471 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860916-214f-4489-896c-d5724d2f60ad None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:00.386040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860916-214f-4489-896c-d5724d2f60ad None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:00.387871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860916-214f-4489-896c-d5724d2f60ad None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:00.388281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2e2d1c94-4b22-41b1-b342-68e27a1da86f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:00.391432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 64/125] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:00 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:00.391432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860916-214f-4489-896c-d5724d2f60ad None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:00.392628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2e2d1c94-4b22-41b1-b342-68e27a1da86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:00.540819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860916-214f-4489-896c-d5724d2f60ad None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:00.566981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:00.581086 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:00.583619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 62/126] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:00.585274 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d1c94-4b22-41b1-b342-68e27a1da86f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:00.600989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a0d08-74c0-4572-9757-1e038604801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:00.600989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a0d08-74c0-4572-9757-1e038604801c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:00.600989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a0d08-74c0-4572-9757-1e038604801c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:00.600989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a0d08-74c0-4572-9757-1e038604801c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:00.614369 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a0d08-74c0-4572-9757-1e038604801c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-262a0d08-74c0-4572-9757-1e038604801c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:00.629412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:00.630393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:00.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 65/127] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:00.639736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a0d08-74c0-4572-9757-1e038604801c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:00.744287 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d1c94-4b22-41b1-b342-68e27a1da86f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:00.772612 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a0d08-74c0-4572-9757-1e038604801c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:00.801083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55da33-b6a9-44f5-bd71-9c99cb625855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:00.802287 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55da33-b6a9-44f5-bd71-9c99cb625855 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:00.803155 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55da33-b6a9-44f5-bd71-9c99cb625855 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:00.803489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55da33-b6a9-44f5-bd71-9c99cb625855 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a/users/635c975960e84510ab325ac63758c0a9/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:00.806765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55da33-b6a9-44f5-bd71-9c99cb625855 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf7151ce6284a59851d3c6ec893ff7a, user_id=635c975960e84510ab325ac63758c0a9, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:00.809312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55da33-b6a9-44f5-bd71-9c99cb625855 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:00.833796 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61590b-12ef-47b8-b00e-ee852b214855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:00.834035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 63/128] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:11:00 2022] PUT /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a/users/635c975960e84510ab325ac63758c0a9/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:00.834790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55da33-b6a9-44f5-bd71-9c99cb625855 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:00.836512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61590b-12ef-47b8-b00e-ee852b214855 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:00.836783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61590b-12ef-47b8-b00e-ee852b214855 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:00.837037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61590b-12ef-47b8-b00e-ee852b214855 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:00.837948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61590b-12ef-47b8-b00e-ee852b214855 None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:00.839053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61590b-12ef-47b8-b00e-ee852b214855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:00.840869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61590b-12ef-47b8-b00e-ee852b214855 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:00.853656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 66/129] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:00.867121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61590b-12ef-47b8-b00e-ee852b214855 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:00.916673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:01.019971 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:01.061799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55da33-b6a9-44f5-bd71-9c99cb625855 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:01.137020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61590b-12ef-47b8-b00e-ee852b214855 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:01.147764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc0a6f-e13a-4a90-90c0-9b37f7b41d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:01.149474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc0a6f-e13a-4a90-90c0-9b37f7b41d61 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:01.150068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc0a6f-e13a-4a90-90c0-9b37f7b41d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:01.150904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc0a6f-e13a-4a90-90c0-9b37f7b41d61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:01.169611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc0a6f-e13a-4a90-90c0-9b37f7b41d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:01.179325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20b38b-d2fe-4ab2-ae55-62db8d1dab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:01.180314 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20b38b-d2fe-4ab2-ae55-62db8d1dab1e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:01.180679 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20b38b-d2fe-4ab2-ae55-62db8d1dab1e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:01.181036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20b38b-d2fe-4ab2-ae55-62db8d1dab1e None admin] PATH_INFO: `/v3/users/3564ee5cf4b74d50a0faeae97059d272` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:01.182407 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20b38b-d2fe-4ab2-ae55-62db8d1dab1e None admin] RBAC: Authorizing `identity:get_user(user_id=3564ee5cf4b74d50a0faeae97059d272)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-07dc0a6f-e13a-4a90-90c0-9b37f7b41d61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:01.182601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:01.183450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:01.184221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:01.184221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:01.184221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:01.184221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:01.184221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:01.184221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:01.184221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:01.184221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:01.184221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:01.184221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:01.184221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:01.184221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:01.184823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20b38b-d2fe-4ab2-ae55-62db8d1dab1e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:01.186405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 67/130] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:00 2022] GET /identity/v3/users/3564ee5cf4b74d50a0faeae97059d272 => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:01.187163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 64/131] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:11:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:01.191997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20b38b-d2fe-4ab2-ae55-62db8d1dab1e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:01.198166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc0a6f-e13a-4a90-90c0-9b37f7b41d61 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:01.413799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20b38b-d2fe-4ab2-ae55-62db8d1dab1e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:01.419485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc0a6f-e13a-4a90-90c0-9b37f7b41d61 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:01.444162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:01.454588 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:01.495574 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca5cb1-3a56-407e-a72f-a7c6dee0f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:01.496891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca5cb1-3a56-407e-a72f-a7c6dee0f5ea None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:01.497555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca5cb1-3a56-407e-a72f-a7c6dee0f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:01.498104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca5cb1-3a56-407e-a72f-a7c6dee0f5ea None admin] PATH_INFO: `/v3/projects/3e116fb0bb0d4d42af1708686206ab88` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:01.500087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca5cb1-3a56-407e-a72f-a7c6dee0f5ea None admin] RBAC: Authorizing `identity:get_project(project_id=3e116fb0bb0d4d42af1708686206ab88)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:01.501996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca5cb1-3a56-407e-a72f-a7c6dee0f5ea None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:01.505164 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 68/132] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:01 2022] GET /identity/v3/projects/3e116fb0bb0d4d42af1708686206ab88 => generated 312 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:01.512123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca5cb1-3a56-407e-a72f-a7c6dee0f5ea None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:01.527674 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f210-6b59-41a7-9066-d081733be244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:01.528123 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f210-6b59-41a7-9066-d081733be244 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:01.528425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f210-6b59-41a7-9066-d081733be244 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:01.528712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f210-6b59-41a7-9066-d081733be244 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:01.532932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616f210-6b59-41a7-9066-d081733be244 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:01.532932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616f210-6b59-41a7-9066-d081733be244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:01.532932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616f210-6b59-41a7-9066-d081733be244 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:01.552443 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 65/133] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:01.561528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f210-6b59-41a7-9066-d081733be244 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:01.740282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca5cb1-3a56-407e-a72f-a7c6dee0f5ea None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:01.788803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f210-6b59-41a7-9066-d081733be244 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:01.815543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a3b7d-21b3-4b4e-bc07-d74077bad3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:01.816474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a3b7d-21b3-4b4e-bc07-d74077bad3aa None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:01.816771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a3b7d-21b3-4b4e-bc07-d74077bad3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:01.817087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a3b7d-21b3-4b4e-bc07-d74077bad3aa None admin] PATH_INFO: `/v3/projects/3e116fb0bb0d4d42af1708686206ab88/users/3564ee5cf4b74d50a0faeae97059d272/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:01.820857 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a3b7d-21b3-4b4e-bc07-d74077bad3aa None admin] RBAC: Authorizing `identity:create_grant(project_id=3e116fb0bb0d4d42af1708686206ab88, user_id=3564ee5cf4b74d50a0faeae97059d272, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:01.822394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a3b7d-21b3-4b4e-bc07-d74077bad3aa None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:01.851335 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 69/134] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:11:01 2022] PUT /identity/v3/projects/3e116fb0bb0d4d42af1708686206ab88/users/3564ee5cf4b74d50a0faeae97059d272/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:11:01.852859 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253193b-c833-4098-a97e-7345b219eac6 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:01.853189 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253193b-c833-4098-a97e-7345b219eac6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:01.855273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253193b-c833-4098-a97e-7345b219eac6 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:01.856953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 70/135] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:01.863661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacea36-3e67-4022-a434-f751efc9e43d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:01.864008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacea36-3e67-4022-a434-f751efc9e43d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:01.864345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacea36-3e67-4022-a434-f751efc9e43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:01.871034 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3807a3-0406-408b-a21a-770e10b519ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:01.871947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3807a3-0406-408b-a21a-770e10b519ea None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:01.872244 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3807a3-0406-408b-a21a-770e10b519ea None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:01.872534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3807a3-0406-408b-a21a-770e10b519ea None admin] PATH_INFO: `/v3/users/3564ee5cf4b74d50a0faeae97059d272` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:01.880243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3807a3-0406-408b-a21a-770e10b519ea None admin] RBAC: Authorizing `identity:get_user(user_id=3564ee5cf4b74d50a0faeae97059d272)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:01.883036 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3807a3-0406-408b-a21a-770e10b519ea None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:01.885682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 66/136] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:01 2022] GET /identity/v3/users/3564ee5cf4b74d50a0faeae97059d272 => generated 275 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:01.898040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3807a3-0406-408b-a21a-770e10b519ea None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:01.939779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-cfacea36-3e67-4022-a434-f751efc9e43d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:01.946430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cfacea36-3e67-4022-a434-f751efc9e43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:02.044355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:02.063943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:02.113055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 71/137] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:02.116197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7b464-6af2-4d0a-a022-78e95ce76aab None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:02.116656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7b464-6af2-4d0a-a022-78e95ce76aab None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:02.117091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7b464-6af2-4d0a-a022-78e95ce76aab None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:02.135451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 72/138] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:02 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:02.177011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1b2ca-80dc-4663-a5cf-3423ac46d912 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:02.177373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1b2ca-80dc-4663-a5cf-3423ac46d912 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:02.178197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1b2ca-80dc-4663-a5cf-3423ac46d912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:02.210353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f5a1b2ca-80dc-4663-a5cf-3423ac46d912 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:02.211706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f5a1b2ca-80dc-4663-a5cf-3423ac46d912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:02.227491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3807a3-0406-408b-a21a-770e10b519ea None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:02.297638 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd406a8-a952-4528-8ada-99aac277e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:02.299117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd406a8-a952-4528-8ada-99aac277e31a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:02.299790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd406a8-a952-4528-8ada-99aac277e31a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:02.300305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd406a8-a952-4528-8ada-99aac277e31a None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:02.303555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd406a8-a952-4528-8ada-99aac277e31a None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:02.305983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd406a8-a952-4528-8ada-99aac277e31a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:02.308133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 67/139] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:01 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:02.310100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd406a8-a952-4528-8ada-99aac277e31a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:02.347243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 73/140] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 15 15:11:02.348682 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1b2ca-80dc-4663-a5cf-3423ac46d912 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:02.484371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd406a8-a952-4528-8ada-99aac277e31a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:02.501218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:02.554262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1b2ca-80dc-4663-a5cf-3423ac46d912 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:02.565984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:02.567593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85249d57-8a44-4b88-b9cc-5d9e3a6d2ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:02.569000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249d57-8a44-4b88-b9cc-5d9e3a6d2ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:02.569472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249d57-8a44-4b88-b9cc-5d9e3a6d2ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:02.569679 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249d57-8a44-4b88-b9cc-5d9e3a6d2ec8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:02.577108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85249d57-8a44-4b88-b9cc-5d9e3a6d2ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:02.577108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85249d57-8a44-4b88-b9cc-5d9e3a6d2ec8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:02.578533 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 68/141] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:02.580245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85249d57-8a44-4b88-b9cc-5d9e3a6d2ec8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:02.643830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e132-5895-490d-8fe7-c3eaeeb1fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:02.645966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e132-5895-490d-8fe7-c3eaeeb1fcae None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:02.649559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e132-5895-490d-8fe7-c3eaeeb1fcae None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:02.650139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e132-5895-490d-8fe7-c3eaeeb1fcae None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a/users/3564ee5cf4b74d50a0faeae97059d272/roles/f5fb67c95c834bc9b359a5141ae0f60c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:02.655850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e132-5895-490d-8fe7-c3eaeeb1fcae None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf7151ce6284a59851d3c6ec893ff7a, user_id=3564ee5cf4b74d50a0faeae97059d272, role_id=f5fb67c95c834bc9b359a5141ae0f60c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:02.658838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e132-5895-490d-8fe7-c3eaeeb1fcae None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:02.694065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 74/142] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:11:02 2022] PUT /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a/users/3564ee5cf4b74d50a0faeae97059d272/roles/f5fb67c95c834bc9b359a5141ae0f60c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:02.694893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e132-5895-490d-8fe7-c3eaeeb1fcae None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:02.782484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85249d57-8a44-4b88-b9cc-5d9e3a6d2ec8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:02.838519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7124b-d9e5-4b40-a963-d31d01a508e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:02.839878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7124b-d9e5-4b40-a963-d31d01a508e6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:02.840461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7124b-d9e5-4b40-a963-d31d01a508e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:02.840978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7124b-d9e5-4b40-a963-d31d01a508e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:02.862199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7124b-d9e5-4b40-a963-d31d01a508e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-29a7124b-d9e5-4b40-a963-d31d01a508e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:02.880903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:02.881887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:02.882659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:02.882659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:02.882659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:02.882659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:02.882659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:02.882659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:02.882659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:02.882659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:02.882659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:02.882659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:02.882659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:02.882659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:02.885893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 69/143] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:02.892767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7124b-d9e5-4b40-a963-d31d01a508e6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:02.937359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:03.019559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7124b-d9e5-4b40-a963-d31d01a508e6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:03.063218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e132-5895-490d-8fe7-c3eaeeb1fcae None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:03.066798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a925f0e-93b3-41a4-b0cd-c66954ecdb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:03.067755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a925f0e-93b3-41a4-b0cd-c66954ecdb15 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:03.068819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a925f0e-93b3-41a4-b0cd-c66954ecdb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:03.069335 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a925f0e-93b3-41a4-b0cd-c66954ecdb15 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:03.070336 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a925f0e-93b3-41a4-b0cd-c66954ecdb15 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:03.072685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a925f0e-93b3-41a4-b0cd-c66954ecdb15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:03.080039 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a925f0e-93b3-41a4-b0cd-c66954ecdb15 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:03.095675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 70/144] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:03.101585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a925f0e-93b3-41a4-b0cd-c66954ecdb15 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:03.152747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e91ac-8dc9-4d62-bfc8-9b628e28c7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:03.153868 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e91ac-8dc9-4d62-bfc8-9b628e28c7ba None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:03.154389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e91ac-8dc9-4d62-bfc8-9b628e28c7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:03.156289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e91ac-8dc9-4d62-bfc8-9b628e28c7ba None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:03.157477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e91ac-8dc9-4d62-bfc8-9b628e28c7ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:03.159193 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e91ac-8dc9-4d62-bfc8-9b628e28c7ba None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:03.189578 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 75/145] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:11:02 2022] POST /identity/v3/users => generated 283 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:11:03.305093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:03.312273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a925f0e-93b3-41a4-b0cd-c66954ecdb15 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:03.382684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173189de-db74-4ea6-9931-2b54161394e7 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:03.383552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173189de-db74-4ea6-9931-2b54161394e7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:03.384267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173189de-db74-4ea6-9931-2b54161394e7 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:03.386906 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 76/146] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:03.393224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca10635-2263-4b5c-9949-4ce43288fb5a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:03.394108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca10635-2263-4b5c-9949-4ce43288fb5a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:03.394809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca10635-2263-4b5c-9949-4ce43288fb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:03.413975 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72955ef-4e34-418e-95be-5df38c23d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:03.414918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72955ef-4e34-418e-95be-5df38c23d3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:03.415210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72955ef-4e34-418e-95be-5df38c23d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:03.415494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72955ef-4e34-418e-95be-5df38c23d3f5 None admin] PATH_INFO: `/v3/users/827eafcf3aa34ae89beeb798f466e590` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:03.422543 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72955ef-4e34-418e-95be-5df38c23d3f5 None admin] RBAC: Authorizing `identity:get_user(user_id=827eafcf3aa34ae89beeb798f466e590)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:03.424088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72955ef-4e34-418e-95be-5df38c23d3f5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:03.425935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 71/147] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:03 2022] GET /identity/v3/users/827eafcf3aa34ae89beeb798f466e590 => generated 289 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:03.432518 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72955ef-4e34-418e-95be-5df38c23d3f5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:03.434749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-eca10635-2263-4b5c-9949-4ce43288fb5a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:03.436659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-eca10635-2263-4b5c-9949-4ce43288fb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:03.472607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:03.574088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 77/148] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:03.619268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca10635-2263-4b5c-9949-4ce43288fb5a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:03.688253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72955ef-4e34-418e-95be-5df38c23d3f5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:03.781765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab601858-3828-4f30-b6a7-676f80c23b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:03.782669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab601858-3828-4f30-b6a7-676f80c23b7f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:03.782961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab601858-3828-4f30-b6a7-676f80c23b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:03.783245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab601858-3828-4f30-b6a7-676f80c23b7f None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:03.786592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab601858-3828-4f30-b6a7-676f80c23b7f None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:03.788814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab601858-3828-4f30-b6a7-676f80c23b7f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:03.790928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 72/149] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:03 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:03.798517 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab601858-3828-4f30-b6a7-676f80c23b7f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:03.827600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca10635-2263-4b5c-9949-4ce43288fb5a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:03.877788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe941102-263b-4b21-a837-ee2bc6359be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:03.877788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe941102-263b-4b21-a837-ee2bc6359be8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:03.877788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe941102-263b-4b21-a837-ee2bc6359be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:03.878093 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe941102-263b-4b21-a837-ee2bc6359be8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:03.888515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:03.892356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe941102-263b-4b21-a837-ee2bc6359be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-fe941102-263b-4b21-a837-ee2bc6359be8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:03.905724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:03.906654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:03.907415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 78/150] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:03.908617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8204fc-c309-44d0-94d2-97893206b813 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:03.909162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8204fc-c309-44d0-94d2-97893206b813 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:03.909983 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8204fc-c309-44d0-94d2-97893206b813 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:03.911476 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 79/151] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:03.916935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8204fc-c309-44d0-94d2-97893206b813 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:03.940720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:03.999380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab601858-3828-4f30-b6a7-676f80c23b7f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:04.059906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27892357-c409-4a8f-8f69-e7fa8db354d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:04.061388 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27892357-c409-4a8f-8f69-e7fa8db354d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:04.062228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27892357-c409-4a8f-8f69-e7fa8db354d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:04.062949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27892357-c409-4a8f-8f69-e7fa8db354d9 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a/users/827eafcf3aa34ae89beeb798f466e590/roles/0af3acb37467488c9ef322c203b98fd9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:04.067033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27892357-c409-4a8f-8f69-e7fa8db354d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf7151ce6284a59851d3c6ec893ff7a, user_id=827eafcf3aa34ae89beeb798f466e590, role_id=0af3acb37467488c9ef322c203b98fd9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:04.070764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27892357-c409-4a8f-8f69-e7fa8db354d9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:04.081006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8204fc-c309-44d0-94d2-97893206b813 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:04.090777 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 73/152] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:11:03 2022] PUT /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a/users/827eafcf3aa34ae89beeb798f466e590/roles/0af3acb37467488c9ef322c203b98fd9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:04.092050 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88e08a-d219-49d5-a5c0-8b21e4a66b6e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:04.092354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88e08a-d219-49d5-a5c0-8b21e4a66b6e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:04.092643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88e08a-d219-49d5-a5c0-8b21e4a66b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:04.119359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9f88e08a-d219-49d5-a5c0-8b21e4a66b6e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:04.120716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9f88e08a-d219-49d5-a5c0-8b21e4a66b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:04.159799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3101b-1d9a-44ad-9328-243e68391e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:04.161034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3101b-1d9a-44ad-9328-243e68391e95 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:04.161580 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3101b-1d9a-44ad-9328-243e68391e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:04.162103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3101b-1d9a-44ad-9328-243e68391e95 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:04.163086 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3101b-1d9a-44ad-9328-243e68391e95 None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:04.163602 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3101b-1d9a-44ad-9328-243e68391e95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:04.165315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3101b-1d9a-44ad-9328-243e68391e95 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:04.185023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 80/153] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:04.191227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3101b-1d9a-44ad-9328-243e68391e95 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:04.216548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 74/154] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:04.249810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88e08a-d219-49d5-a5c0-8b21e4a66b6e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:04.284919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:04.346371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:04.397953 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88e08a-d219-49d5-a5c0-8b21e4a66b6e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:04.459889 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3101b-1d9a-44ad-9328-243e68391e95 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:04.464182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa525f7-818a-4394-a30a-b6ea038e5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:04.467451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa525f7-818a-4394-a30a-b6ea038e5971 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:04.468260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa525f7-818a-4394-a30a-b6ea038e5971 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:04.468991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa525f7-818a-4394-a30a-b6ea038e5971 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:04.492012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa525f7-818a-4394-a30a-b6ea038e5971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ffa525f7-818a-4394-a30a-b6ea038e5971 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:04.501670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:04.502604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:04.503575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:04.503575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:04.503575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:04.503575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:04.503575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:04.503575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:04.503575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:04.503575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:04.503575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:04.503575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:04.503575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:04.503575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:04.507138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 75/155] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:04.514993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa525f7-818a-4394-a30a-b6ea038e5971 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:04.570189 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45369c-f700-4296-b4dd-e4934cb81890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:04.571667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45369c-f700-4296-b4dd-e4934cb81890 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:04.572083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45369c-f700-4296-b4dd-e4934cb81890 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:04.572487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45369c-f700-4296-b4dd-e4934cb81890 None admin] PATH_INFO: `/v3/users/3564ee5cf4b74d50a0faeae97059d272` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:04.574523 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45369c-f700-4296-b4dd-e4934cb81890 None admin] RBAC: Authorizing `identity:get_user(user_id=3564ee5cf4b74d50a0faeae97059d272)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:04.576015 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45369c-f700-4296-b4dd-e4934cb81890 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:04.578625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 81/156] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:04 2022] GET /identity/v3/users/3564ee5cf4b74d50a0faeae97059d272 => generated 275 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:04.585139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45369c-f700-4296-b4dd-e4934cb81890 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:04.654696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:04.673413 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa525f7-818a-4394-a30a-b6ea038e5971 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:04.727607 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4a392-feac-4216-a8ad-3c204dd664a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:04.728259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4a392-feac-4216-a8ad-3c204dd664a6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:04.728505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4a392-feac-4216-a8ad-3c204dd664a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:04.733632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4a392-feac-4216-a8ad-3c204dd664a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:04.734555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4a392-feac-4216-a8ad-3c204dd664a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:04.734884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4a392-feac-4216-a8ad-3c204dd664a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:04.736669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4a392-feac-4216-a8ad-3c204dd664a6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:04.746612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 76/157] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:04.752584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4a392-feac-4216-a8ad-3c204dd664a6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:04.813107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45369c-f700-4296-b4dd-e4934cb81890 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:04.926574 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf575c-fa70-4a09-a804-fb5852f8415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:04.927279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf575c-fa70-4a09-a804-fb5852f8415d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:04.927593 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf575c-fa70-4a09-a804-fb5852f8415d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:04.927871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf575c-fa70-4a09-a804-fb5852f8415d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:04.953825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:04.966225 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4a392-feac-4216-a8ad-3c204dd664a6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:05.017389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835df8ee-a83c-4b71-842c-dc8908dbc1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:05.021573 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835df8ee-a83c-4b71-842c-dc8908dbc1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:05.021573 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835df8ee-a83c-4b71-842c-dc8908dbc1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:05.021573 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835df8ee-a83c-4b71-842c-dc8908dbc1b6 None admin] PATH_INFO: `/v3/users/635c975960e84510ab325ac63758c0a9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:05.021829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835df8ee-a83c-4b71-842c-dc8908dbc1b6 None admin] RBAC: Authorizing `identity:get_user(user_id=635c975960e84510ab325ac63758c0a9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:05.023266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835df8ee-a83c-4b71-842c-dc8908dbc1b6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:05.025181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 77/158] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:04 2022] GET /identity/v3/users/635c975960e84510ab325ac63758c0a9 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:05.026563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59119b6a-9816-4f44-ba52-2efc72d64d78 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:05.026856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59119b6a-9816-4f44-ba52-2efc72d64d78 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:05.027133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59119b6a-9816-4f44-ba52-2efc72d64d78 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:05.028545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 78/159] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:05.034542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce42a18-b3df-4969-84e1-18c3e7523626 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:05.034882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce42a18-b3df-4969-84e1-18c3e7523626 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:05.035170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce42a18-b3df-4969-84e1-18c3e7523626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:05.056578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3ce42a18-b3df-4969-84e1-18c3e7523626 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:05.058069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3ce42a18-b3df-4969-84e1-18c3e7523626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:05.071421 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:05.086039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf575c-fa70-4a09-a804-fb5852f8415d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:05.093646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf575c-fa70-4a09-a804-fb5852f8415d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:05.138952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 79/160] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:05.139851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce42a18-b3df-4969-84e1-18c3e7523626 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:05.279135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce42a18-b3df-4969-84e1-18c3e7523626 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:05.330809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcdc5c-8e3d-4cc4-aad3-aa66e44a33b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:05.331485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcdc5c-8e3d-4cc4-aad3-aa66e44a33b4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:05.331762 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcdc5c-8e3d-4cc4-aad3-aa66e44a33b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:05.332042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcdc5c-8e3d-4cc4-aad3-aa66e44a33b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:05.379628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:05.444639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 82/161] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 861 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:05.446729 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf575c-fa70-4a09-a804-fb5852f8415d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:05.528991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcdc5c-8e3d-4cc4-aad3-aa66e44a33b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:05.532692 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcdc5c-8e3d-4cc4-aad3-aa66e44a33b4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:05.554001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:05.684437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf575c-fa70-4a09-a804-fb5852f8415d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:05.740179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 80/162] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:05.741181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcdc5c-8e3d-4cc4-aad3-aa66e44a33b4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:05.757676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dba208-081f-42aa-bbba-554969f81467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:05.758535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dba208-081f-42aa-bbba-554969f81467 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:05.758822 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dba208-081f-42aa-bbba-554969f81467 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:05.759101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dba208-081f-42aa-bbba-554969f81467 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:05.781668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dba208-081f-42aa-bbba-554969f81467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-96dba208-081f-42aa-bbba-554969f81467 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:05.804068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:05.804977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:05.805771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 83/163] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:05.811813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dba208-081f-42aa-bbba-554969f81467 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:05.868072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:05.974115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcdc5c-8e3d-4cc4-aad3-aa66e44a33b4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:05.991635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dba208-081f-42aa-bbba-554969f81467 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:05.993295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:06.018735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e40a6-e42c-46cc-ab45-890c8ababf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:06.019632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e40a6-e42c-46cc-ab45-890c8ababf15 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:06.019923 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e40a6-e42c-46cc-ab45-890c8ababf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:06.020198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e40a6-e42c-46cc-ab45-890c8ababf15 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:06.022051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e40a6-e42c-46cc-ab45-890c8ababf15 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:06.023564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e40a6-e42c-46cc-ab45-890c8ababf15 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:06.029813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 81/164] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:05 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:06.030751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e40a6-e42c-46cc-ab45-890c8ababf15 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:06.049985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca94c4-e441-4910-97f3-7321e849578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:06.050874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca94c4-e441-4910-97f3-7321e849578d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:06.051165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca94c4-e441-4910-97f3-7321e849578d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:06.051444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca94c4-e441-4910-97f3-7321e849578d None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:06.058002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca94c4-e441-4910-97f3-7321e849578d None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:06.059456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca94c4-e441-4910-97f3-7321e849578d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:06.062679 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 84/165] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:05 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:06.063544 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca94c4-e441-4910-97f3-7321e849578d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:06.209601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e40a6-e42c-46cc-ab45-890c8ababf15 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:06.235576 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:06.247064 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca94c4-e441-4910-97f3-7321e849578d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:06.282841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02b3d5-7c5a-46d1-9f8f-7edca82d2d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:06.283582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02b3d5-7c5a-46d1-9f8f-7edca82d2d87 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:06.283873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02b3d5-7c5a-46d1-9f8f-7edca82d2d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:06.284152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02b3d5-7c5a-46d1-9f8f-7edca82d2d87 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:06.284939 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02b3d5-7c5a-46d1-9f8f-7edca82d2d87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:06.285299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02b3d5-7c5a-46d1-9f8f-7edca82d2d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:06.286905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02b3d5-7c5a-46d1-9f8f-7edca82d2d87 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:06.302742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 82/166] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:06.310290 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02b3d5-7c5a-46d1-9f8f-7edca82d2d87 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:06.319184 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f585ce-1dd0-4cb6-b598-44e80eec7de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:06.319891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f585ce-1dd0-4cb6-b598-44e80eec7de3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:06.320380 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f585ce-1dd0-4cb6-b598-44e80eec7de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:06.320690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f585ce-1dd0-4cb6-b598-44e80eec7de3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:06.321830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f585ce-1dd0-4cb6-b598-44e80eec7de3 None admin] RBAC: Adding query filter params (role.id=b670784e829b4bffb77b03422132634a, scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a, user.id=3564ee5cf4b74d50a0faeae97059d272) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:06.322282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f585ce-1dd0-4cb6-b598-44e80eec7de3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:06.324005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f585ce-1dd0-4cb6-b598-44e80eec7de3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:06.339045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 85/167] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:06 2022] GET /identity/v3/role_assignments?user.id=3564ee5cf4b74d50a0faeae97059d272&scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a&role.id=b670784e829b4bffb77b03422132634a => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:06.339902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f585ce-1dd0-4cb6-b598-44e80eec7de3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:06.405366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:06.512240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f585ce-1dd0-4cb6-b598-44e80eec7de3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:06.576714 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d52fd-0d9b-4f39-b3d2-f58d67eb97f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:06.577673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d52fd-0d9b-4f39-b3d2-f58d67eb97f6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:06.577965 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d52fd-0d9b-4f39-b3d2-f58d67eb97f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:06.578249 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d52fd-0d9b-4f39-b3d2-f58d67eb97f6 None admin] PATH_INFO: `/v3/users/3564ee5cf4b74d50a0faeae97059d272` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:06.586182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d52fd-0d9b-4f39-b3d2-f58d67eb97f6 None admin] RBAC: Authorizing `identity:get_user(user_id=3564ee5cf4b74d50a0faeae97059d272)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:06.587808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d52fd-0d9b-4f39-b3d2-f58d67eb97f6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:06.589776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 86/168] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:06 2022] GET /identity/v3/users/3564ee5cf4b74d50a0faeae97059d272 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:06.591108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7568f42-c9af-40a6-8a1e-9f6c38434012 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:06.591402 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7568f42-c9af-40a6-8a1e-9f6c38434012 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:06.591683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7568f42-c9af-40a6-8a1e-9f6c38434012 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:06.592773 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02b3d5-7c5a-46d1-9f8f-7edca82d2d87 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:06.593013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 87/169] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:06.601842 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7568f42-c9af-40a6-8a1e-9f6c38434012 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:06.661719 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2cc02-9bb7-4a38-8960-9431868271e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:06.662785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2cc02-9bb7-4a38-8960-9431868271e4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:06.663270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2cc02-9bb7-4a38-8960-9431868271e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:06.663745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2cc02-9bb7-4a38-8960-9431868271e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:06.664815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2cc02-9bb7-4a38-8960-9431868271e4 None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a, user.id=635c975960e84510ab325ac63758c0a9) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:06.665363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2cc02-9bb7-4a38-8960-9431868271e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:06.667124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2cc02-9bb7-4a38-8960-9431868271e4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:06.674172 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 83/170] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:06 2022] GET /identity/v3/role_assignments?user.id=635c975960e84510ab325ac63758c0a9&scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a&role.id=87593f63c4744eac870c07b006022e77 => generated 608 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:06.675793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f884a3e-2ce6-436b-aeac-ffb8f70d6e3e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:06.676281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f884a3e-2ce6-436b-aeac-ffb8f70d6e3e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:06.676758 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f884a3e-2ce6-436b-aeac-ffb8f70d6e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:06.722288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0f884a3e-2ce6-436b-aeac-ffb8f70d6e3e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:06.723872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0f884a3e-2ce6-436b-aeac-ffb8f70d6e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:06.791435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:06.817443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7568f42-c9af-40a6-8a1e-9f6c38434012 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:06.821419 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:06.900716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 84/171] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:06.910729 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334364a-cded-46f7-8cbc-85fd50623aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:06.911422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334364a-cded-46f7-8cbc-85fd50623aee None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:06.911752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334364a-cded-46f7-8cbc-85fd50623aee None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:06.912042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334364a-cded-46f7-8cbc-85fd50623aee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:06.957319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f884a3e-2ce6-436b-aeac-ffb8f70d6e3e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:07.060894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334364a-cded-46f7-8cbc-85fd50623aee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:07.063176 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334364a-cded-46f7-8cbc-85fd50623aee None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:07.176179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f884a3e-2ce6-436b-aeac-ffb8f70d6e3e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:07.235417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6bb2-6547-4a57-a53e-eda354128031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:07.236808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6bb2-6547-4a57-a53e-eda354128031 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:07.237346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6bb2-6547-4a57-a53e-eda354128031 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:07.237841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6bb2-6547-4a57-a53e-eda354128031 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:07.258153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f6bb2-6547-4a57-a53e-eda354128031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-721f6bb2-6547-4a57-a53e-eda354128031 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:07.268616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:07.270161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:07.271498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:07.271498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:07.271498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:07.271498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:07.271498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:07.271498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:07.271498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:07.271498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:07.271498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:07.271498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:07.271498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:07.271498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:07.275985 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 85/172] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:11:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:07.283789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6bb2-6547-4a57-a53e-eda354128031 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:07.330965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:07.390330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 88/173] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:07.402147 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334364a-cded-46f7-8cbc-85fd50623aee None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:07.404310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:07.428906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6bb2-6547-4a57-a53e-eda354128031 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:07.465979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc634d3-5e37-4141-8608-89ed8a0846cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:07.467017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc634d3-5e37-4141-8608-89ed8a0846cb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:07.467503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc634d3-5e37-4141-8608-89ed8a0846cb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:07.468019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc634d3-5e37-4141-8608-89ed8a0846cb None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:07.468983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc634d3-5e37-4141-8608-89ed8a0846cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:07.469511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc634d3-5e37-4141-8608-89ed8a0846cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:07.471134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc634d3-5e37-4141-8608-89ed8a0846cb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:07.480550 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 86/174] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:07.492426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc634d3-5e37-4141-8608-89ed8a0846cb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:07.635697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:07.648334 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc634d3-5e37-4141-8608-89ed8a0846cb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:07.696830 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137981e-13ff-427c-9324-db47c598ba57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:07.698688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137981e-13ff-427c-9324-db47c598ba57 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:07.699336 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137981e-13ff-427c-9324-db47c598ba57 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:07.701397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334364a-cded-46f7-8cbc-85fd50623aee None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:07.701903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137981e-13ff-427c-9324-db47c598ba57 None admin] PATH_INFO: `/v3/users/3564ee5cf4b74d50a0faeae97059d272` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:07.704599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137981e-13ff-427c-9324-db47c598ba57 None admin] RBAC: Authorizing `identity:get_user(user_id=3564ee5cf4b74d50a0faeae97059d272)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:07.706377 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137981e-13ff-427c-9324-db47c598ba57 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:07.709501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 87/175] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:07 2022] GET /identity/v3/users/3564ee5cf4b74d50a0faeae97059d272 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:07.715618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137981e-13ff-427c-9324-db47c598ba57 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:07.778367 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f66919-a48e-4b9a-a49a-b40fbd1ea136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:07.779609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f66919-a48e-4b9a-a49a-b40fbd1ea136 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:07.781936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f66919-a48e-4b9a-a49a-b40fbd1ea136 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:07.782434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f66919-a48e-4b9a-a49a-b40fbd1ea136 None admin] PATH_INFO: `/v3/projects/3e116fb0bb0d4d42af1708686206ab88` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:07.784731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f66919-a48e-4b9a-a49a-b40fbd1ea136 None admin] RBAC: Authorizing `identity:get_project(project_id=3e116fb0bb0d4d42af1708686206ab88)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:07.788681 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f66919-a48e-4b9a-a49a-b40fbd1ea136 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:07.796111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 89/176] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:07 2022] GET /identity/v3/projects/3e116fb0bb0d4d42af1708686206ab88 => generated 312 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:07.804925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f66919-a48e-4b9a-a49a-b40fbd1ea136 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:07.918650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137981e-13ff-427c-9324-db47c598ba57 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:07.941439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:07.985140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f66919-a48e-4b9a-a49a-b40fbd1ea136 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:07.991493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5941c-6959-4aef-9992-4b28e71b374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:07.992275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5941c-6959-4aef-9992-4b28e71b374c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:07.992636 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5941c-6959-4aef-9992-4b28e71b374c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:07.992994 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5941c-6959-4aef-9992-4b28e71b374c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:08.049942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:08.062432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd9181-8d99-4dcd-a7b7-8a9a21fcf35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:08.063478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9181-8d99-4dcd-a7b7-8a9a21fcf35f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:08.064017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9181-8d99-4dcd-a7b7-8a9a21fcf35f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:08.064435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9181-8d99-4dcd-a7b7-8a9a21fcf35f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:08.066072 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd9181-8d99-4dcd-a7b7-8a9a21fcf35f None admin] RBAC: Adding query filter params (role.id=b670784e829b4bffb77b03422132634a, scope.project.id=3e116fb0bb0d4d42af1708686206ab88, user.id=3564ee5cf4b74d50a0faeae97059d272) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:08.066643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd9181-8d99-4dcd-a7b7-8a9a21fcf35f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:08.070473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd9181-8d99-4dcd-a7b7-8a9a21fcf35f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:08.097277 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 90/177] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:07 2022] GET /identity/v3/role_assignments?user.id=3564ee5cf4b74d50a0faeae97059d272&scope.project.id=3e116fb0bb0d4d42af1708686206ab88&role.id=b670784e829b4bffb77b03422132634a => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:08.100481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98a32-2447-4a12-85e8-a373e4bad65e None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:08.100982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98a32-2447-4a12-85e8-a373e4bad65e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:08.101799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98a32-2447-4a12-85e8-a373e4bad65e None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:08.111140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 91/178] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:08.113750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907916e-ec51-4b49-a034-31f73a70d82f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:08.114246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907916e-ec51-4b49-a034-31f73a70d82f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:08.115300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907916e-ec51-4b49-a034-31f73a70d82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:08.116252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5941c-6959-4aef-9992-4b28e71b374c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:08.121100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5941c-6959-4aef-9992-4b28e71b374c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:08.172187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b907916e-ec51-4b49-a034-31f73a70d82f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:08.174352 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b907916e-ec51-4b49-a034-31f73a70d82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:08.344076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 92/179] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:08.358676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 88/180] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:08.366184 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907916e-ec51-4b49-a034-31f73a70d82f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:08.397838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5941c-6959-4aef-9992-4b28e71b374c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:08.470119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:08.515764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907916e-ec51-4b49-a034-31f73a70d82f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:08.551362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:08.582097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1c6ec-d2c1-47a3-919b-df62798f6c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:08.583952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1c6ec-d2c1-47a3-919b-df62798f6c06 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:08.584458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1c6ec-d2c1-47a3-919b-df62798f6c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:08.584867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1c6ec-d2c1-47a3-919b-df62798f6c06 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:08.587073 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1c6ec-d2c1-47a3-919b-df62798f6c06 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:08.589866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1c6ec-d2c1-47a3-919b-df62798f6c06 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:08.592788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 93/181] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:08 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:08.595632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd1455-fce8-4383-af57-b3768140e294 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:08.595632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd1455-fce8-4383-af57-b3768140e294 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:08.595975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd1455-fce8-4383-af57-b3768140e294 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:08.600326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 94/182] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:08.605518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603fea8-12fd-4fca-85f3-1de9b2705e71 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:08.605849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603fea8-12fd-4fca-85f3-1de9b2705e71 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:08.606188 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603fea8-12fd-4fca-85f3-1de9b2705e71 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:08.607776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 95/183] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:08.608378 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603fea8-12fd-4fca-85f3-1de9b2705e71 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:08.631266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5941c-6959-4aef-9992-4b28e71b374c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:08.678808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38e22e-f24b-49e1-ba2a-f42ae09f35ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:08.679627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38e22e-f24b-49e1-ba2a-f42ae09f35ba None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:08.679981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38e22e-f24b-49e1-ba2a-f42ae09f35ba None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:08.680246 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38e22e-f24b-49e1-ba2a-f42ae09f35ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:08.691159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38e22e-f24b-49e1-ba2a-f42ae09f35ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4d38e22e-f24b-49e1-ba2a-f42ae09f35ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:08.699073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:08.700033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:08.701047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 89/184] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:08.707074 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6c7bc-db25-4977-8561-567afdcbfad8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:08.707480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6c7bc-db25-4977-8561-567afdcbfad8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:08.708894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6c7bc-db25-4977-8561-567afdcbfad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:08.727083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-baf6c7bc-db25-4977-8561-567afdcbfad8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:08.729298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-baf6c7bc-db25-4977-8561-567afdcbfad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:08.739978 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603fea8-12fd-4fca-85f3-1de9b2705e71 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:08.773205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:08.784381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf42d52-aaca-42a5-89a0-2d6c227b4d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:08.785541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf42d52-aaca-42a5-89a0-2d6c227b4d90 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:08.785943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf42d52-aaca-42a5-89a0-2d6c227b4d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:08.786304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf42d52-aaca-42a5-89a0-2d6c227b4d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:08.787832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf42d52-aaca-42a5-89a0-2d6c227b4d90 None admin] RBAC: Adding query filter params (role.id=f5fb67c95c834bc9b359a5141ae0f60c, scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a, user.id=3564ee5cf4b74d50a0faeae97059d272) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:08.788240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf42d52-aaca-42a5-89a0-2d6c227b4d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:08.789920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf42d52-aaca-42a5-89a0-2d6c227b4d90 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:08.796445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 96/185] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:08 2022] GET /identity/v3/role_assignments?user.id=3564ee5cf4b74d50a0faeae97059d272&scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a&role.id=f5fb67c95c834bc9b359a5141ae0f60c => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:08.797749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd871dbb-c971-445b-b075-8d268d59e3da None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:08.798041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd871dbb-c971-445b-b075-8d268d59e3da None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:08.798319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd871dbb-c971-445b-b075-8d268d59e3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:08.824365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-dd871dbb-c971-445b-b075-8d268d59e3da None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:08.837147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 90/186] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:08.837414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-dd871dbb-c971-445b-b075-8d268d59e3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:08.837541 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6c7bc-db25-4977-8561-567afdcbfad8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:08.919334 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:08.945859 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 97/187] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:08.947866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f011cc-21f8-4ac4-80a6-9f75249fc5e5 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:08.948301 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f011cc-21f8-4ac4-80a6-9f75249fc5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:08.948751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f011cc-21f8-4ac4-80a6-9f75249fc5e5 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:08.950443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 98/188] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:08.951367 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f011cc-21f8-4ac4-80a6-9f75249fc5e5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:09.006632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6c7bc-db25-4977-8561-567afdcbfad8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:09.067603 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280d80-7302-4c17-87cb-30d6cd28159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:09.069002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280d80-7302-4c17-87cb-30d6cd28159c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:09.069576 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280d80-7302-4c17-87cb-30d6cd28159c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:09.070049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280d80-7302-4c17-87cb-30d6cd28159c None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:09.071367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e280d80-7302-4c17-87cb-30d6cd28159c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:09.071905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e280d80-7302-4c17-87cb-30d6cd28159c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:09.074468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e280d80-7302-4c17-87cb-30d6cd28159c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:09.085098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 91/189] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:09.086073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806920-fb5a-4bfc-ba65-f0e83739a77f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:09.086363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806920-fb5a-4bfc-ba65-f0e83739a77f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:09.086637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806920-fb5a-4bfc-ba65-f0e83739a77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:09.099923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f011cc-21f8-4ac4-80a6-9f75249fc5e5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:09.102633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4c806920-fb5a-4bfc-ba65-f0e83739a77f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:09.103817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4c806920-fb5a-4bfc-ba65-f0e83739a77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:09.131541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:09.142653 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10703cd3-2097-4b8b-bbda-8db8ee8e4fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:09.143460 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10703cd3-2097-4b8b-bbda-8db8ee8e4fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:09.143745 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10703cd3-2097-4b8b-bbda-8db8ee8e4fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:09.144016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10703cd3-2097-4b8b-bbda-8db8ee8e4fb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:09.155195 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10703cd3-2097-4b8b-bbda-8db8ee8e4fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-10703cd3-2097-4b8b-bbda-8db8ee8e4fb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:09.163091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:09.164007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 99/190] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:11:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:09.169710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10703cd3-2097-4b8b-bbda-8db8ee8e4fb2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:09.180506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 92/191] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:09.193298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c806920-fb5a-4bfc-ba65-f0e83739a77f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:09.240095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:09.307016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10703cd3-2097-4b8b-bbda-8db8ee8e4fb2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:09.315511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c806920-fb5a-4bfc-ba65-f0e83739a77f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:09.347372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e145a33-1736-45db-a80e-c9d0eff2c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:09.348430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145a33-1736-45db-a80e-c9d0eff2c353 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:09.348952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145a33-1736-45db-a80e-c9d0eff2c353 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:09.349375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145a33-1736-45db-a80e-c9d0eff2c353 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:09.354223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163539e1-b89f-4ab5-b072-fe09a988009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:09.355105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163539e1-b89f-4ab5-b072-fe09a988009e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:09.355392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163539e1-b89f-4ab5-b072-fe09a988009e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:09.355670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163539e1-b89f-4ab5-b072-fe09a988009e None admin] PATH_INFO: `/v3/users/827eafcf3aa34ae89beeb798f466e590` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:09.357122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163539e1-b89f-4ab5-b072-fe09a988009e None admin] RBAC: Authorizing `identity:get_user(user_id=827eafcf3aa34ae89beeb798f466e590)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:09.358617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163539e1-b89f-4ab5-b072-fe09a988009e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:09.360284 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 93/192] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:09 2022] GET /identity/v3/users/827eafcf3aa34ae89beeb798f466e590 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:09.365583 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163539e1-b89f-4ab5-b072-fe09a988009e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:09.366343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e145a33-1736-45db-a80e-c9d0eff2c353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2e145a33-1736-45db-a80e-c9d0eff2c353 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:09.374565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:09.376161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 100/193] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:11:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:09.377001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e145a33-1736-45db-a80e-c9d0eff2c353 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:09.446409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:09.490806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163539e1-b89f-4ab5-b072-fe09a988009e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:09.500482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:09.516847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e145a33-1736-45db-a80e-c9d0eff2c353 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:09.529434 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473a4c0-521f-4690-8314-3e6a3f3bc237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:09.530108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473a4c0-521f-4690-8314-3e6a3f3bc237 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:09.530396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473a4c0-521f-4690-8314-3e6a3f3bc237 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:09.530675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473a4c0-521f-4690-8314-3e6a3f3bc237 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:09.531437 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473a4c0-521f-4690-8314-3e6a3f3bc237 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:09.531749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473a4c0-521f-4690-8314-3e6a3f3bc237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:09.533165 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473a4c0-521f-4690-8314-3e6a3f3bc237 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:09.549239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 94/194] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:09.549239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473a4c0-521f-4690-8314-3e6a3f3bc237 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:09.558181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fd587-6c2e-4c90-b4c2-8aa8af2a00d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:09.559180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fd587-6c2e-4c90-b4c2-8aa8af2a00d7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:09.559476 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fd587-6c2e-4c90-b4c2-8aa8af2a00d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:09.559761 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fd587-6c2e-4c90-b4c2-8aa8af2a00d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:09.561001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fd587-6c2e-4c90-b4c2-8aa8af2a00d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:09.562541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fd587-6c2e-4c90-b4c2-8aa8af2a00d7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:09.564483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 101/195] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:09.565170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fd587-6c2e-4c90-b4c2-8aa8af2a00d7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:09.673052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473a4c0-521f-4690-8314-3e6a3f3bc237 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:09.693188 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fd587-6c2e-4c90-b4c2-8aa8af2a00d7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:09.708348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:09.719515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d586-9f28-42c1-8e07-68de4c0dcf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:09.720137 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d586-9f28-42c1-8e07-68de4c0dcf3a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:09.720423 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d586-9f28-42c1-8e07-68de4c0dcf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:09.720746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d586-9f28-42c1-8e07-68de4c0dcf3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:09.736310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df546f3d-a27d-4b08-a14f-408cb8e69d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:09.737424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546f3d-a27d-4b08-a14f-408cb8e69d72 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:09.737875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546f3d-a27d-4b08-a14f-408cb8e69d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:09.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546f3d-a27d-4b08-a14f-408cb8e69d72 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:09.740184 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df546f3d-a27d-4b08-a14f-408cb8e69d72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:09.740617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df546f3d-a27d-4b08-a14f-408cb8e69d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:09.742752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df546f3d-a27d-4b08-a14f-408cb8e69d72 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:09.755140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 102/196] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:09.756650 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df546f3d-a27d-4b08-a14f-408cb8e69d72 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:09.772188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:09.808319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0d586-9f28-42c1-8e07-68de4c0dcf3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:09.809831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0d586-9f28-42c1-8e07-68de4c0dcf3a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:09.890289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df546f3d-a27d-4b08-a14f-408cb8e69d72 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:09.920640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 95/197] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:09.926015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d586-9f28-42c1-8e07-68de4c0dcf3a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:09.931469 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c25b8-3e54-44a6-9879-21978bfaf394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:09.932357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c25b8-3e54-44a6-9879-21978bfaf394 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:09.932645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c25b8-3e54-44a6-9879-21978bfaf394 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:09.932949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c25b8-3e54-44a6-9879-21978bfaf394 None admin] PATH_INFO: `/v3/users/9c22b6b48c674a94b45a1fd536561cba` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:09.950701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c25b8-3e54-44a6-9879-21978bfaf394 None admin] RBAC: Authorizing `identity:get_user(user_id=9c22b6b48c674a94b45a1fd536561cba)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:09.952753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c25b8-3e54-44a6-9879-21978bfaf394 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:09.954584 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 103/198] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:09 2022] GET /identity/v3/users/9c22b6b48c674a94b45a1fd536561cba => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:09.955382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c25b8-3e54-44a6-9879-21978bfaf394 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:09.997883 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:10.001237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:10.042063 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d586-9f28-42c1-8e07-68de4c0dcf3a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:10.077835 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c25b8-3e54-44a6-9879-21978bfaf394 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:10.084735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bcb5a-e8f7-409f-9000-88e5e7a75bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:10.085862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bcb5a-e8f7-409f-9000-88e5e7a75bf5 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:10.086942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bcb5a-e8f7-409f-9000-88e5e7a75bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:10.087405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bcb5a-e8f7-409f-9000-88e5e7a75bf5 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:10.089260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bcb5a-e8f7-409f-9000-88e5e7a75bf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:10.091679 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bcb5a-e8f7-409f-9000-88e5e7a75bf5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:10.111562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 96/199] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:11:09 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:11:10.112406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bcb5a-e8f7-409f-9000-88e5e7a75bf5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:10.116021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8d872-f807-49b2-b191-92958ae2ad36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:10.116926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8d872-f807-49b2-b191-92958ae2ad36 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:10.117271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8d872-f807-49b2-b191-92958ae2ad36 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:10.117548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8d872-f807-49b2-b191-92958ae2ad36 None admin] PATH_INFO: `/v3/users/9c22b6b48c674a94b45a1fd536561cba` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:10.118837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8d872-f807-49b2-b191-92958ae2ad36 None admin] RBAC: Authorizing `identity:get_user(user_id=9c22b6b48c674a94b45a1fd536561cba)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:10.120340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8d872-f807-49b2-b191-92958ae2ad36 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:10.122162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 104/200] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:09 2022] GET /identity/v3/users/9c22b6b48c674a94b45a1fd536561cba => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:10.127056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8d872-f807-49b2-b191-92958ae2ad36 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:10.270376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8d872-f807-49b2-b191-92958ae2ad36 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:10.272726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:10.284934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bcb5a-e8f7-409f-9000-88e5e7a75bf5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:10.328282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb981-359d-48ea-b934-7bf0a04b0ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:10.329257 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb981-359d-48ea-b934-7bf0a04b0ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:10.329736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb981-359d-48ea-b934-7bf0a04b0ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:10.330345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb981-359d-48ea-b934-7bf0a04b0ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:10.336304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:10.353382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6daa7-31ad-48b0-a835-765465665fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:10.354266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6daa7-31ad-48b0-a835-765465665fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:10.354545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6daa7-31ad-48b0-a835-765465665fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:10.354827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6daa7-31ad-48b0-a835-765465665fe9 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:10.356154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6daa7-31ad-48b0-a835-765465665fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:10.357751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6daa7-31ad-48b0-a835-765465665fe9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:10.359499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 97/201] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:10 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:10.360292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6daa7-31ad-48b0-a835-765465665fe9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:10.429666 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fb981-359d-48ea-b934-7bf0a04b0ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:10.431209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fb981-359d-48ea-b934-7bf0a04b0ee8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:10.497990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6daa7-31ad-48b0-a835-765465665fe9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:10.562667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0111c-59cd-4923-8b0c-bc75cb3aab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:10.563531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0111c-59cd-4923-8b0c-bc75cb3aab42 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:10.563951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0111c-59cd-4923-8b0c-bc75cb3aab42 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:10.564387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0111c-59cd-4923-8b0c-bc75cb3aab42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:10.590059 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 105/202] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:10.592201 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb981-359d-48ea-b934-7bf0a04b0ee8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:10.599670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:10.658798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:10.668132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0111c-59cd-4923-8b0c-bc75cb3aab42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:10.670002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0111c-59cd-4923-8b0c-bc75cb3aab42 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:10.722836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb981-359d-48ea-b934-7bf0a04b0ee8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:10.763453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a760da1-1017-4ad3-83cb-3581b44e6d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:10.764056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a760da1-1017-4ad3-83cb-3581b44e6d70 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:10.764348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a760da1-1017-4ad3-83cb-3581b44e6d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:10.764633 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a760da1-1017-4ad3-83cb-3581b44e6d70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:10.765528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a760da1-1017-4ad3-83cb-3581b44e6d70 None admin] RBAC: Adding query filter params (role.id=0af3acb37467488c9ef322c203b98fd9, scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a, user.id=827eafcf3aa34ae89beeb798f466e590) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:10.765848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a760da1-1017-4ad3-83cb-3581b44e6d70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:10.767446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a760da1-1017-4ad3-83cb-3581b44e6d70 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:10.785099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 106/203] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:10 2022] GET /identity/v3/role_assignments?user.id=827eafcf3aa34ae89beeb798f466e590&scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a&role.id=0af3acb37467488c9ef322c203b98fd9 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:10.785099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a760da1-1017-4ad3-83cb-3581b44e6d70 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:10.809944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 98/204] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:10.815974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0111c-59cd-4923-8b0c-bc75cb3aab42 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:10.872666 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:10.943527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a760da1-1017-4ad3-83cb-3581b44e6d70 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:10.992264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:11.003900 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0111c-59cd-4923-8b0c-bc75cb3aab42 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:11.021642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad758ce4-665d-4d7d-8bab-908bc76b57fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:11.023124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad758ce4-665d-4d7d-8bab-908bc76b57fe None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:11.024061 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad758ce4-665d-4d7d-8bab-908bc76b57fe None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:11.024696 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad758ce4-665d-4d7d-8bab-908bc76b57fe None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:11.026448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad758ce4-665d-4d7d-8bab-908bc76b57fe None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:11.029011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad758ce4-665d-4d7d-8bab-908bc76b57fe None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:11.031827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 107/205] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:10 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:11.037787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad758ce4-665d-4d7d-8bab-908bc76b57fe None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:11.054895 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f56d84-e88f-4827-85ed-b7d93dd6ea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:11.055824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f56d84-e88f-4827-85ed-b7d93dd6ea3f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:11.056523 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f56d84-e88f-4827-85ed-b7d93dd6ea3f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:11.056813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f56d84-e88f-4827-85ed-b7d93dd6ea3f None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:11.059109 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f56d84-e88f-4827-85ed-b7d93dd6ea3f None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:11.060453 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f56d84-e88f-4827-85ed-b7d93dd6ea3f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:11.062604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 99/206] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:10 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:11.068839 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f56d84-e88f-4827-85ed-b7d93dd6ea3f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:11.187538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f56d84-e88f-4827-85ed-b7d93dd6ea3f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:11.188372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad758ce4-665d-4d7d-8bab-908bc76b57fe None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:11.235206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88848e15-c26a-4f71-9bc3-280f594f7d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:11.236211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88848e15-c26a-4f71-9bc3-280f594f7d26 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:11.236645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bcc66-d556-48ad-b40f-a26bd3fce6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:11.236915 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88848e15-c26a-4f71-9bc3-280f594f7d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:11.237336 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bcc66-d556-48ad-b40f-a26bd3fce6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:11.237627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bcc66-d556-48ad-b40f-a26bd3fce6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:11.237826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88848e15-c26a-4f71-9bc3-280f594f7d26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:11.237920 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bcc66-d556-48ad-b40f-a26bd3fce6a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:11.240859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bcc66-d556-48ad-b40f-a26bd3fce6a6 None admin] RBAC: Adding query filter params (role.id=f5fb67c95c834bc9b359a5141ae0f60c, scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f, user.id=9c22b6b48c674a94b45a1fd536561cba) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:11.240859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bcc66-d556-48ad-b40f-a26bd3fce6a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:11.240859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bcc66-d556-48ad-b40f-a26bd3fce6a6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:11.241402 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88848e15-c26a-4f71-9bc3-280f594f7d26 None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f, user.id=9c22b6b48c674a94b45a1fd536561cba) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:11.241927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88848e15-c26a-4f71-9bc3-280f594f7d26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:11.243580 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88848e15-c26a-4f71-9bc3-280f594f7d26 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:11.246164 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:11.247437 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 100/207] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:11 2022] GET /identity/v3/role_assignments?user.id=9c22b6b48c674a94b45a1fd536561cba&scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f&role.id=f5fb67c95c834bc9b359a5141ae0f60c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:11.260490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 108/208] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:11 2022] GET /identity/v3/role_assignments?user.id=9c22b6b48c674a94b45a1fd536561cba&scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f&role.id=87593f63c4744eac870c07b006022e77 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:12.494613 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e442889-9453-4dc5-8641-30e11c323176 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:12.495134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e442889-9453-4dc5-8641-30e11c323176 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:12.495134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e442889-9453-4dc5-8641-30e11c323176 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:12.495300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fcf80-5d8d-46ce-9f88-4d520c511aaf None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:12.495625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fcf80-5d8d-46ce-9f88-4d520c511aaf None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:12.495936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fcf80-5d8d-46ce-9f88-4d520c511aaf None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:12.496529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 101/209] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:12.497843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 109/210] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:12.502269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7169a-b47a-46e5-ab8d-0104396b878b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:12.502530 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e34dd9-d0f4-4f23-ac90-ede2ac11e2ba None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:12.502631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7169a-b47a-46e5-ab8d-0104396b878b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:12.502779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e34dd9-d0f4-4f23-ac90-ede2ac11e2ba None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:12.502888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7169a-b47a-46e5-ab8d-0104396b878b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:12.503044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e34dd9-d0f4-4f23-ac90-ede2ac11e2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:12.522022 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-75e34dd9-d0f4-4f23-ac90-ede2ac11e2ba None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:12.522872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a6c7169a-b47a-46e5-ab8d-0104396b878b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:12.523618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-75e34dd9-d0f4-4f23-ac90-ede2ac11e2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:12.524052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a6c7169a-b47a-46e5-ab8d-0104396b878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:12.548416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:12.603145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 110/211] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:12.605760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 102/212] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:12.626387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e34dd9-d0f4-4f23-ac90-ede2ac11e2ba None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:12.635517 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7169a-b47a-46e5-ab8d-0104396b878b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:12.745258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e34dd9-d0f4-4f23-ac90-ede2ac11e2ba None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:12.775711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7169a-b47a-46e5-ab8d-0104396b878b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:12.783522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:12.797463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21e1a5-e68c-4a3b-b7a5-9f097a50fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:12.798667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21e1a5-e68c-4a3b-b7a5-9f097a50fc45 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:12.799722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21e1a5-e68c-4a3b-b7a5-9f097a50fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:12.800209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21e1a5-e68c-4a3b-b7a5-9f097a50fc45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:12.815912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913c09-c78c-400c-baa4-77311ace9b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:12.816727 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913c09-c78c-400c-baa4-77311ace9b05 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:12.816968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21e1a5-e68c-4a3b-b7a5-9f097a50fc45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:12.817103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913c09-c78c-400c-baa4-77311ace9b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:12.817320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913c09-c78c-400c-baa4-77311ace9b05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:12.818574 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6913c09-c78c-400c-baa4-77311ace9b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:12.820076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6913c09-c78c-400c-baa4-77311ace9b05 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:12.821765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 103/213] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-4b21e1a5-e68c-4a3b-b7a5-9f097a50fc45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:12.826226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:12.827099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:12.827900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:12.827900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:12.827900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:12.827900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:12.827900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:12.827900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:12.827900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:12.827900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:12.827900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:12.827900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:12.827900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:12.827900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:12.828564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913c09-c78c-400c-baa4-77311ace9b05 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:12.830903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 111/214] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:12.836772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21e1a5-e68c-4a3b-b7a5-9f097a50fc45 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:12.857249 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:12.954285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21e1a5-e68c-4a3b-b7a5-9f097a50fc45 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:12.955498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913c09-c78c-400c-baa4-77311ace9b05 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:12.991923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba7155-90b7-4787-8baf-7f1bcb1f121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:12.993041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba7155-90b7-4787-8baf-7f1bcb1f121d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:12.993587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba7155-90b7-4787-8baf-7f1bcb1f121d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:12.994099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba7155-90b7-4787-8baf-7f1bcb1f121d None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:12.995078 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba7155-90b7-4787-8baf-7f1bcb1f121d None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:12.995641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba7155-90b7-4787-8baf-7f1bcb1f121d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:12.997326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba7155-90b7-4787-8baf-7f1bcb1f121d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:13.007154 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 112/215] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:13.013408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba7155-90b7-4787-8baf-7f1bcb1f121d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:13.019578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683890e-6098-42d1-9459-bb53bd8f389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:13.021311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683890e-6098-42d1-9459-bb53bd8f389f None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:13.021810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683890e-6098-42d1-9459-bb53bd8f389f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:13.022311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683890e-6098-42d1-9459-bb53bd8f389f None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:13.023658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683890e-6098-42d1-9459-bb53bd8f389f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:13.026463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683890e-6098-42d1-9459-bb53bd8f389f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:13.073163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 104/216] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:11:12 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:11:13.092554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:13.159041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba7155-90b7-4787-8baf-7f1bcb1f121d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:13.196883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2088ea-2cd2-40df-972e-106a09bb7856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:13.197826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2088ea-2cd2-40df-972e-106a09bb7856 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:13.198174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2088ea-2cd2-40df-972e-106a09bb7856 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:13.198693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2088ea-2cd2-40df-972e-106a09bb7856 None admin] PATH_INFO: `/v3/users/bb809b979f4f40648f4a181e740186b9` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:13.227008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2088ea-2cd2-40df-972e-106a09bb7856 None admin] RBAC: Authorizing `identity:get_user(user_id=bb809b979f4f40648f4a181e740186b9)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:13.230354 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2088ea-2cd2-40df-972e-106a09bb7856 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:13.236462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 113/217] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:13 2022] GET /identity/v3/users/bb809b979f4f40648f4a181e740186b9 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:13.242377 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683890e-6098-42d1-9459-bb53bd8f389f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:13.336364 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:13.358326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683890e-6098-42d1-9459-bb53bd8f389f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:13.390562 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da09b8-d8a7-4746-88b5-91e87d9e70bd None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:13.391158 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da09b8-d8a7-4746-88b5-91e87d9e70bd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:13.391631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da09b8-d8a7-4746-88b5-91e87d9e70bd None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:13.394338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 114/218] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:13.402072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c285a0f-60f3-4cb8-b0f3-420f1b053583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:13.402384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f9767-e7e5-465a-8d74-fd029871a54d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:13.402748 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c285a0f-60f3-4cb8-b0f3-420f1b053583 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:13.402873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f9767-e7e5-465a-8d74-fd029871a54d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:13.403026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c285a0f-60f3-4cb8-b0f3-420f1b053583 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:13.403306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f9767-e7e5-465a-8d74-fd029871a54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:13.403415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c285a0f-60f3-4cb8-b0f3-420f1b053583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:13.440868 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7e5f9767-e7e5-465a-8d74-fd029871a54d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:13.443441 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7e5f9767-e7e5-465a-8d74-fd029871a54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:13.510363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c285a0f-60f3-4cb8-b0f3-420f1b053583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:13.513122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c285a0f-60f3-4cb8-b0f3-420f1b053583 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:13.548741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 115/219] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:13.550852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5cb4d-61e6-435d-9026-68577b7c5fc8 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:13.551348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5cb4d-61e6-435d-9026-68577b7c5fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:13.551644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5cb4d-61e6-435d-9026-68577b7c5fc8 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:13.553025 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 116/220] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:13.559806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a87dc-6de9-42df-b8bc-3c08ea993f55 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:13.560188 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a87dc-6de9-42df-b8bc-3c08ea993f55 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:13.560415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a87dc-6de9-42df-b8bc-3c08ea993f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:13.586233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f27a87dc-6de9-42df-b8bc-3c08ea993f55 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:13.588311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f27a87dc-6de9-42df-b8bc-3c08ea993f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:13.641432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:13.654897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:13.688711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 105/221] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 15:11:13.689703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c285a0f-60f3-4cb8-b0f3-420f1b053583 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:13.692135 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 117/222] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:13.695357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a87dc-6de9-42df-b8bc-3c08ea993f55 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:13.830482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c285a0f-60f3-4cb8-b0f3-420f1b053583 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:13.831534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a87dc-6de9-42df-b8bc-3c08ea993f55 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:13.870305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dcbe9-997a-4526-9dfc-50859479f813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:13.871108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dcbe9-997a-4526-9dfc-50859479f813 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:13.871390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dcbe9-997a-4526-9dfc-50859479f813 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:13.871685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dcbe9-997a-4526-9dfc-50859479f813 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:13.875870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec6a9e-c994-4fdb-9645-425abf3a72e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:13.877492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec6a9e-c994-4fdb-9645-425abf3a72e1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:13.878143 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec6a9e-c994-4fdb-9645-425abf3a72e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:13.878648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec6a9e-c994-4fdb-9645-425abf3a72e1 None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:13.881415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec6a9e-c994-4fdb-9645-425abf3a72e1 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:13.883386 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec6a9e-c994-4fdb-9645-425abf3a72e1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:13.883497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dcbe9-997a-4526-9dfc-50859479f813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:13.885487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 118/223] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:13 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:13.886654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec6a9e-c994-4fdb-9645-425abf3a72e1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-311dcbe9-997a-4526-9dfc-50859479f813 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:13.891788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:13.892688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 106/224] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:11:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:13.893905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dcbe9-997a-4526-9dfc-50859479f813 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:13.946486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:13.947380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:14.013456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec6a9e-c994-4fdb-9645-425abf3a72e1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:14.023310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dcbe9-997a-4526-9dfc-50859479f813 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:14.056526 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8db8bf-95ac-4239-9d2f-e9f7926cbdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:14.057807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8db8bf-95ac-4239-9d2f-e9f7926cbdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:14.058263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8db8bf-95ac-4239-9d2f-e9f7926cbdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:14.058682 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8db8bf-95ac-4239-9d2f-e9f7926cbdf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:14.059908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4c91-61ee-418b-abfc-0292ca05b2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:14.060678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4c91-61ee-418b-abfc-0292ca05b2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:14.061097 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4c91-61ee-418b-abfc-0292ca05b2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:14.061466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4c91-61ee-418b-abfc-0292ca05b2f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:14.062551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c4c91-61ee-418b-abfc-0292ca05b2f5 None admin] RBAC: Adding query filter params (role.id=b670784e829b4bffb77b03422132634a, scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f, user.id=bb809b979f4f40648f4a181e740186b9) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:14.062830 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c4c91-61ee-418b-abfc-0292ca05b2f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:14.064516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c4c91-61ee-418b-abfc-0292ca05b2f5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:14.071215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 107/225] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:13 2022] GET /identity/v3/role_assignments?user.id=bb809b979f4f40648f4a181e740186b9&scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f&role.id=b670784e829b4bffb77b03422132634a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:14.072147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4c91-61ee-418b-abfc-0292ca05b2f5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:14.072398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8db8bf-95ac-4239-9d2f-e9f7926cbdf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-6b8db8bf-95ac-4239-9d2f-e9f7926cbdf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:14.081101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:14.082080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:14.083071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 119/226] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:11:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:14.090727 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8db8bf-95ac-4239-9d2f-e9f7926cbdf5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:14.256213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4c91-61ee-418b-abfc-0292ca05b2f5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:14.259071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:14.288076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:14.298237 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489536a5-ada1-4352-be98-49913fb818e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:14.298929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489536a5-ada1-4352-be98-49913fb818e7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:14.299217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489536a5-ada1-4352-be98-49913fb818e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:14.299496 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489536a5-ada1-4352-be98-49913fb818e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:14.300833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489536a5-ada1-4352-be98-49913fb818e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:14.300833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489536a5-ada1-4352-be98-49913fb818e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:14.302191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489536a5-ada1-4352-be98-49913fb818e7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:14.312034 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 108/227] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:14.312832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8db8bf-95ac-4239-9d2f-e9f7926cbdf5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:14.320733 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489536a5-ada1-4352-be98-49913fb818e7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:14.393377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ca78e-6b84-4a2b-b99d-d53c220e4836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:14.395012 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ca78e-6b84-4a2b-b99d-d53c220e4836 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:14.396801 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ca78e-6b84-4a2b-b99d-d53c220e4836 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:14.397321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ca78e-6b84-4a2b-b99d-d53c220e4836 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:14.398742 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ca78e-6b84-4a2b-b99d-d53c220e4836 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:14.399518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ca78e-6b84-4a2b-b99d-d53c220e4836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:14.401950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ca78e-6b84-4a2b-b99d-d53c220e4836 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:14.418903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 120/228] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:14.420493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ca78e-6b84-4a2b-b99d-d53c220e4836 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:14.542233 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489536a5-ada1-4352-be98-49913fb818e7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:14.575304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ca78e-6b84-4a2b-b99d-d53c220e4836 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:14.584143 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073f9c1-53c2-4824-bd3a-3e19e1c53605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:14.585401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073f9c1-53c2-4824-bd3a-3e19e1c53605 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:14.585980 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073f9c1-53c2-4824-bd3a-3e19e1c53605 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:14.586452 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073f9c1-53c2-4824-bd3a-3e19e1c53605 None admin] PATH_INFO: `/v3/users/9c22b6b48c674a94b45a1fd536561cba` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:14.594064 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073f9c1-53c2-4824-bd3a-3e19e1c53605 None admin] RBAC: Authorizing `identity:get_user(user_id=9c22b6b48c674a94b45a1fd536561cba)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:14.595907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073f9c1-53c2-4824-bd3a-3e19e1c53605 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:14.598013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 109/229] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:14 2022] GET /identity/v3/users/9c22b6b48c674a94b45a1fd536561cba => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:14.604698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073f9c1-53c2-4824-bd3a-3e19e1c53605 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:14.656740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba79b07-f815-48c1-847b-0543b133a2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:14.658098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba79b07-f815-48c1-847b-0543b133a2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:14.658616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba79b07-f815-48c1-847b-0543b133a2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:14.659088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba79b07-f815-48c1-847b-0543b133a2a4 None admin] PATH_INFO: `/v3/users/9c22b6b48c674a94b45a1fd536561cba` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:14.661622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba79b07-f815-48c1-847b-0543b133a2a4 None admin] RBAC: Authorizing `identity:get_user(user_id=9c22b6b48c674a94b45a1fd536561cba)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:14.664643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba79b07-f815-48c1-847b-0543b133a2a4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:14.668769 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 121/230] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:14 2022] GET /identity/v3/users/9c22b6b48c674a94b45a1fd536561cba => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:14.680882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:14.693280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba79b07-f815-48c1-847b-0543b133a2a4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:14.725725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:14.821506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba79b07-f815-48c1-847b-0543b133a2a4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:14.835531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073f9c1-53c2-4824-bd3a-3e19e1c53605 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:14.868140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d89304-0b03-4f5b-84c9-5b0a0b73f19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:14.869018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d89304-0b03-4f5b-84c9-5b0a0b73f19a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:14.869323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d89304-0b03-4f5b-84c9-5b0a0b73f19a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:14.869598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d89304-0b03-4f5b-84c9-5b0a0b73f19a None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:14.872423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d89304-0b03-4f5b-84c9-5b0a0b73f19a None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:14.873933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d89304-0b03-4f5b-84c9-5b0a0b73f19a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:14.875673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 122/231] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:14 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:14.884799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d89304-0b03-4f5b-84c9-5b0a0b73f19a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:14.911596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2ffda-28c4-42d6-abd3-9eb2ab0204b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:14.912551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2ffda-28c4-42d6-abd3-9eb2ab0204b1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:14.912832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2ffda-28c4-42d6-abd3-9eb2ab0204b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:14.913124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2ffda-28c4-42d6-abd3-9eb2ab0204b1 None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:14.914857 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2ffda-28c4-42d6-abd3-9eb2ab0204b1 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:14.916330 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2ffda-28c4-42d6-abd3-9eb2ab0204b1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:14.918100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 110/232] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:14 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:14.928728 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2ffda-28c4-42d6-abd3-9eb2ab0204b1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:15.101470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:15.113311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d89304-0b03-4f5b-84c9-5b0a0b73f19a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:15.149952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a83b0b-08f2-4088-b475-0119abffae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:15.150847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a83b0b-08f2-4088-b475-0119abffae9e None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:15.151132 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a83b0b-08f2-4088-b475-0119abffae9e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:15.151411 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a83b0b-08f2-4088-b475-0119abffae9e None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f/users/9c22b6b48c674a94b45a1fd536561cba/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:15.154003 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a83b0b-08f2-4088-b475-0119abffae9e None admin] RBAC: Authorizing `identity:create_grant(project_id=ffa8c33444b7494fbfbe8ad5eadb219f, user_id=9c22b6b48c674a94b45a1fd536561cba, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:15.155507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a83b0b-08f2-4088-b475-0119abffae9e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:15.171169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 123/233] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:11:14 2022] PUT /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f/users/9c22b6b48c674a94b45a1fd536561cba/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:15.171511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2ffda-28c4-42d6-abd3-9eb2ab0204b1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:15.173440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:15.253799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e59ae-e843-4987-ac78-8c25c8af00b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:15.256135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e59ae-e843-4987-ac78-8c25c8af00b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:15.256435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e59ae-e843-4987-ac78-8c25c8af00b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:15.256716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e59ae-e843-4987-ac78-8c25c8af00b7 None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f/users/9c22b6b48c674a94b45a1fd536561cba/roles/f5fb67c95c834bc9b359a5141ae0f60c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:15.259276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e59ae-e843-4987-ac78-8c25c8af00b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffa8c33444b7494fbfbe8ad5eadb219f, user_id=9c22b6b48c674a94b45a1fd536561cba, role_id=f5fb67c95c834bc9b359a5141ae0f60c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:15.260751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e59ae-e843-4987-ac78-8c25c8af00b7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:15.288115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 111/234] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:11:14 2022] PUT /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f/users/9c22b6b48c674a94b45a1fd536561cba/roles/f5fb67c95c834bc9b359a5141ae0f60c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:15.851497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4ce93-6d2e-4c5c-98fc-089f8849611b None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:15.852001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4ce93-6d2e-4c5c-98fc-089f8849611b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:15.852001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4ce93-6d2e-4c5c-98fc-089f8849611b None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:15.853732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 124/235] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:15.859305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf07f19-8cd9-400a-8b4f-e84b32be1442 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:15.859770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf07f19-8cd9-400a-8b4f-e84b32be1442 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:15.859868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf07f19-8cd9-400a-8b4f-e84b32be1442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:15.882047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2bf07f19-8cd9-400a-8b4f-e84b32be1442 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:15.883277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2bf07f19-8cd9-400a-8b4f-e84b32be1442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:15.983379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 112/236] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:16.022741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4ce93-6d2e-4c5c-98fc-089f8849611b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:16.033916 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5db197-9989-4014-a24f-66b8208b73b3 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:16.034299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5db197-9989-4014-a24f-66b8208b73b3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:16.034536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5db197-9989-4014-a24f-66b8208b73b3 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:16.038509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 113/237] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:16.047047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1282fb-f1f9-4ebf-bdb2-50386823f6fa None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:16.047322 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1282fb-f1f9-4ebf-bdb2-50386823f6fa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:16.047601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1282fb-f1f9-4ebf-bdb2-50386823f6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:16.069624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fa1282fb-f1f9-4ebf-bdb2-50386823f6fa None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:16.070833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fa1282fb-f1f9-4ebf-bdb2-50386823f6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:16.190099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 114/238] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:16.211042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4ce93-6d2e-4c5c-98fc-089f8849611b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:16.237947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1282fb-f1f9-4ebf-bdb2-50386823f6fa None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:16.270513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:16.283725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b99495-9606-467a-ab1c-337726698909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:16.284892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b99495-9606-467a-ab1c-337726698909 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:16.285403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b99495-9606-467a-ab1c-337726698909 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:16.286336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b99495-9606-467a-ab1c-337726698909 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:16.300478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b99495-9606-467a-ab1c-337726698909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-09b99495-9606-467a-ab1c-337726698909 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:16.309458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:16.310366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:16.311138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:16.311138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:16.311138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:16.311138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:16.311138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:16.311138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:16.311138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:16.311138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:16.311138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:16.311138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:16.311138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:16.311138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:16.313956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 125/239] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:16.320057 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b99495-9606-467a-ab1c-337726698909 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:16.339438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:16.418367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1282fb-f1f9-4ebf-bdb2-50386823f6fa None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:16.455347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557ba8a-38b3-45ce-9059-8e495b99b924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:16.456504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ba8a-38b3-45ce-9059-8e495b99b924 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:16.457077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ba8a-38b3-45ce-9059-8e495b99b924 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:16.457560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ba8a-38b3-45ce-9059-8e495b99b924 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:16.459149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557ba8a-38b3-45ce-9059-8e495b99b924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:16.460943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557ba8a-38b3-45ce-9059-8e495b99b924 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:16.462850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 115/240] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:16.468564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557ba8a-38b3-45ce-9059-8e495b99b924 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:16.507787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b99495-9606-467a-ab1c-337726698909 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:16.573508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:16.576836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557ba8a-38b3-45ce-9059-8e495b99b924 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:16.601859 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83ee72-0bc5-49d8-8cd3-4fd1a1d2c38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:16.603011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83ee72-0bc5-49d8-8cd3-4fd1a1d2c38c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:16.603011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83ee72-0bc5-49d8-8cd3-4fd1a1d2c38c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:16.603142 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83ee72-0bc5-49d8-8cd3-4fd1a1d2c38c None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:16.603860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83ee72-0bc5-49d8-8cd3-4fd1a1d2c38c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:16.604167 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83ee72-0bc5-49d8-8cd3-4fd1a1d2c38c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:16.609118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83ee72-0bc5-49d8-8cd3-4fd1a1d2c38c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:16.625096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 126/241] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:16.631132 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83ee72-0bc5-49d8-8cd3-4fd1a1d2c38c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:16.649479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7814344-3a71-4121-baf6-f4776857fb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:16.650505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814344-3a71-4121-baf6-f4776857fb1e None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:16.650990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814344-3a71-4121-baf6-f4776857fb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:16.651527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814344-3a71-4121-baf6-f4776857fb1e None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:16.653841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7814344-3a71-4121-baf6-f4776857fb1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:16.656242 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7814344-3a71-4121-baf6-f4776857fb1e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:16.694680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 116/242] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:11:16 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:11:16.765629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:16.804163 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83ee72-0bc5-49d8-8cd3-4fd1a1d2c38c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:16.858575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5829c-ad69-43e8-929a-49818433374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:16.860356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5829c-ad69-43e8-929a-49818433374d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:16.860894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5829c-ad69-43e8-929a-49818433374d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:16.861471 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5829c-ad69-43e8-929a-49818433374d None admin] PATH_INFO: `/v3/users/8c7e90fcb7df4f60852559adfbf9eda3` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:16.878777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5829c-ad69-43e8-929a-49818433374d None admin] RBAC: Authorizing `identity:get_user(user_id=8c7e90fcb7df4f60852559adfbf9eda3)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:16.881594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5829c-ad69-43e8-929a-49818433374d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:16.884151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 127/243] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:16 2022] GET /identity/v3/users/8c7e90fcb7df4f60852559adfbf9eda3 => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:16.889792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7814344-3a71-4121-baf6-f4776857fb1e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:16.952518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33515592-75e7-4c3e-ab78-e6e114b206ad None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:16.952866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33515592-75e7-4c3e-ab78-e6e114b206ad None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:16.953126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33515592-75e7-4c3e-ab78-e6e114b206ad None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:16.954869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 128/244] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:16.967490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4fd7f-32db-4d41-b2a8-68c3643877d5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:16.967804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4fd7f-32db-4d41-b2a8-68c3643877d5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:16.968106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4fd7f-32db-4d41-b2a8-68c3643877d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:16.991330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ddd4fd7f-32db-4d41-b2a8-68c3643877d5 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:16.992608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ddd4fd7f-32db-4d41-b2a8-68c3643877d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:17.034584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7814344-3a71-4121-baf6-f4776857fb1e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:17.093178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 129/245] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:17.104478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2a694-f878-4905-91ce-102279fa8d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:17.105324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2a694-f878-4905-91ce-102279fa8d04 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:17.105608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2a694-f878-4905-91ce-102279fa8d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:17.106026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2a694-f878-4905-91ce-102279fa8d04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:17.122267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4fd7f-32db-4d41-b2a8-68c3643877d5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:17.134100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:17.193640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:17.232996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2a694-f878-4905-91ce-102279fa8d04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:17.237334 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2a694-f878-4905-91ce-102279fa8d04 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:17.274844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4fd7f-32db-4d41-b2a8-68c3643877d5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:17.320670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dd337-0eee-4723-b7b2-5afdc3ff4a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:17.321867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dd337-0eee-4723-b7b2-5afdc3ff4a5c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:17.322766 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dd337-0eee-4723-b7b2-5afdc3ff4a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:17.323259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dd337-0eee-4723-b7b2-5afdc3ff4a5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:17.343895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8dd337-0eee-4723-b7b2-5afdc3ff4a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-bb8dd337-0eee-4723-b7b2-5afdc3ff4a5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:17.352720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:17.353916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:17.354937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:17.354937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:17.354937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:17.354937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:17.354937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:17.354937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:17.354937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:17.354937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:17.354937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:17.354937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:17.354937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:17.354937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:17.356816 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 130/246] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:17.366051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dd337-0eee-4723-b7b2-5afdc3ff4a5c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:17.413500 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 117/247] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:17.419996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2a694-f878-4905-91ce-102279fa8d04 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:17.475387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:17.534187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dd337-0eee-4723-b7b2-5afdc3ff4a5c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:17.549990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2a694-f878-4905-91ce-102279fa8d04 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:17.566572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:17.584423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ac244-b2de-4864-a1f9-91a874ad1839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:17.585477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac244-b2de-4864-a1f9-91a874ad1839 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:17.588742 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac244-b2de-4864-a1f9-91a874ad1839 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:17.589174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac244-b2de-4864-a1f9-91a874ad1839 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:17.589945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ac244-b2de-4864-a1f9-91a874ad1839 None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:17.590340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ac244-b2de-4864-a1f9-91a874ad1839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:17.592966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ac244-b2de-4864-a1f9-91a874ad1839 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:17.601902 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02319f-3289-4517-9f51-47127858970c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:17.602819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02319f-3289-4517-9f51-47127858970c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:17.603105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02319f-3289-4517-9f51-47127858970c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:17.603385 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02319f-3289-4517-9f51-47127858970c None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:17.604862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02319f-3289-4517-9f51-47127858970c None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:17.606558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02319f-3289-4517-9f51-47127858970c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:17.607434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 131/248] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:17.609683 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 118/249] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:17 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:17.621504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ac244-b2de-4864-a1f9-91a874ad1839 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:17.632680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02319f-3289-4517-9f51-47127858970c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:17.763167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02319f-3289-4517-9f51-47127858970c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:17.785608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:17.810989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa391c5b-7e70-42ab-98a2-7fdaa36347c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:17.811884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa391c5b-7e70-42ab-98a2-7fdaa36347c5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:17.812244 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa391c5b-7e70-42ab-98a2-7fdaa36347c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:17.812447 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa391c5b-7e70-42ab-98a2-7fdaa36347c5 None admin] PATH_INFO: `/v3/users/bb809b979f4f40648f4a181e740186b9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:17.814082 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa391c5b-7e70-42ab-98a2-7fdaa36347c5 None admin] RBAC: Authorizing `identity:get_user(user_id=bb809b979f4f40648f4a181e740186b9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:17.815719 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa391c5b-7e70-42ab-98a2-7fdaa36347c5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:17.818445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 119/250] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:17 2022] GET /identity/v3/users/bb809b979f4f40648f4a181e740186b9 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:17.824341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa391c5b-7e70-42ab-98a2-7fdaa36347c5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:17.839281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ac244-b2de-4864-a1f9-91a874ad1839 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:17.945159 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ec60-9169-4f5d-adce-534a242ae52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:17.946395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ec60-9169-4f5d-adce-534a242ae52c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:17.947115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ec60-9169-4f5d-adce-534a242ae52c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:17.947624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ec60-9169-4f5d-adce-534a242ae52c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:17.948744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa391c5b-7e70-42ab-98a2-7fdaa36347c5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:17.949565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20ec60-9169-4f5d-adce-534a242ae52c None admin] RBAC: Adding query filter params (role.id=0af3acb37467488c9ef322c203b98fd9, scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f, user.id=8c7e90fcb7df4f60852559adfbf9eda3) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:17.950120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20ec60-9169-4f5d-adce-534a242ae52c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:17.958468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20ec60-9169-4f5d-adce-534a242ae52c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:17.977565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 132/251] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:17 2022] GET /identity/v3/role_assignments?user.id=8c7e90fcb7df4f60852559adfbf9eda3&scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f&role.id=0af3acb37467488c9ef322c203b98fd9 => generated 259 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:17.986171 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb975a6-c736-4daa-812f-12166a6c07c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:17.987105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb975a6-c736-4daa-812f-12166a6c07c5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:17.987393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb975a6-c736-4daa-812f-12166a6c07c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:17.987676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb975a6-c736-4daa-812f-12166a6c07c5 None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:17.989179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb975a6-c736-4daa-812f-12166a6c07c5 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:17.990714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb975a6-c736-4daa-812f-12166a6c07c5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:17.992522 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 120/252] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:17 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:17.998579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ec60-9169-4f5d-adce-534a242ae52c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:18.073323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:18.134882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15963797-57a7-47e5-854a-05d7d32518a3 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:18.135169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15963797-57a7-47e5-854a-05d7d32518a3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:18.135379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15963797-57a7-47e5-854a-05d7d32518a3 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:18.136976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 121/253] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:18.146759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1d477-4fe8-4754-9b05-c918044d419b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:18.147071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1d477-4fe8-4754-9b05-c918044d419b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:18.147330 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1d477-4fe8-4754-9b05-c918044d419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:18.149487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ec60-9169-4f5d-adce-534a242ae52c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:18.184650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f1a1d477-4fe8-4754-9b05-c918044d419b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:18.185938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f1a1d477-4fe8-4754-9b05-c918044d419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:18.209823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfa7b0-2b6d-43d9-b783-a6e4222f983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:18.211149 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfa7b0-2b6d-43d9-b783-a6e4222f983f None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:18.211708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfa7b0-2b6d-43d9-b783-a6e4222f983f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:18.212202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfa7b0-2b6d-43d9-b783-a6e4222f983f None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f/users/bb809b979f4f40648f4a181e740186b9/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:18.222057 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfa7b0-2b6d-43d9-b783-a6e4222f983f None admin] RBAC: Authorizing `identity:create_grant(project_id=ffa8c33444b7494fbfbe8ad5eadb219f, user_id=bb809b979f4f40648f4a181e740186b9, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:18.224007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfa7b0-2b6d-43d9-b783-a6e4222f983f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:18.252894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 133/254] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:11:17 2022] PUT /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f/users/bb809b979f4f40648f4a181e740186b9/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:18.281526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:18.322278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 122/255] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:18.349352 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfa7b0-2b6d-43d9-b783-a6e4222f983f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:18.491982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfa7b0-2b6d-43d9-b783-a6e4222f983f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:18.503416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:18.533377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06da4d-2fc9-4b4d-9b93-486a0449b822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:18.534255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06da4d-2fc9-4b4d-9b93-486a0449b822 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:18.534549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06da4d-2fc9-4b4d-9b93-486a0449b822 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:18.534829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06da4d-2fc9-4b4d-9b93-486a0449b822 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:18.546382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06da4d-2fc9-4b4d-9b93-486a0449b822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-0d06da4d-2fc9-4b4d-9b93-486a0449b822 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:18.555491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:18.556429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:18.557246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 134/256] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:11:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:18.565876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1d477-4fe8-4754-9b05-c918044d419b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:18.594449 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8c2c6-5a40-4182-96a8-1df235dba337 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:18.594868 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8c2c6-5a40-4182-96a8-1df235dba337 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:18.595160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8c2c6-5a40-4182-96a8-1df235dba337 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:18.596704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 135/257] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:18.604096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068290a2-47f6-488e-a921-32e6a6f0e644 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:18.604523 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068290a2-47f6-488e-a921-32e6a6f0e644 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:18.604763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068290a2-47f6-488e-a921-32e6a6f0e644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:18.646894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-068290a2-47f6-488e-a921-32e6a6f0e644 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:18.648366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-068290a2-47f6-488e-a921-32e6a6f0e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:18.802149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1d477-4fe8-4754-9b05-c918044d419b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:18.843545 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 136/258] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:18.867767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779079-6b13-49ac-92b8-40e58bf0c667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:18.868935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779079-6b13-49ac-92b8-40e58bf0c667 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:18.869487 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779079-6b13-49ac-92b8-40e58bf0c667 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:18.869846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779079-6b13-49ac-92b8-40e58bf0c667 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:18.871106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3779079-6b13-49ac-92b8-40e58bf0c667 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:18.871648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3779079-6b13-49ac-92b8-40e58bf0c667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:18.874207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3779079-6b13-49ac-92b8-40e58bf0c667 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:18.888735 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068290a2-47f6-488e-a921-32e6a6f0e644 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:18.893226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 123/259] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:18.901793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779079-6b13-49ac-92b8-40e58bf0c667 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:19.006544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:19.125370 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779079-6b13-49ac-92b8-40e58bf0c667 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:19.162880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:19.171468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068290a2-47f6-488e-a921-32e6a6f0e644 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:19.231654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a9712-efdf-476b-b48d-14b23e7cdd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:19.232567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a9712-efdf-476b-b48d-14b23e7cdd34 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:19.232852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a9712-efdf-476b-b48d-14b23e7cdd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:19.233169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a9712-efdf-476b-b48d-14b23e7cdd34 None admin] PATH_INFO: `/v3/users/9c22b6b48c674a94b45a1fd536561cba` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:19.249311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a9712-efdf-476b-b48d-14b23e7cdd34 None admin] RBAC: Authorizing `identity:get_user(user_id=9c22b6b48c674a94b45a1fd536561cba)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:19.249311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a9712-efdf-476b-b48d-14b23e7cdd34 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:19.249311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 124/260] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:18 2022] GET /identity/v3/users/9c22b6b48c674a94b45a1fd536561cba => generated 283 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:19.254128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a9712-efdf-476b-b48d-14b23e7cdd34 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:19.327970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1440c84-daf5-4b99-8d63-4f1ef0f49158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:19.328794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1440c84-daf5-4b99-8d63-4f1ef0f49158 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:19.329094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1440c84-daf5-4b99-8d63-4f1ef0f49158 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:19.329371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1440c84-daf5-4b99-8d63-4f1ef0f49158 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:19.377238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1440c84-daf5-4b99-8d63-4f1ef0f49158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c1440c84-daf5-4b99-8d63-4f1ef0f49158 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:19.390676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:19.392536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:19.394157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 137/261] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:11:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 504 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:19.410167 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1440c84-daf5-4b99-8d63-4f1ef0f49158 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:19.621357 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a9712-efdf-476b-b48d-14b23e7cdd34 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:19.649178 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:19.689092 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1440c84-daf5-4b99-8d63-4f1ef0f49158 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:19.741705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e001d3-5c4b-4cee-b92a-93db8708257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:19.742762 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e001d3-5c4b-4cee-b92a-93db8708257e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:19.743249 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e001d3-5c4b-4cee-b92a-93db8708257e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:19.743729 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e001d3-5c4b-4cee-b92a-93db8708257e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:19.802720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375666d-bf0d-41f4-a9dd-4d3f40b66e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:19.803805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375666d-bf0d-41f4-a9dd-4d3f40b66e13 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:19.804300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375666d-bf0d-41f4-a9dd-4d3f40b66e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:19.804803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375666d-bf0d-41f4-a9dd-4d3f40b66e13 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:19.806110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375666d-bf0d-41f4-a9dd-4d3f40b66e13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:19.807934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375666d-bf0d-41f4-a9dd-4d3f40b66e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:19.809768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375666d-bf0d-41f4-a9dd-4d3f40b66e13 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:19.840037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 138/262] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:19.841510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375666d-bf0d-41f4-a9dd-4d3f40b66e13 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:19.883236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:19.989689 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e001d3-5c4b-4cee-b92a-93db8708257e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:19.991144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e001d3-5c4b-4cee-b92a-93db8708257e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:20.015055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375666d-bf0d-41f4-a9dd-4d3f40b66e13 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:20.103416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204987a-baf5-4ed1-bde0-f53743587f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:20.104913 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204987a-baf5-4ed1-bde0-f53743587f25 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:20.105450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204987a-baf5-4ed1-bde0-f53743587f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:20.105948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204987a-baf5-4ed1-bde0-f53743587f25 None admin] PATH_INFO: `/v3/users/9c22b6b48c674a94b45a1fd536561cba` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:20.121753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204987a-baf5-4ed1-bde0-f53743587f25 None admin] RBAC: Authorizing `identity:get_user(user_id=9c22b6b48c674a94b45a1fd536561cba)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:20.133922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204987a-baf5-4ed1-bde0-f53743587f25 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:20.151645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 139/263] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:19 2022] GET /identity/v3/users/9c22b6b48c674a94b45a1fd536561cba => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:20.161781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204987a-baf5-4ed1-bde0-f53743587f25 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:20.322537 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 125/264] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1069 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:20.329613 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e001d3-5c4b-4cee-b92a-93db8708257e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:20.356390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:20.381409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:20.398686 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204987a-baf5-4ed1-bde0-f53743587f25 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:20.473737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e671f4c-b9bf-48f3-b2d4-2265c80887a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:20.474820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e671f4c-b9bf-48f3-b2d4-2265c80887a4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:20.475309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e671f4c-b9bf-48f3-b2d4-2265c80887a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:20.475811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e671f4c-b9bf-48f3-b2d4-2265c80887a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:20.512807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e001d3-5c4b-4cee-b92a-93db8708257e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:20.595362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd61344-7a2d-4f12-b637-bbb4580952db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:20.596265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd61344-7a2d-4f12-b637-bbb4580952db None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:20.596554 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd61344-7a2d-4f12-b637-bbb4580952db None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:20.597375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd61344-7a2d-4f12-b637-bbb4580952db None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:20.610095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd61344-7a2d-4f12-b637-bbb4580952db None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:20.612067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd61344-7a2d-4f12-b637-bbb4580952db None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:20.614507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 126/265] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:20 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:20.620660 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd61344-7a2d-4f12-b637-bbb4580952db None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:20.658018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e671f4c-b9bf-48f3-b2d4-2265c80887a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:20.660440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e671f4c-b9bf-48f3-b2d4-2265c80887a4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:20.804830 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:20.829594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd61344-7a2d-4f12-b637-bbb4580952db None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:20.839849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:20.855339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 140/266] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:20.872800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8087e-ef02-4451-8572-6cb5a0d0972e None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:20.874019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8087e-ef02-4451-8572-6cb5a0d0972e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:20.874701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8087e-ef02-4451-8572-6cb5a0d0972e None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:20.876789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 141/267] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:20.878438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60b97c-d1c8-48a3-9e8b-d9330ee653ab None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:20.878928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60b97c-d1c8-48a3-9e8b-d9330ee653ab None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:20.879646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60b97c-d1c8-48a3-9e8b-d9330ee653ab None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:20.881791 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 142/268] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:20.882698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60b97c-d1c8-48a3-9e8b-d9330ee653ab None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:20.894533 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861753c-a476-4682-beb4-d1b9899b350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:20.896072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861753c-a476-4682-beb4-d1b9899b350f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:20.896931 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861753c-a476-4682-beb4-d1b9899b350f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:20.897986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861753c-a476-4682-beb4-d1b9899b350f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:20.899917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861753c-a476-4682-beb4-d1b9899b350f None admin] RBAC: Adding query filter params (role.id=f5fb67c95c834bc9b359a5141ae0f60c, scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f, user.id=9c22b6b48c674a94b45a1fd536561cba) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:20.900685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861753c-a476-4682-beb4-d1b9899b350f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:20.903867 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861753c-a476-4682-beb4-d1b9899b350f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:20.917519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 127/269] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:20 2022] GET /identity/v3/role_assignments?user.id=9c22b6b48c674a94b45a1fd536561cba&scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f&role.id=f5fb67c95c834bc9b359a5141ae0f60c => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:20.920566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e2205-383e-4a0e-8b63-68cc364eaac8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:20.921384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e2205-383e-4a0e-8b63-68cc364eaac8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:20.922097 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e2205-383e-4a0e-8b63-68cc364eaac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:20.946372 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-437e2205-383e-4a0e-8b63-68cc364eaac8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:20.947929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-437e2205-383e-4a0e-8b63-68cc364eaac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:21.008399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60b97c-d1c8-48a3-9e8b-d9330ee653ab None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:21.041139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 128/270] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:21.046400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802888ee-4c50-46fc-a99c-ce85dbec0638 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:21.046925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802888ee-4c50-46fc-a99c-ce85dbec0638 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:21.047666 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802888ee-4c50-46fc-a99c-ce85dbec0638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:21.090218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c3fad-0422-4ce3-8880-9e7c9aca116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:21.091420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c3fad-0422-4ce3-8880-9e7c9aca116f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:21.091893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c3fad-0422-4ce3-8880-9e7c9aca116f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:21.092320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c3fad-0422-4ce3-8880-9e7c9aca116f None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:21.094627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-802888ee-4c50-46fc-a99c-ce85dbec0638 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:21.095702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c3fad-0422-4ce3-8880-9e7c9aca116f None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:21.100790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-802888ee-4c50-46fc-a99c-ce85dbec0638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:21.103492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c3fad-0422-4ce3-8880-9e7c9aca116f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:21.108497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 143/271] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:20 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:21.111875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c3fad-0422-4ce3-8880-9e7c9aca116f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:21.219558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 129/272] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:21.222759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802888ee-4c50-46fc-a99c-ce85dbec0638 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:21.226165 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:21.228849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:21.280168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c3fad-0422-4ce3-8880-9e7c9aca116f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:21.319363 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f096ab0-781b-40b5-bf31-e198fa88ac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:21.320548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f096ab0-781b-40b5-bf31-e198fa88ac9f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:21.321052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f096ab0-781b-40b5-bf31-e198fa88ac9f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:21.321562 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f096ab0-781b-40b5-bf31-e198fa88ac9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:21.334428 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f096ab0-781b-40b5-bf31-e198fa88ac9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-6f096ab0-781b-40b5-bf31-e198fa88ac9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:21.342878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:21.343828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:21.344626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:21.344626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:21.344626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:21.344626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:21.344626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:21.344626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:21.344626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:21.344626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:21.344626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:21.344626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:21.344626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:21.344626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:21.347140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 144/273] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:21.348249 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f096ab0-781b-40b5-bf31-e198fa88ac9f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:21.357358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802888ee-4c50-46fc-a99c-ce85dbec0638 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:21.404907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ada8f-2400-47e9-a5f0-d3c7b97bdc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:21.405581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ada8f-2400-47e9-a5f0-d3c7b97bdc4c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:21.405890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ada8f-2400-47e9-a5f0-d3c7b97bdc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:21.406151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ada8f-2400-47e9-a5f0-d3c7b97bdc4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:21.407005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ada8f-2400-47e9-a5f0-d3c7b97bdc4c None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f, user.id=9c22b6b48c674a94b45a1fd536561cba) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:21.407320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ada8f-2400-47e9-a5f0-d3c7b97bdc4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:21.408858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ada8f-2400-47e9-a5f0-d3c7b97bdc4c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:21.415964 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 130/274] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:21 2022] GET /identity/v3/role_assignments?user.id=9c22b6b48c674a94b45a1fd536561cba&scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f&role.id=87593f63c4744eac870c07b006022e77 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:21.417618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ada8f-2400-47e9-a5f0-d3c7b97bdc4c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:21.470620 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f096ab0-781b-40b5-bf31-e198fa88ac9f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:21.492125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:21.512743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e45ef-6a46-40e9-a180-4f9dd7d89ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:21.513999 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e45ef-6a46-40e9-a180-4f9dd7d89ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:21.514517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e45ef-6a46-40e9-a180-4f9dd7d89ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:21.515012 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e45ef-6a46-40e9-a180-4f9dd7d89ad5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:21.516770 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e45ef-6a46-40e9-a180-4f9dd7d89ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:21.518625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e45ef-6a46-40e9-a180-4f9dd7d89ad5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:21.520748 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 145/275] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:21.522425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97df06-ad0d-4592-a51c-10af3aa925e5 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:21.522960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97df06-ad0d-4592-a51c-10af3aa925e5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:21.523447 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97df06-ad0d-4592-a51c-10af3aa925e5 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:21.525126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 146/276] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:21.526305 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97df06-ad0d-4592-a51c-10af3aa925e5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:21.555615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:21.615093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ada8f-2400-47e9-a5f0-d3c7b97bdc4c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:21.668884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de489c76-58af-4683-961b-75a72cfb8109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:21.669515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de489c76-58af-4683-961b-75a72cfb8109 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:21.669515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de489c76-58af-4683-961b-75a72cfb8109 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:21.669653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de489c76-58af-4683-961b-75a72cfb8109 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:21.670389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de489c76-58af-4683-961b-75a72cfb8109 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:21.670733 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de489c76-58af-4683-961b-75a72cfb8109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:21.674308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de489c76-58af-4683-961b-75a72cfb8109 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:21.682956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 131/277] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:21.684625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a734e-cc9e-4241-8549-9044527bb3d8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:21.685004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a734e-cc9e-4241-8549-9044527bb3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:21.685389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a734e-cc9e-4241-8549-9044527bb3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:21.693414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97df06-ad0d-4592-a51c-10af3aa925e5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:21.709451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c52a734e-cc9e-4241-8549-9044527bb3d8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:21.711232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c52a734e-cc9e-4241-8549-9044527bb3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:21.748287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692f0e5-1ddc-45eb-be50-cb9df9c84a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:21.749098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692f0e5-1ddc-45eb-be50-cb9df9c84a98 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:21.749297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692f0e5-1ddc-45eb-be50-cb9df9c84a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:21.749579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692f0e5-1ddc-45eb-be50-cb9df9c84a98 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:21.750328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692f0e5-1ddc-45eb-be50-cb9df9c84a98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:21.751811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692f0e5-1ddc-45eb-be50-cb9df9c84a98 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:21.782337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 147/278] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:11:21 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:11:21.783235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692f0e5-1ddc-45eb-be50-cb9df9c84a98 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:21.841534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 132/279] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:21.847092 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:21.870153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a12b9-db73-41c3-b337-d8124946bb45 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:21.870477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a12b9-db73-41c3-b337-d8124946bb45 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:21.870780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a12b9-db73-41c3-b337-d8124946bb45 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:21.872397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 133/280] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:21.876489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a12b9-db73-41c3-b337-d8124946bb45 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:21.933586 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692f0e5-1ddc-45eb-be50-cb9df9c84a98 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:21.975668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea42120-39f5-4171-84e5-99978400bfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:21.976561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea42120-39f5-4171-84e5-99978400bfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:21.976844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea42120-39f5-4171-84e5-99978400bfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:21.977139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea42120-39f5-4171-84e5-99978400bfd1 None admin] PATH_INFO: `/v3/users/d76fe557c8fa452688eff40a7f9b634f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:21.986251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:22.006912 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea42120-39f5-4171-84e5-99978400bfd1 None admin] RBAC: Authorizing `identity:get_user(user_id=d76fe557c8fa452688eff40a7f9b634f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:22.010475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea42120-39f5-4171-84e5-99978400bfd1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:22.015085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 148/281] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:21 2022] GET /identity/v3/users/d76fe557c8fa452688eff40a7f9b634f => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:22.018283 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce52c3-84c1-42de-b920-014ad31be7d9 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:22.018794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce52c3-84c1-42de-b920-014ad31be7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:22.019302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce52c3-84c1-42de-b920-014ad31be7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:22.036891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a12b9-db73-41c3-b337-d8124946bb45 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:22.045750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f3ce52c3-84c1-42de-b920-014ad31be7d9 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:22.047059 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f3ce52c3-84c1-42de-b920-014ad31be7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:22.090890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3bf16-7c22-4c76-8359-c2b339826443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:22.092269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3bf16-7c22-4c76-8359-c2b339826443 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:22.092776 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3bf16-7c22-4c76-8359-c2b339826443 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:22.093453 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3bf16-7c22-4c76-8359-c2b339826443 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:22.116936 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3bf16-7c22-4c76-8359-c2b339826443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:22.132931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 149/282] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:22.133837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce52c3-84c1-42de-b920-014ad31be7d9 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f1c3bf16-7c22-4c76-8359-c2b339826443 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:22.136152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:22.137026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:22.137919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:22.137919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:22.137919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:22.137919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:22.137919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:22.137919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:22.137919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:22.137919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:22.137919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:22.137919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:22.137919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:22.137919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:22.138703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 134/283] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:22.151080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3bf16-7c22-4c76-8359-c2b339826443 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:22.172875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:22.273516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce52c3-84c1-42de-b920-014ad31be7d9 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:22.295851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3bf16-7c22-4c76-8359-c2b339826443 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:22.323705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:22.337432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6cbc8-d754-49dc-aa3a-f3dcb86fdde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:22.338692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6cbc8-d754-49dc-aa3a-f3dcb86fdde3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:22.338692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6cbc8-d754-49dc-aa3a-f3dcb86fdde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:22.338692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6cbc8-d754-49dc-aa3a-f3dcb86fdde3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:22.339491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6cbc8-d754-49dc-aa3a-f3dcb86fdde3 None admin] RBAC: Adding query filter params (role.id=b670784e829b4bffb77b03422132634a, user.id=d76fe557c8fa452688eff40a7f9b634f, scope.system=all) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:22.340031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6cbc8-d754-49dc-aa3a-f3dcb86fdde3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:22.341632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6cbc8-d754-49dc-aa3a-f3dcb86fdde3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:22.347328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 150/284] 10.222.0.64 () {56 vars in 1308 bytes} [Fri Jul 15 15:11:22 2022] GET /identity/v3/role_assignments?user.id=d76fe557c8fa452688eff40a7f9b634f&scope.system=all&role.id=b670784e829b4bffb77b03422132634a => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:22.348684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6cbc8-d754-49dc-aa3a-f3dcb86fdde3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:22.354287 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e800-f420-4b50-90ad-08f709a17d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:22.355348 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e800-f420-4b50-90ad-08f709a17d1d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:22.355843 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e800-f420-4b50-90ad-08f709a17d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:22.356332 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e800-f420-4b50-90ad-08f709a17d1d None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:22.357542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e800-f420-4b50-90ad-08f709a17d1d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:22.358563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e800-f420-4b50-90ad-08f709a17d1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:22.360677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e800-f420-4b50-90ad-08f709a17d1d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:22.373164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 135/285] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:22.383318 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e800-f420-4b50-90ad-08f709a17d1d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:22.533464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e800-f420-4b50-90ad-08f709a17d1d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:22.607634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29320224-54f1-4b2e-b76c-f8d83bc6d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:22.609865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29320224-54f1-4b2e-b76c-f8d83bc6d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:22.609865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29320224-54f1-4b2e-b76c-f8d83bc6d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:22.609865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29320224-54f1-4b2e-b76c-f8d83bc6d0b9 None admin] PATH_INFO: `/v3/users/8c7e90fcb7df4f60852559adfbf9eda3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:22.611556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29320224-54f1-4b2e-b76c-f8d83bc6d0b9 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7e90fcb7df4f60852559adfbf9eda3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:22.614316 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29320224-54f1-4b2e-b76c-f8d83bc6d0b9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:22.617372 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 136/286] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:22 2022] GET /identity/v3/users/8c7e90fcb7df4f60852559adfbf9eda3 => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:22.624695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29320224-54f1-4b2e-b76c-f8d83bc6d0b9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:22.638826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:22.651422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6cbc8-d754-49dc-aa3a-f3dcb86fdde3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:22.701773 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:22.732872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb622ae-f2cf-4fad-94d6-43b65cd2e311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:22.733817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb622ae-f2cf-4fad-94d6-43b65cd2e311 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:22.734110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb622ae-f2cf-4fad-94d6-43b65cd2e311 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:22.734394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb622ae-f2cf-4fad-94d6-43b65cd2e311 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:22.764522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb622ae-f2cf-4fad-94d6-43b65cd2e311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:22.769489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29320224-54f1-4b2e-b76c-f8d83bc6d0b9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-acb622ae-f2cf-4fad-94d6-43b65cd2e311 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:22.782513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:22.784247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:22.785914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 151/287] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:22.790848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb622ae-f2cf-4fad-94d6-43b65cd2e311 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:22.834678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aca4d-fd68-4398-a87e-11c6ab6e7e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:22.836812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aca4d-fd68-4398-a87e-11c6ab6e7e2c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:22.837519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aca4d-fd68-4398-a87e-11c6ab6e7e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:22.838240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aca4d-fd68-4398-a87e-11c6ab6e7e2c None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:22.840565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aca4d-fd68-4398-a87e-11c6ab6e7e2c None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:22.843656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aca4d-fd68-4398-a87e-11c6ab6e7e2c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:22.847770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 137/288] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:22 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:22.856090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aca4d-fd68-4398-a87e-11c6ab6e7e2c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:22.987466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb622ae-f2cf-4fad-94d6-43b65cd2e311 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:23.039111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aca4d-fd68-4398-a87e-11c6ab6e7e2c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:23.061235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:23.065818 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3411de1-e1da-4d36-bde5-75f56690e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:23.066546 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3411de1-e1da-4d36-bde5-75f56690e669 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:23.067030 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3411de1-e1da-4d36-bde5-75f56690e669 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:23.067835 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3411de1-e1da-4d36-bde5-75f56690e669 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:23.068229 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3411de1-e1da-4d36-bde5-75f56690e669 None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:23.068547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3411de1-e1da-4d36-bde5-75f56690e669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:23.069995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3411de1-e1da-4d36-bde5-75f56690e669 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:23.086394 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66ae77-1347-4efd-9c6d-9e68cdf0127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:23.087624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66ae77-1347-4efd-9c6d-9e68cdf0127b None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:23.089684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66ae77-1347-4efd-9c6d-9e68cdf0127b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:23.091132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66ae77-1347-4efd-9c6d-9e68cdf0127b None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f/users/8c7e90fcb7df4f60852559adfbf9eda3/roles/0af3acb37467488c9ef322c203b98fd9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:23.095044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 152/289] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:23.096654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66ae77-1347-4efd-9c6d-9e68cdf0127b None admin] RBAC: Authorizing `identity:create_grant(project_id=ffa8c33444b7494fbfbe8ad5eadb219f, user_id=8c7e90fcb7df4f60852559adfbf9eda3, role_id=0af3acb37467488c9ef322c203b98fd9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:23.100030 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66ae77-1347-4efd-9c6d-9e68cdf0127b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:23.102488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3411de1-e1da-4d36-bde5-75f56690e669 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:23.131372 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 138/290] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:11:22 2022] PUT /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f/users/8c7e90fcb7df4f60852559adfbf9eda3/roles/0af3acb37467488c9ef322c203b98fd9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:23.134874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:23.256263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3411de1-e1da-4d36-bde5-75f56690e669 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:23.337454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737993b-3fe1-4272-84e6-a0f44840e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:23.339286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737993b-3fe1-4272-84e6-a0f44840e545 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:23.340048 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737993b-3fe1-4272-84e6-a0f44840e545 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:23.340794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737993b-3fe1-4272-84e6-a0f44840e545 None admin] PATH_INFO: `/v3/users/bb809b979f4f40648f4a181e740186b9` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:23.343219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737993b-3fe1-4272-84e6-a0f44840e545 None admin] RBAC: Authorizing `identity:get_user(user_id=bb809b979f4f40648f4a181e740186b9)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:23.346323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737993b-3fe1-4272-84e6-a0f44840e545 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:23.350937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 153/291] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:23 2022] GET /identity/v3/users/bb809b979f4f40648f4a181e740186b9 => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:23.358768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66ae77-1347-4efd-9c6d-9e68cdf0127b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:23.516113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66ae77-1347-4efd-9c6d-9e68cdf0127b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:23.551700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fdd35-528b-4cba-8ca3-e3b449db57cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:23.552427 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fdd35-528b-4cba-8ca3-e3b449db57cd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:23.552710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fdd35-528b-4cba-8ca3-e3b449db57cd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:23.553032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fdd35-528b-4cba-8ca3-e3b449db57cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:23.623034 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:23.659148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fdd35-528b-4cba-8ca3-e3b449db57cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:23.661087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fdd35-528b-4cba-8ca3-e3b449db57cd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:23.817661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 139/292] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:23.824006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737993b-3fe1-4272-84e6-a0f44840e545 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:23.968734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:24.005346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737993b-3fe1-4272-84e6-a0f44840e545 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:24.063762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc5fdd-0c08-4894-a4ea-cfb74e3f08d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:24.064659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc5fdd-0c08-4894-a4ea-cfb74e3f08d3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:24.064947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc5fdd-0c08-4894-a4ea-cfb74e3f08d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:24.065256 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc5fdd-0c08-4894-a4ea-cfb74e3f08d3 None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:24.066505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc5fdd-0c08-4894-a4ea-cfb74e3f08d3 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:24.068530 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc5fdd-0c08-4894-a4ea-cfb74e3f08d3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:24.070486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 154/293] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:23 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:24.076552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fdd35-528b-4cba-8ca3-e3b449db57cd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:24.198136 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:24.211809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fdd35-528b-4cba-8ca3-e3b449db57cd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:24.248252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033c241-5d83-43de-b135-373d0c485732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:24.248840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033c241-5d83-43de-b135-373d0c485732 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:24.249161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033c241-5d83-43de-b135-373d0c485732 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:24.249448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033c241-5d83-43de-b135-373d0c485732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:24.250304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033c241-5d83-43de-b135-373d0c485732 None admin] RBAC: Adding query filter params (role.id=b670784e829b4bffb77b03422132634a, scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f, user.id=bb809b979f4f40648f4a181e740186b9) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:24.250622 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033c241-5d83-43de-b135-373d0c485732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:24.252355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033c241-5d83-43de-b135-373d0c485732 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:24.259716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 140/294] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:24 2022] GET /identity/v3/role_assignments?user.id=bb809b979f4f40648f4a181e740186b9&scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f&role.id=b670784e829b4bffb77b03422132634a => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:24.647141 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3df4ef-6ac6-4037-9a81-2e0ca5e8b0be None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:24.647464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3df4ef-6ac6-4037-9a81-2e0ca5e8b0be None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:24.647717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3df4ef-6ac6-4037-9a81-2e0ca5e8b0be None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:24.649376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 155/295] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:24.656045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a93466-6c6f-40f6-9d3c-8b4cc489c5b8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:24.656505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a93466-6c6f-40f6-9d3c-8b4cc489c5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:24.656604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a93466-6c6f-40f6-9d3c-8b4cc489c5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:24.677128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a1a93466-6c6f-40f6-9d3c-8b4cc489c5b8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:24.678352 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a1a93466-6c6f-40f6-9d3c-8b4cc489c5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:24.746821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56164ff0-86a1-4720-b6e5-2cf23fe599d5 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:24.747252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56164ff0-86a1-4720-b6e5-2cf23fe599d5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:24.747659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56164ff0-86a1-4720-b6e5-2cf23fe599d5 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:24.750084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 156/296] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:24.760545 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6371c3-cb72-4aa7-9998-d22f1e2e62ef None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:24.761040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6371c3-cb72-4aa7-9998-d22f1e2e62ef None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:24.761561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6371c3-cb72-4aa7-9998-d22f1e2e62ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:24.761888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 141/297] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:24.784443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6e6371c3-cb72-4aa7-9998-d22f1e2e62ef None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:24.786225 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6e6371c3-cb72-4aa7-9998-d22f1e2e62ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:24.786585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a93466-6c6f-40f6-9d3c-8b4cc489c5b8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:24.867920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 157/298] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:24.889468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:24.898215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6371c3-cb72-4aa7-9998-d22f1e2e62ef None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:24.927617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a93466-6c6f-40f6-9d3c-8b4cc489c5b8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:24.971715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a6bfe-88cb-43d0-b6f1-15ed2d037184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:24.972591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a6bfe-88cb-43d0-b6f1-15ed2d037184 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:24.972882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a6bfe-88cb-43d0-b6f1-15ed2d037184 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:24.973218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a6bfe-88cb-43d0-b6f1-15ed2d037184 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:24.974902 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a6bfe-88cb-43d0-b6f1-15ed2d037184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:24.976818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a6bfe-88cb-43d0-b6f1-15ed2d037184 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:24.979331 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 142/299] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:24.986014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a6bfe-88cb-43d0-b6f1-15ed2d037184 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:25.000836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:25.022937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6371c3-cb72-4aa7-9998-d22f1e2e62ef None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:25.060276 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74475cf-2dda-4d4b-acd0-431707ce73e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:25.061478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74475cf-2dda-4d4b-acd0-431707ce73e1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:25.062006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74475cf-2dda-4d4b-acd0-431707ce73e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:25.062503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74475cf-2dda-4d4b-acd0-431707ce73e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:25.076895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74475cf-2dda-4d4b-acd0-431707ce73e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-f74475cf-2dda-4d4b-acd0-431707ce73e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:25.085667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:25.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:25.087353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:25.087353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:25.087353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:25.087353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:25.087353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:25.087353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:25.087353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:25.087353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:25.087353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:25.087353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:25.087353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:25.087353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:25.089942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 158/300] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:25.094972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a6bfe-88cb-43d0-b6f1-15ed2d037184 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:25.096213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74475cf-2dda-4d4b-acd0-431707ce73e1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:25.130977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a54b9-5995-4040-8d46-94639dfe99c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:25.131589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a54b9-5995-4040-8d46-94639dfe99c7 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:25.131873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a54b9-5995-4040-8d46-94639dfe99c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:25.132153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a54b9-5995-4040-8d46-94639dfe99c7 None admin] PATH_INFO: `/v3/groups` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:25.132893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a54b9-5995-4040-8d46-94639dfe99c7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:25.134981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a54b9-5995-4040-8d46-94639dfe99c7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:25.146617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:25.162261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 143/301] 10.222.0.64 () {60 vars in 1134 bytes} [Fri Jul 15 15:11:24 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:11:25.164255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072fae8-6b29-4817-9362-66951b70c3e9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:25.164703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072fae8-6b29-4817-9362-66951b70c3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:25.165337 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072fae8-6b29-4817-9362-66951b70c3e9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:25.171471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 144/302] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:25.173176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5f90-f277-4321-9e7e-ebcddf51004b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:25.173620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5f90-f277-4321-9e7e-ebcddf51004b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:25.174078 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5f90-f277-4321-9e7e-ebcddf51004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:25.191757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-aefb5f90-f277-4321-9e7e-ebcddf51004b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:25.193036 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-aefb5f90-f277-4321-9e7e-ebcddf51004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:25.222843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74475cf-2dda-4d4b-acd0-431707ce73e1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:25.266394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ba2f0-c289-40c5-89d6-e6ca530feff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:25.267425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ba2f0-c289-40c5-89d6-e6ca530feff1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:25.267949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ba2f0-c289-40c5-89d6-e6ca530feff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:25.268413 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ba2f0-c289-40c5-89d6-e6ca530feff1 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:25.269570 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ba2f0-c289-40c5-89d6-e6ca530feff1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:25.270569 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ba2f0-c289-40c5-89d6-e6ca530feff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:25.272225 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ba2f0-c289-40c5-89d6-e6ca530feff1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:25.282938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 159/303] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:25.288802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ba2f0-c289-40c5-89d6-e6ca530feff1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:25.293706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:25.294292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 145/304] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:25.324941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb5f90-f277-4321-9e7e-ebcddf51004b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:25.434851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ba2f0-c289-40c5-89d6-e6ca530feff1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:25.474738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb5f90-f277-4321-9e7e-ebcddf51004b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:25.482226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d58849-c3ed-4685-b390-164b9fba8d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:25.484000 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d58849-c3ed-4685-b390-164b9fba8d71 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:25.484527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d58849-c3ed-4685-b390-164b9fba8d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:25.485483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d58849-c3ed-4685-b390-164b9fba8d71 None admin] PATH_INFO: `/v3/users/ac8d439b1ecb44a28a7352415d6fa6a6` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:25.508335 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:25.511061 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d58849-c3ed-4685-b390-164b9fba8d71 None admin] RBAC: Authorizing `identity:get_user(user_id=ac8d439b1ecb44a28a7352415d6fa6a6)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:25.514459 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d58849-c3ed-4685-b390-164b9fba8d71 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:25.517221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 160/305] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:25 2022] GET /identity/v3/users/ac8d439b1ecb44a28a7352415d6fa6a6 => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:25.523402 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d58849-c3ed-4685-b390-164b9fba8d71 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:25.523974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2b5f4-8c79-4e7e-bcaf-b16419f6f64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:25.524967 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2b5f4-8c79-4e7e-bcaf-b16419f6f64b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:25.525307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2b5f4-8c79-4e7e-bcaf-b16419f6f64b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:25.525585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2b5f4-8c79-4e7e-bcaf-b16419f6f64b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:25.537953 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2b5f4-8c79-4e7e-bcaf-b16419f6f64b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-48a2b5f4-8c79-4e7e-bcaf-b16419f6f64b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:25.546676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:25.547625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:25.548405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 146/306] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:25.554923 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2b5f4-8c79-4e7e-bcaf-b16419f6f64b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:25.625329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:25.682224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d58849-c3ed-4685-b390-164b9fba8d71 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:25.725659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2e82e-b56b-4e94-972b-c6a14c71cc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:25.726670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2e82e-b56b-4e94-972b-c6a14c71cc64 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:25.727182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2e82e-b56b-4e94-972b-c6a14c71cc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:25.727621 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2e82e-b56b-4e94-972b-c6a14c71cc64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:25.728323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2b5f4-8c79-4e7e-bcaf-b16419f6f64b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:25.728957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2e82e-b56b-4e94-972b-c6a14c71cc64 None admin] RBAC: Adding query filter params (role.id=0af3acb37467488c9ef322c203b98fd9, user.id=ac8d439b1ecb44a28a7352415d6fa6a6, scope.system=all) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:25.729364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2e82e-b56b-4e94-972b-c6a14c71cc64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:25.731184 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2e82e-b56b-4e94-972b-c6a14c71cc64 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:25.738976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 161/307] 10.222.0.64 () {56 vars in 1308 bytes} [Fri Jul 15 15:11:25 2022] GET /identity/v3/role_assignments?user.id=ac8d439b1ecb44a28a7352415d6fa6a6&scope.system=all&role.id=0af3acb37467488c9ef322c203b98fd9 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:25.775727 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aae31-e54a-44ba-b5b2-debf871593f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:25.776845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aae31-e54a-44ba-b5b2-debf871593f0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:25.777420 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aae31-e54a-44ba-b5b2-debf871593f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:25.777913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aae31-e54a-44ba-b5b2-debf871593f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:25.778959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3aae31-e54a-44ba-b5b2-debf871593f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:25.779494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3aae31-e54a-44ba-b5b2-debf871593f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:25.781362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3aae31-e54a-44ba-b5b2-debf871593f0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:25.792260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 147/308] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:25.798860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2e82e-b56b-4e94-972b-c6a14c71cc64 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:25.836920 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15fc3f-9250-4e87-b89c-50cead3ced87 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:25.837414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15fc3f-9250-4e87-b89c-50cead3ced87 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:25.837847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15fc3f-9250-4e87-b89c-50cead3ced87 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:25.846843 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 148/309] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:11:25.849830 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d12d9-916c-4804-b603-87ec5d957f2d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:25.850321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d12d9-916c-4804-b603-87ec5d957f2d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:25.850763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d12d9-916c-4804-b603-87ec5d957f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:25.874821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-867d12d9-916c-4804-b603-87ec5d957f2d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:25.877199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-867d12d9-916c-4804-b603-87ec5d957f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:25.948982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:25.979747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2e82e-b56b-4e94-972b-c6a14c71cc64 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:25.984386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 149/310] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:26.015491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d12d9-916c-4804-b603-87ec5d957f2d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:26.016286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:26.030373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474120a-fff4-4831-b333-522a9d8fab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:26.032049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474120a-fff4-4831-b333-522a9d8fab14 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:26.032881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474120a-fff4-4831-b333-522a9d8fab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:26.033446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474120a-fff4-4831-b333-522a9d8fab14 None admin] PATH_INFO: `/v3/users/d76fe557c8fa452688eff40a7f9b634f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:26.035943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474120a-fff4-4831-b333-522a9d8fab14 None admin] RBAC: Authorizing `identity:get_user(user_id=d76fe557c8fa452688eff40a7f9b634f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:26.038179 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474120a-fff4-4831-b333-522a9d8fab14 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:26.040886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 162/311] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:25 2022] GET /identity/v3/users/d76fe557c8fa452688eff40a7f9b634f => generated 293 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:26.057099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474120a-fff4-4831-b333-522a9d8fab14 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:26.157885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d12d9-916c-4804-b603-87ec5d957f2d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:26.201713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a90f-cd23-4419-9bac-8743b6807ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:26.202650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a90f-cd23-4419-9bac-8743b6807ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:26.203009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a90f-cd23-4419-9bac-8743b6807ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:26.203356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a90f-cd23-4419-9bac-8743b6807ea0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:26.207135 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474120a-fff4-4831-b333-522a9d8fab14 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:26.218038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780a90f-cd23-4419-9bac-8743b6807ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8780a90f-cd23-4419-9bac-8743b6807ea0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:26.227688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:26.228725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:26.229815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 150/312] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:26.241927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a90f-cd23-4419-9bac-8743b6807ea0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:26.257238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11245c8d-660c-42af-8370-fb50eec341de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:26.259265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11245c8d-660c-42af-8370-fb50eec341de None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:26.259901 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11245c8d-660c-42af-8370-fb50eec341de None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:26.260626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11245c8d-660c-42af-8370-fb50eec341de None admin] PATH_INFO: `/v3/system/users/d76fe557c8fa452688eff40a7f9b634f/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:26.264196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11245c8d-660c-42af-8370-fb50eec341de None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d76fe557c8fa452688eff40a7f9b634f, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:26.265712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11245c8d-660c-42af-8370-fb50eec341de None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:26.281183 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 163/313] 10.222.0.64 () {58 vars in 1334 bytes} [Fri Jul 15 15:11:26 2022] PUT /identity/v3/system/users/d76fe557c8fa452688eff40a7f9b634f/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:26.311858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:26.421430 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a90f-cd23-4419-9bac-8743b6807ea0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:26.486930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff750eb-6c97-49ab-925b-8519c2688cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:26.488381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff750eb-6c97-49ab-925b-8519c2688cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:26.489151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff750eb-6c97-49ab-925b-8519c2688cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:26.489879 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff750eb-6c97-49ab-925b-8519c2688cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:26.491276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff750eb-6c97-49ab-925b-8519c2688cb8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:26.491757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff750eb-6c97-49ab-925b-8519c2688cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:26.493386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff750eb-6c97-49ab-925b-8519c2688cb8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:26.508449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 151/314] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:26.510185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11245c8d-660c-42af-8370-fb50eec341de None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:26.603088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:26.654056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11245c8d-660c-42af-8370-fb50eec341de None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:26.690749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f70246-b060-41d2-aa87-978b5c8819f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:26.691710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f70246-b060-41d2-aa87-978b5c8819f2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:26.691998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f70246-b060-41d2-aa87-978b5c8819f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:26.692278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f70246-b060-41d2-aa87-978b5c8819f2 None admin] PATH_INFO: `/v3/users/8c7e90fcb7df4f60852559adfbf9eda3` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:26.693660 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f70246-b060-41d2-aa87-978b5c8819f2 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7e90fcb7df4f60852559adfbf9eda3)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:26.695293 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f70246-b060-41d2-aa87-978b5c8819f2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:26.697365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 164/315] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:26 2022] GET /identity/v3/users/8c7e90fcb7df4f60852559adfbf9eda3 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:26.706888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff750eb-6c97-49ab-925b-8519c2688cb8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:26.869810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff750eb-6c97-49ab-925b-8519c2688cb8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:26.871397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:26.908483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82793bc5-b0b9-457b-b5e9-69a95a54ad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:26.909197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793bc5-b0b9-457b-b5e9-69a95a54ad78 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:26.909489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793bc5-b0b9-457b-b5e9-69a95a54ad78 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:26.909767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793bc5-b0b9-457b-b5e9-69a95a54ad78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:26.982743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82793bc5-b0b9-457b-b5e9-69a95a54ad78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:26.984383 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82793bc5-b0b9-457b-b5e9-69a95a54ad78 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:27.112753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 152/316] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:27.123024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f70246-b060-41d2-aa87-978b5c8819f2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:27.250882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f70246-b060-41d2-aa87-978b5c8819f2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:27.288464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c1b8f-df79-4923-914b-8dcc83c3de4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:27.289440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c1b8f-df79-4923-914b-8dcc83c3de4b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:27.289964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c1b8f-df79-4923-914b-8dcc83c3de4b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:27.290247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c1b8f-df79-4923-914b-8dcc83c3de4b None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:27.291550 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c1b8f-df79-4923-914b-8dcc83c3de4b None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:27.293222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c1b8f-df79-4923-914b-8dcc83c3de4b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:27.295162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:27.295422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 165/317] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:27 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:27.306229 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82793bc5-b0b9-457b-b5e9-69a95a54ad78 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:27.311666 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:27.422406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82793bc5-b0b9-457b-b5e9-69a95a54ad78 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:27.459478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9057c3-8bbd-4eab-bdb9-1486f28f24de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:27.460151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9057c3-8bbd-4eab-bdb9-1486f28f24de None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:27.460436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9057c3-8bbd-4eab-bdb9-1486f28f24de None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:27.460715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9057c3-8bbd-4eab-bdb9-1486f28f24de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:27.461684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9057c3-8bbd-4eab-bdb9-1486f28f24de None admin] RBAC: Adding query filter params (role.id=0af3acb37467488c9ef322c203b98fd9, scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f, user.id=8c7e90fcb7df4f60852559adfbf9eda3) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:27.462004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9057c3-8bbd-4eab-bdb9-1486f28f24de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:27.463633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9057c3-8bbd-4eab-bdb9-1486f28f24de None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:27.471010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 153/318] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:27 2022] GET /identity/v3/role_assignments?user.id=8c7e90fcb7df4f60852559adfbf9eda3&scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f&role.id=0af3acb37467488c9ef322c203b98fd9 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:27.895054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e4519-ddd3-438f-98bb-e6dc5f451362 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:27.895458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e4519-ddd3-438f-98bb-e6dc5f451362 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:27.895638 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e4519-ddd3-438f-98bb-e6dc5f451362 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:27.897087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 166/319] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:27.902661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f2334-e9b5-459f-b9c0-91429614fd9c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:27.903230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f2334-e9b5-459f-b9c0-91429614fd9c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:27.903602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f2334-e9b5-459f-b9c0-91429614fd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:27.924590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-454f2334-e9b5-459f-b9c0-91429614fd9c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:27.925833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-454f2334-e9b5-459f-b9c0-91429614fd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:27.999980 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:28.017277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 154/320] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:28.042277 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e4519-ddd3-438f-98bb-e6dc5f451362 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:28.169210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e4519-ddd3-438f-98bb-e6dc5f451362 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:28.206034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648d447-5658-40dd-96b9-b4b506f38a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:28.206847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648d447-5658-40dd-96b9-b4b506f38a16 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:28.207135 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648d447-5658-40dd-96b9-b4b506f38a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:28.207958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648d447-5658-40dd-96b9-b4b506f38a16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:28.209195 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648d447-5658-40dd-96b9-b4b506f38a16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:28.210661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648d447-5658-40dd-96b9-b4b506f38a16 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:28.212527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 167/321] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:28.217955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f2334-e9b5-459f-b9c0-91429614fd9c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:28.267533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09cfb-a9ab-4b1b-bda1-ca60a8c816b4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:28.267823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09cfb-a9ab-4b1b-bda1-ca60a8c816b4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:28.268137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09cfb-a9ab-4b1b-bda1-ca60a8c816b4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:28.270212 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 168/322] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:28.276243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d7b2-0b32-4f68-b116-7f9d30d75051 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:28.276797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d7b2-0b32-4f68-b116-7f9d30d75051 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:28.277100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d7b2-0b32-4f68-b116-7f9d30d75051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:28.296062 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9131d7b2-0b32-4f68-b116-7f9d30d75051 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:28.298299 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9131d7b2-0b32-4f68-b116-7f9d30d75051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:28.353484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f2334-e9b5-459f-b9c0-91429614fd9c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:28.396338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:28.398193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb178dd-a1bc-4f40-b135-2b959a6d1804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:28.398943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb178dd-a1bc-4f40-b135-2b959a6d1804 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:28.399232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb178dd-a1bc-4f40-b135-2b959a6d1804 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:28.399515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb178dd-a1bc-4f40-b135-2b959a6d1804 None admin] PATH_INFO: `/v3/groups` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:28.400225 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb178dd-a1bc-4f40-b135-2b959a6d1804 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:28.406173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb178dd-a1bc-4f40-b135-2b959a6d1804 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:28.412266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 169/323] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:28.422668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 155/324] 10.222.0.64 () {60 vars in 1134 bytes} [Fri Jul 15 15:11:28 2022] POST /identity/v3/groups => generated 226 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:11:28.435284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d7b2-0b32-4f68-b116-7f9d30d75051 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:28.550542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d7b2-0b32-4f68-b116-7f9d30d75051 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:28.590581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78a2e8-116b-494e-8ac9-b9800e3dbc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:28.591398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78a2e8-116b-494e-8ac9-b9800e3dbc34 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:28.591689 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78a2e8-116b-494e-8ac9-b9800e3dbc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:28.591972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78a2e8-116b-494e-8ac9-b9800e3dbc34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:28.607360 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78a2e8-116b-494e-8ac9-b9800e3dbc34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-6c78a2e8-116b-494e-8ac9-b9800e3dbc34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:28.615505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:28.616424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:28.617267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 170/325] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:28.623491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb178dd-a1bc-4f40-b135-2b959a6d1804 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:28.698484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:28.757812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb178dd-a1bc-4f40-b135-2b959a6d1804 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:28.779128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf44b0-0822-4dee-af4d-44de2f5e9146 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:28.779599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf44b0-0822-4dee-af4d-44de2f5e9146 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:28.779883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf44b0-0822-4dee-af4d-44de2f5e9146 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:28.781557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 171/326] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:11:28.788770 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93beb0-7b79-4f8d-9a55-bfaf644b43e1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:28.789084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93beb0-7b79-4f8d-9a55-bfaf644b43e1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:28.789372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93beb0-7b79-4f8d-9a55-bfaf644b43e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:28.810174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966247a5-fa44-430b-8190-0b97d1bfd8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:28.810852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966247a5-fa44-430b-8190-0b97d1bfd8af None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:28.811135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966247a5-fa44-430b-8190-0b97d1bfd8af None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:28.811411 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966247a5-fa44-430b-8190-0b97d1bfd8af None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:28.811962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-cd93beb0-7b79-4f8d-9a55-bfaf644b43e1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:28.812171 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966247a5-fa44-430b-8190-0b97d1bfd8af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:28.812481 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966247a5-fa44-430b-8190-0b97d1bfd8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:28.813865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cd93beb0-7b79-4f8d-9a55-bfaf644b43e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:28.813973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966247a5-fa44-430b-8190-0b97d1bfd8af None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:28.823640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 156/327] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:28.829950 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966247a5-fa44-430b-8190-0b97d1bfd8af None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:28.877229 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:28.914031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 172/328] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:28.936901 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93beb0-7b79-4f8d-9a55-bfaf644b43e1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:28.979850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966247a5-fa44-430b-8190-0b97d1bfd8af None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:29.003277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:29.029178 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48140b-ef17-4de9-876c-7851b3a5c18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:29.030941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48140b-ef17-4de9-876c-7851b3a5c18f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:29.031230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48140b-ef17-4de9-876c-7851b3a5c18f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:29.031511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48140b-ef17-4de9-876c-7851b3a5c18f None admin] PATH_INFO: `/v3/users/ac8d439b1ecb44a28a7352415d6fa6a6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:29.032810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48140b-ef17-4de9-876c-7851b3a5c18f None admin] RBAC: Authorizing `identity:get_user(user_id=ac8d439b1ecb44a28a7352415d6fa6a6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:29.034321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48140b-ef17-4de9-876c-7851b3a5c18f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:29.036884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 157/329] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:28 2022] GET /identity/v3/users/ac8d439b1ecb44a28a7352415d6fa6a6 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:29.044592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48140b-ef17-4de9-876c-7851b3a5c18f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:29.072769 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93beb0-7b79-4f8d-9a55-bfaf644b43e1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:29.120697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792c02c-ef62-4bea-b332-0cc5a028833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:29.121568 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c02c-ef62-4bea-b332-0cc5a028833c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:29.122399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c02c-ef62-4bea-b332-0cc5a028833c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:29.122696 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c02c-ef62-4bea-b332-0cc5a028833c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:29.140839 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792c02c-ef62-4bea-b332-0cc5a028833c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c792c02c-ef62-4bea-b332-0cc5a028833c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:29.155120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:29.156603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:29.158129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:29.158129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:29.158129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:29.158129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:29.158129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:29.158129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:29.158129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:29.158129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:29.158129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:29.158129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:29.158129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:29.158129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:29.159118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 173/330] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:29.166655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792c02c-ef62-4bea-b332-0cc5a028833c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:29.204158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48140b-ef17-4de9-876c-7851b3a5c18f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:29.251120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:29.271604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290901-3958-40f9-b012-42d2fb249bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:29.272832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290901-3958-40f9-b012-42d2fb249bea None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:29.273166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290901-3958-40f9-b012-42d2fb249bea None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:29.273455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290901-3958-40f9-b012-42d2fb249bea None admin] PATH_INFO: `/v3/system/users/ac8d439b1ecb44a28a7352415d6fa6a6/roles/0af3acb37467488c9ef322c203b98fd9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:29.275646 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31290901-3958-40f9-b012-42d2fb249bea None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ac8d439b1ecb44a28a7352415d6fa6a6, role_id=0af3acb37467488c9ef322c203b98fd9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:29.278790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31290901-3958-40f9-b012-42d2fb249bea None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:29.292274 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 158/331] 10.222.0.64 () {58 vars in 1334 bytes} [Fri Jul 15 15:11:29 2022] PUT /identity/v3/system/users/ac8d439b1ecb44a28a7352415d6fa6a6/roles/0af3acb37467488c9ef322c203b98fd9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:29.358662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792c02c-ef62-4bea-b332-0cc5a028833c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:29.404379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5124b-8d0e-45c3-a03b-aa4b8ba4bce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:29.405119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5124b-8d0e-45c3-a03b-aa4b8ba4bce9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:29.405554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5124b-8d0e-45c3-a03b-aa4b8ba4bce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:29.405790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5124b-8d0e-45c3-a03b-aa4b8ba4bce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:29.409107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5124b-8d0e-45c3-a03b-aa4b8ba4bce9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:29.409107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5124b-8d0e-45c3-a03b-aa4b8ba4bce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:29.409107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5124b-8d0e-45c3-a03b-aa4b8ba4bce9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:29.422645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 174/332] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:29.430434 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290901-3958-40f9-b012-42d2fb249bea None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:29.518638 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:29.601618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290901-3958-40f9-b012-42d2fb249bea None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:29.681213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78186972-82fc-4a8c-be0c-a19a328386aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:29.682783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78186972-82fc-4a8c-be0c-a19a328386aa None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:29.683318 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78186972-82fc-4a8c-be0c-a19a328386aa None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:29.683633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78186972-82fc-4a8c-be0c-a19a328386aa None admin] PATH_INFO: `/v3/users/d76fe557c8fa452688eff40a7f9b634f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:29.685470 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78186972-82fc-4a8c-be0c-a19a328386aa None admin] RBAC: Authorizing `identity:get_user(user_id=d76fe557c8fa452688eff40a7f9b634f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:29.688185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78186972-82fc-4a8c-be0c-a19a328386aa None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:29.691602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 159/333] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:29 2022] GET /identity/v3/users/d76fe557c8fa452688eff40a7f9b634f => generated 293 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:29.698037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5124b-8d0e-45c3-a03b-aa4b8ba4bce9 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:29.864131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5124b-8d0e-45c3-a03b-aa4b8ba4bce9 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:29.867801 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:29.912106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec1f13-0dd8-418e-a66b-4da00e4f88c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:29.913243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec1f13-0dd8-418e-a66b-4da00e4f88c8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:29.913729 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec1f13-0dd8-418e-a66b-4da00e4f88c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:29.914189 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec1f13-0dd8-418e-a66b-4da00e4f88c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:29.915227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec1f13-0dd8-418e-a66b-4da00e4f88c8 None admin] RBAC: Adding query filter params (role.id=b670784e829b4bffb77b03422132634a, user.id=d76fe557c8fa452688eff40a7f9b634f, scope.system=all) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:29.915725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec1f13-0dd8-418e-a66b-4da00e4f88c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:29.917430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec1f13-0dd8-418e-a66b-4da00e4f88c8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:29.937027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 175/334] 10.222.0.64 () {56 vars in 1308 bytes} [Fri Jul 15 15:11:29 2022] GET /identity/v3/role_assignments?user.id=d76fe557c8fa452688eff40a7f9b634f&scope.system=all&role.id=b670784e829b4bffb77b03422132634a => generated 510 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:31.956077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424383ed-c06c-4576-895f-cc09e75b9efa None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:31.957547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424383ed-c06c-4576-895f-cc09e75b9efa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:31.958012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424383ed-c06c-4576-895f-cc09e75b9efa None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:31.959905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 160/335] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:31.975621 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3d7f3-871c-481b-9d4c-de040a75fbe8 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:31.976522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3d7f3-871c-481b-9d4c-de040a75fbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:31.977009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3d7f3-871c-481b-9d4c-de040a75fbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:32.011861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-85a3d7f3-871c-481b-9d4c-de040a75fbe8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:32.013567 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-85a3d7f3-871c-481b-9d4c-de040a75fbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:32.115530 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 176/336] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:32.174676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424383ed-c06c-4576-895f-cc09e75b9efa None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:32.291605 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424383ed-c06c-4576-895f-cc09e75b9efa None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:32.310787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebe19a-0186-4403-89d7-7900f7f50ff9 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:32.311121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebe19a-0186-4403-89d7-7900f7f50ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:32.311706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebe19a-0186-4403-89d7-7900f7f50ff9 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:32.313726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 177/337] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:32.322512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f9232-49c3-43ce-ae92-2943de429010 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:32.322807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f9232-49c3-43ce-ae92-2943de429010 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:32.323091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f9232-49c3-43ce-ae92-2943de429010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:32.326025 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:32.356365 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016088d0-0a76-4539-9f94-35b54d102add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:32.356963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-691f9232-49c3-43ce-ae92-2943de429010 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:32.357214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016088d0-0a76-4539-9f94-35b54d102add None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:32.357479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016088d0-0a76-4539-9f94-35b54d102add None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:32.357761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016088d0-0a76-4539-9f94-35b54d102add None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:32.359045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-691f9232-49c3-43ce-ae92-2943de429010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:32.374364 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016088d0-0a76-4539-9f94-35b54d102add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-016088d0-0a76-4539-9f94-35b54d102add None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:32.385720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:32.386793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:32.387588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:32.387588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:32.387588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:32.387588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:32.387588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:32.387588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:32.387588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:32.387588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:32.387588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:32.387588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:32.387588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:32.387588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:32.391125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 161/338] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:32.403180 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016088d0-0a76-4539-9f94-35b54d102add None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:32.502515 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 178/339] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:32.558472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f9232-49c3-43ce-ae92-2943de429010 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:32.619877 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016088d0-0a76-4539-9f94-35b54d102add None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:32.633448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:32.687187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa22472-7ba0-492b-9d16-ad45733d1756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:32.687892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa22472-7ba0-492b-9d16-ad45733d1756 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:32.688211 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa22472-7ba0-492b-9d16-ad45733d1756 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:32.688513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa22472-7ba0-492b-9d16-ad45733d1756 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:32.690820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa22472-7ba0-492b-9d16-ad45733d1756 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:32.691135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa22472-7ba0-492b-9d16-ad45733d1756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:32.694092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa22472-7ba0-492b-9d16-ad45733d1756 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:32.706768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 162/340] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:32.712224 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed668c-98cc-4820-9b98-cc862a9db421 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:32.712724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed668c-98cc-4820-9b98-cc862a9db421 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:32.713200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed668c-98cc-4820-9b98-cc862a9db421 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:32.715253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 163/341] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:32.719067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed668c-98cc-4820-9b98-cc862a9db421 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:32.781361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:32.882244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f9232-49c3-43ce-ae92-2943de429010 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:32.899417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed668c-98cc-4820-9b98-cc862a9db421 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:32.941487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b26569-a433-4f35-9452-2a899975b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:32.942326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b26569-a433-4f35-9452-2a899975b0bb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:32.942607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b26569-a433-4f35-9452-2a899975b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:32.942942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b26569-a433-4f35-9452-2a899975b0bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:32.964395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b26569-a433-4f35-9452-2a899975b0bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:32.975763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc90a8c-b19d-4173-b787-a17effc2d6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:32.976486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc90a8c-b19d-4173-b787-a17effc2d6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:32.976772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc90a8c-b19d-4173-b787-a17effc2d6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:32.977047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc90a8c-b19d-4173-b787-a17effc2d6f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-94b26569-a433-4f35-9452-2a899975b0bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:32.979947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:32.981131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:32.981918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:32.981918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:32.981918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:32.981918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:32.981918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:32.981918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:32.981918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:32.981918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:32.981918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:32.981918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:32.981918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:32.981918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:32.989596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 179/342] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:11:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:32.991042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaf322-88d7-46be-b8ff-e509a8ba8a96 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:32.991331 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaf322-88d7-46be-b8ff-e509a8ba8a96 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:32.991608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaf322-88d7-46be-b8ff-e509a8ba8a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:33.025274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-92eaf322-88d7-46be-b8ff-e509a8ba8a96 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:33.028315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-92eaf322-88d7-46be-b8ff-e509a8ba8a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:33.095857 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc90a8c-b19d-4173-b787-a17effc2d6f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:33.098233 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc90a8c-b19d-4173-b787-a17effc2d6f5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:33.127871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 180/343] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:33.130155 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaf322-88d7-46be-b8ff-e509a8ba8a96 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:33.151160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:33.152216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:33.236146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 164/344] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 15:11:33.242891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854f071-9d89-45ab-a396-99c9bafca1c9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:33.243743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854f071-9d89-45ab-a396-99c9bafca1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:33.244253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854f071-9d89-45ab-a396-99c9bafca1c9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:33.246550 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 165/345] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:33.247585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854f071-9d89-45ab-a396-99c9bafca1c9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:33.311589 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaf322-88d7-46be-b8ff-e509a8ba8a96 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:33.364505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda88deb-9763-4a91-8390-b2380544e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:33.365614 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88deb-9763-4a91-8390-b2380544e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:33.366101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88deb-9763-4a91-8390-b2380544e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:33.366609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88deb-9763-4a91-8390-b2380544e1fe None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:33.367757 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda88deb-9763-4a91-8390-b2380544e1fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:33.368300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda88deb-9763-4a91-8390-b2380544e1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:33.369996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda88deb-9763-4a91-8390-b2380544e1fe None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:33.380443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 181/346] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:33.382683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda88deb-9763-4a91-8390-b2380544e1fe None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:33.384558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854f071-9d89-45ab-a396-99c9bafca1c9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:33.435647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f94af4-2045-4125-ba47-8315d6685048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:33.436388 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f94af4-2045-4125-ba47-8315d6685048 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:33.436659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f94af4-2045-4125-ba47-8315d6685048 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:33.436937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f94af4-2045-4125-ba47-8315d6685048 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:33.452271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:33.464650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f94af4-2045-4125-ba47-8315d6685048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e6f94af4-2045-4125-ba47-8315d6685048 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:33.469757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:33.471624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 166/347] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:33.474786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fa81c-a824-4ee6-a596-1b1ec36206dc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:33.476228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fa81c-a824-4ee6-a596-1b1ec36206dc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:33.476228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fa81c-a824-4ee6-a596-1b1ec36206dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:33.497128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8b2fa81c-a824-4ee6-a596-1b1ec36206dc None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:33.499443 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8b2fa81c-a824-4ee6-a596-1b1ec36206dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:33.527731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:33.570398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda88deb-9763-4a91-8390-b2380544e1fe None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:33.617514 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 167/348] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:33.618713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6d36c-6c71-4f3b-b9b3-2b99ca2576c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:33.619611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6d36c-6c71-4f3b-b9b3-2b99ca2576c3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:33.619933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6d36c-6c71-4f3b-b9b3-2b99ca2576c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:33.620186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6d36c-6c71-4f3b-b9b3-2b99ca2576c3 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:33.620301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80897e-8f67-44dd-8e78-f6df149e9ca4 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:33.620610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80897e-8f67-44dd-8e78-f6df149e9ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:33.621003 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80897e-8f67-44dd-8e78-f6df149e9ca4 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:33.621462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6d36c-6c71-4f3b-b9b3-2b99ca2576c3 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:33.622945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 168/349] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:33.623095 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6d36c-6c71-4f3b-b9b3-2b99ca2576c3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:33.627953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 182/350] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:33 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:33.627953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6d36c-6c71-4f3b-b9b3-2b99ca2576c3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:33.628225 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80897e-8f67-44dd-8e78-f6df149e9ca4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:33.758800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6d36c-6c71-4f3b-b9b3-2b99ca2576c3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:33.773565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80897e-8f67-44dd-8e78-f6df149e9ca4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:33.821483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad162d27-5b97-40b0-9949-5b1243b39f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:33.822270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad162d27-5b97-40b0-9949-5b1243b39f2f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:33.822573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad162d27-5b97-40b0-9949-5b1243b39f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:33.822858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad162d27-5b97-40b0-9949-5b1243b39f2f None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:33.823661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad162d27-5b97-40b0-9949-5b1243b39f2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:33.823981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad162d27-5b97-40b0-9949-5b1243b39f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:33.825453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad162d27-5b97-40b0-9949-5b1243b39f2f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:33.826376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:33.836308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa228e-415b-4a76-be0b-3c4561213425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:33.836999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa228e-415b-4a76-be0b-3c4561213425 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:33.837192 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 183/351] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:33.837401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa228e-415b-4a76-be0b-3c4561213425 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:33.837598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa228e-415b-4a76-be0b-3c4561213425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:33.838410 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b5429-e334-4ce9-9031-694a2c017394 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:33.838829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b5429-e334-4ce9-9031-694a2c017394 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:33.839119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b5429-e334-4ce9-9031-694a2c017394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:33.846445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:33.859724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f72b5429-e334-4ce9-9031-694a2c017394 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:33.860949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f72b5429-e334-4ce9-9031-694a2c017394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:33.948955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa228e-415b-4a76-be0b-3c4561213425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:33.950521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa228e-415b-4a76-be0b-3c4561213425 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:33.959781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 184/352] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:33.960581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b5429-e334-4ce9-9031-694a2c017394 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:34.092479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 169/353] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:34.093406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa228e-415b-4a76-be0b-3c4561213425 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:34.110743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b5429-e334-4ce9-9031-694a2c017394 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:34.140715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:34.157372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7498d46-c253-4c7c-b1ae-b382fe4d5d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:34.158536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7498d46-c253-4c7c-b1ae-b382fe4d5d9e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:34.159173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7498d46-c253-4c7c-b1ae-b382fe4d5d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:34.159573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7498d46-c253-4c7c-b1ae-b382fe4d5d9e None admin] PATH_INFO: `/v3/groups/eb7cd5266c4a4def9325ad9e705255fb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:34.163627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:34.171741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7498d46-c253-4c7c-b1ae-b382fe4d5d9e None admin] RBAC: Authorizing `identity:get_group(group_id=eb7cd5266c4a4def9325ad9e705255fb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:34.175243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7498d46-c253-4c7c-b1ae-b382fe4d5d9e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:34.175243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 185/354] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:33 2022] GET /identity/v3/groups/eb7cd5266c4a4def9325ad9e705255fb => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:34.175899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739be96-2b37-4fbb-bb5e-54ba94208609 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:34.176228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739be96-2b37-4fbb-bb5e-54ba94208609 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:34.176512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739be96-2b37-4fbb-bb5e-54ba94208609 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:34.179242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 186/355] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:34.179814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739be96-2b37-4fbb-bb5e-54ba94208609 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:34.246873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa228e-415b-4a76-be0b-3c4561213425 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:34.296497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b0bf9-e4cf-4250-9aa7-309a8a7f06e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:34.297346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b0bf9-e4cf-4250-9aa7-309a8a7f06e3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:34.297630 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b0bf9-e4cf-4250-9aa7-309a8a7f06e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:34.298239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b0bf9-e4cf-4250-9aa7-309a8a7f06e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:34.312121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b0bf9-e4cf-4250-9aa7-309a8a7f06e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e41b0bf9-e4cf-4250-9aa7-309a8a7f06e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:34.320645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:34.321612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:34.322888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 170/356] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:34.324217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b0bf9-e4cf-4250-9aa7-309a8a7f06e3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:34.335318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739be96-2b37-4fbb-bb5e-54ba94208609 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:34.382951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a5649-2058-4ea2-adfb-374bc88b6da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:34.383538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5649-2058-4ea2-adfb-374bc88b6da5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:34.383824 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5649-2058-4ea2-adfb-374bc88b6da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:34.384102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5649-2058-4ea2-adfb-374bc88b6da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:34.472325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:34.487073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b0bf9-e4cf-4250-9aa7-309a8a7f06e3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:34.494958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:34.500155 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a5649-2058-4ea2-adfb-374bc88b6da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:34.501809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a5649-2058-4ea2-adfb-374bc88b6da5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:34.552597 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9134-457f-4e00-b339-8109be3b6c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:34.553492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9134-457f-4e00-b339-8109be3b6c00 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:34.553907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9134-457f-4e00-b339-8109be3b6c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:34.554190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9134-457f-4e00-b339-8109be3b6c00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:34.569624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b9134-457f-4e00-b339-8109be3b6c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-094b9134-457f-4e00-b339-8109be3b6c00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:34.580105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:34.581080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 171/357] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:11:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:34.581940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9134-457f-4e00-b339-8109be3b6c00 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:34.674511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 187/358] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:34.675200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a5649-2058-4ea2-adfb-374bc88b6da5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:34.755448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9134-457f-4e00-b339-8109be3b6c00 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:34.801827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fc271-81ae-4396-b657-52967f7e7e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:34.802724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fc271-81ae-4396-b657-52967f7e7e9e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:34.803173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fc271-81ae-4396-b657-52967f7e7e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:34.803479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fc271-81ae-4396-b657-52967f7e7e9e None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:34.805946 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fc271-81ae-4396-b657-52967f7e7e9e None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:34.806898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fc271-81ae-4396-b657-52967f7e7e9e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:34.810520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 172/359] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:34 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:34.810520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d6bb-0bb2-4899-8ba4-d8cc79c1a974 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:34.810520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d6bb-0bb2-4899-8ba4-d8cc79c1a974 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:34.810832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d6bb-0bb2-4899-8ba4-d8cc79c1a974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:34.827595 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:34.833665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a5649-2058-4ea2-adfb-374bc88b6da5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:34.835035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a873d6bb-0bb2-4899-8ba4-d8cc79c1a974 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:34.836277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a873d6bb-0bb2-4899-8ba4-d8cc79c1a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:34.856210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:34.894139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1498ea7-0058-4df4-aa6a-fd4d97fb2a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:34.895377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1498ea7-0058-4df4-aa6a-fd4d97fb2a46 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:34.895377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1498ea7-0058-4df4-aa6a-fd4d97fb2a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:34.895578 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1498ea7-0058-4df4-aa6a-fd4d97fb2a46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:34.898519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1498ea7-0058-4df4-aa6a-fd4d97fb2a46 None admin] RBAC: Adding query filter params (group.id=eb7cd5266c4a4def9325ad9e705255fb, role.id=b670784e829b4bffb77b03422132634a, scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:34.898519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1498ea7-0058-4df4-aa6a-fd4d97fb2a46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:34.899104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1498ea7-0058-4df4-aa6a-fd4d97fb2a46 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:34.909298 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 188/360] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Jul 15 15:11:34 2022] GET /identity/v3/role_assignments?group.id=eb7cd5266c4a4def9325ad9e705255fb&scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a&role.id=b670784e829b4bffb77b03422132634a => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:34.909298 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1498ea7-0058-4df4-aa6a-fd4d97fb2a46 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:34.938240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 173/361] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:34.939176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873d6bb-0bb2-4899-8ba4-d8cc79c1a974 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:35.086603 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873d6bb-0bb2-4899-8ba4-d8cc79c1a974 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:35.093208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1498ea7-0058-4df4-aa6a-fd4d97fb2a46 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:35.142697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330602a1-3848-4786-a460-fcbc6bbcd588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:35.143554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330602a1-3848-4786-a460-fcbc6bbcd588 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:35.143664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330602a1-3848-4786-a460-fcbc6bbcd588 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:35.143931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330602a1-3848-4786-a460-fcbc6bbcd588 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:35.145464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcca9c1-393a-4f24-98f2-022cea12dc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:35.146052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330602a1-3848-4786-a460-fcbc6bbcd588 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:35.146052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330602a1-3848-4786-a460-fcbc6bbcd588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:35.146277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcca9c1-393a-4f24-98f2-022cea12dc19 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:35.146277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcca9c1-393a-4f24-98f2-022cea12dc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:35.146718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcca9c1-393a-4f24-98f2-022cea12dc19 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:35.148836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcca9c1-393a-4f24-98f2-022cea12dc19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:35.149048 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330602a1-3848-4786-a460-fcbc6bbcd588 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:35.149233 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcca9c1-393a-4f24-98f2-022cea12dc19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:35.150466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcca9c1-393a-4f24-98f2-022cea12dc19 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:35.164548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 189/362] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:35.164548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330602a1-3848-4786-a460-fcbc6bbcd588 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:35.166130 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 174/363] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:35.167331 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcca9c1-393a-4f24-98f2-022cea12dc19 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:35.188808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:35.205403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:35.318587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330602a1-3848-4786-a460-fcbc6bbcd588 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:35.324995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcca9c1-393a-4f24-98f2-022cea12dc19 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:35.360712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95384928-d59b-49a6-a822-6e9dbab6961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:35.362081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384928-d59b-49a6-a822-6e9dbab6961a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:35.362521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384928-d59b-49a6-a822-6e9dbab6961a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:35.362872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384928-d59b-49a6-a822-6e9dbab6961a None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:35.364932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95384928-d59b-49a6-a822-6e9dbab6961a None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:35.367411 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95384928-d59b-49a6-a822-6e9dbab6961a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:35.375530 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 190/364] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:35 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:35.375530 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95384928-d59b-49a6-a822-6e9dbab6961a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:35.377358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b58203-e910-4027-938b-5f6f1dd1712c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:35.378255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b58203-e910-4027-938b-5f6f1dd1712c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:35.378843 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b58203-e910-4027-938b-5f6f1dd1712c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:35.379204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b58203-e910-4027-938b-5f6f1dd1712c None admin] PATH_INFO: `/v3/groups/eb7cd5266c4a4def9325ad9e705255fb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:35.380832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b58203-e910-4027-938b-5f6f1dd1712c None admin] RBAC: Authorizing `identity:get_group(group_id=eb7cd5266c4a4def9325ad9e705255fb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:35.382545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b58203-e910-4027-938b-5f6f1dd1712c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:35.385147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 175/365] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:35 2022] GET /identity/v3/groups/eb7cd5266c4a4def9325ad9e705255fb => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:35.385147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b58203-e910-4027-938b-5f6f1dd1712c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:35.500322 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:35.514690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:35.527843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95384928-d59b-49a6-a822-6e9dbab6961a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:35.530384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b58203-e910-4027-938b-5f6f1dd1712c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:35.571406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e15fe3-e149-40e4-a9af-91f82da07aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:35.572234 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e15fe3-e149-40e4-a9af-91f82da07aba None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:35.572521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e15fe3-e149-40e4-a9af-91f82da07aba None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:35.572797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e15fe3-e149-40e4-a9af-91f82da07aba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:35.577802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e820a6d-5c81-4a23-bc04-da6fbfa71aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:35.578999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e820a6d-5c81-4a23-bc04-da6fbfa71aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:35.579491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e820a6d-5c81-4a23-bc04-da6fbfa71aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:35.580167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e820a6d-5c81-4a23-bc04-da6fbfa71aa5 None admin] PATH_INFO: `/v3/users/ac8d439b1ecb44a28a7352415d6fa6a6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:35.582814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e820a6d-5c81-4a23-bc04-da6fbfa71aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=ac8d439b1ecb44a28a7352415d6fa6a6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:35.583395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e820a6d-5c81-4a23-bc04-da6fbfa71aa5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:35.587202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 176/366] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:11:35 2022] GET /identity/v3/users/ac8d439b1ecb44a28a7352415d6fa6a6 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:35.587202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e820a6d-5c81-4a23-bc04-da6fbfa71aa5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:35.600227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e15fe3-e149-40e4-a9af-91f82da07aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-93e15fe3-e149-40e4-a9af-91f82da07aba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:35.603398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:35.605016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 191/367] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:11:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:35.606611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e15fe3-e149-40e4-a9af-91f82da07aba None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:35.744218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e820a6d-5c81-4a23-bc04-da6fbfa71aa5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:35.757224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e15fe3-e149-40e4-a9af-91f82da07aba None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:35.792657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb9dbb-2012-4801-8328-424ab188551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:35.793894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb9dbb-2012-4801-8328-424ab188551c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:35.794325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb9dbb-2012-4801-8328-424ab188551c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:35.794747 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb9dbb-2012-4801-8328-424ab188551c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:35.811370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85094e-463c-4bc6-b3eb-96379f8f340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:35.812282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85094e-463c-4bc6-b3eb-96379f8f340c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:35.812690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85094e-463c-4bc6-b3eb-96379f8f340c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:35.812975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85094e-463c-4bc6-b3eb-96379f8f340c None admin] PATH_INFO: `/v3/groups/eb7cd5266c4a4def9325ad9e705255fb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:35.814244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85094e-463c-4bc6-b3eb-96379f8f340c None admin] RBAC: Authorizing `identity:get_group(group_id=eb7cd5266c4a4def9325ad9e705255fb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:35.815760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85094e-463c-4bc6-b3eb-96379f8f340c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:35.823388 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 192/368] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:35 2022] GET /identity/v3/groups/eb7cd5266c4a4def9325ad9e705255fb => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:35.823388 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85094e-463c-4bc6-b3eb-96379f8f340c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:35.830145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:35.858436 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:35.911687 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb9dbb-2012-4801-8328-424ab188551c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:35.917957 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb9dbb-2012-4801-8328-424ab188551c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:35.991433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85094e-463c-4bc6-b3eb-96379f8f340c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:36.031950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67f4c7-91ea-4602-9ba2-ae8c20689c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:36.032636 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67f4c7-91ea-4602-9ba2-ae8c20689c35 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:36.032928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67f4c7-91ea-4602-9ba2-ae8c20689c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:36.033271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67f4c7-91ea-4602-9ba2-ae8c20689c35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:36.034131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67f4c7-91ea-4602-9ba2-ae8c20689c35 None admin] RBAC: Adding query filter params (group.id=eb7cd5266c4a4def9325ad9e705255fb, role.id=f5fb67c95c834bc9b359a5141ae0f60c, scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:36.034448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67f4c7-91ea-4602-9ba2-ae8c20689c35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:36.036475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67f4c7-91ea-4602-9ba2-ae8c20689c35 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:36.043457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 193/369] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Jul 15 15:11:35 2022] GET /identity/v3/role_assignments?group.id=eb7cd5266c4a4def9325ad9e705255fb&scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a&role.id=f5fb67c95c834bc9b359a5141ae0f60c => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:36.065099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67f4c7-91ea-4602-9ba2-ae8c20689c35 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:36.071884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 177/370] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:36.073648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb9dbb-2012-4801-8328-424ab188551c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:36.132446 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:36.187917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:36.201814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb9dbb-2012-4801-8328-424ab188551c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:36.208787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67f4c7-91ea-4602-9ba2-ae8c20689c35 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:36.246731 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff701502-7856-4bb0-9fd0-947b298012a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:36.248757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701502-7856-4bb0-9fd0-947b298012a0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:36.248757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701502-7856-4bb0-9fd0-947b298012a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:36.248757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701502-7856-4bb0-9fd0-947b298012a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:36.249594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff701502-7856-4bb0-9fd0-947b298012a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:36.249700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff701502-7856-4bb0-9fd0-947b298012a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:36.253343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff701502-7856-4bb0-9fd0-947b298012a0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:36.259808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd7ea4-b1ca-4ed2-af59-ccaf940fca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:36.260609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd7ea4-b1ca-4ed2-af59-ccaf940fca84 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:36.260967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd7ea4-b1ca-4ed2-af59-ccaf940fca84 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:36.261358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd7ea4-b1ca-4ed2-af59-ccaf940fca84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:36.262350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd7ea4-b1ca-4ed2-af59-ccaf940fca84 None admin] RBAC: Adding query filter params (role.id=0af3acb37467488c9ef322c203b98fd9, user.id=ac8d439b1ecb44a28a7352415d6fa6a6, scope.system=all) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:36.262984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd7ea4-b1ca-4ed2-af59-ccaf940fca84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:36.265485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd7ea4-b1ca-4ed2-af59-ccaf940fca84 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:36.266183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 178/371] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:36.270435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff701502-7856-4bb0-9fd0-947b298012a0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:36.294691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 194/372] 10.222.0.64 () {56 vars in 1308 bytes} [Fri Jul 15 15:11:36 2022] GET /identity/v3/role_assignments?user.id=ac8d439b1ecb44a28a7352415d6fa6a6&scope.system=all&role.id=0af3acb37467488c9ef322c203b98fd9 => generated 510 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:36.296172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd7ea4-b1ca-4ed2-af59-ccaf940fca84 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:36.506807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff701502-7856-4bb0-9fd0-947b298012a0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:36.524917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:36.530032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd7ea4-b1ca-4ed2-af59-ccaf940fca84 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:36.567127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fc26a-92bb-4f22-9f2a-b7844ce8530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:36.567725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fc26a-92bb-4f22-9f2a-b7844ce8530b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:36.568034 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fc26a-92bb-4f22-9f2a-b7844ce8530b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:36.568316 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fc26a-92bb-4f22-9f2a-b7844ce8530b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:36.569465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fc26a-92bb-4f22-9f2a-b7844ce8530b None admin] RBAC: Adding query filter params (group.id=eb7cd5266c4a4def9325ad9e705255fb, role.id=b670784e829b4bffb77b03422132634a, scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:36.569778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fc26a-92bb-4f22-9f2a-b7844ce8530b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:36.572106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fc26a-92bb-4f22-9f2a-b7844ce8530b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:36.580892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 179/373] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Jul 15 15:11:36 2022] GET /identity/v3/role_assignments?group.id=eb7cd5266c4a4def9325ad9e705255fb&scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f&role.id=b670784e829b4bffb77b03422132634a => generated 260 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:36.582542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fc26a-92bb-4f22-9f2a-b7844ce8530b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:36.591081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba87ab-6fbf-4a11-a6dc-bcce06179edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:36.592463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba87ab-6fbf-4a11-a6dc-bcce06179edb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:36.593260 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba87ab-6fbf-4a11-a6dc-bcce06179edb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:36.593715 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba87ab-6fbf-4a11-a6dc-bcce06179edb None admin] PATH_INFO: `/v3/projects/71c3490c70ac4566897a6b15fddccf92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:36.598788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba87ab-6fbf-4a11-a6dc-bcce06179edb None admin] RBAC: Authorizing `identity:get_project(project_id=71c3490c70ac4566897a6b15fddccf92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:36.604750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba87ab-6fbf-4a11-a6dc-bcce06179edb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:36.606945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 195/374] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:36 2022] GET /identity/v3/projects/71c3490c70ac4566897a6b15fddccf92 => generated 344 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:36.613330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba87ab-6fbf-4a11-a6dc-bcce06179edb None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:36.630597 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:36.765184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fc26a-92bb-4f22-9f2a-b7844ce8530b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:36.817680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba87ab-6fbf-4a11-a6dc-bcce06179edb None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:36.818215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8d53c-e64b-40e1-8220-caec99504399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:36.819232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8d53c-e64b-40e1-8220-caec99504399 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:36.819750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8d53c-e64b-40e1-8220-caec99504399 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:36.820339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8d53c-e64b-40e1-8220-caec99504399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:36.872902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acfd44-4a63-47d5-a81c-729cba2e9a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:36.873848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acfd44-4a63-47d5-a81c-729cba2e9a36 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:36.874138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acfd44-4a63-47d5-a81c-729cba2e9a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:36.874422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acfd44-4a63-47d5-a81c-729cba2e9a36 None admin] PATH_INFO: `/v3/groups/cfe327c3c3b744f0b28f999c7231303a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:36.886945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:36.889852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acfd44-4a63-47d5-a81c-729cba2e9a36 None admin] RBAC: Authorizing `identity:get_group(group_id=cfe327c3c3b744f0b28f999c7231303a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:36.891408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acfd44-4a63-47d5-a81c-729cba2e9a36 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:36.893564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 196/375] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:36 2022] GET /identity/v3/groups/cfe327c3c3b744f0b28f999c7231303a => generated 229 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:36.899302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acfd44-4a63-47d5-a81c-729cba2e9a36 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:36.940218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8d53c-e64b-40e1-8220-caec99504399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:36.942677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8d53c-e64b-40e1-8220-caec99504399 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:37.060668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:37.122549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acfd44-4a63-47d5-a81c-729cba2e9a36 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:37.172929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 180/376] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:37.179160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8d53c-e64b-40e1-8220-caec99504399 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:37.210207 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd3eb3-7aa3-4c14-879a-a8a35277d001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:37.214786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3eb3-7aa3-4c14-879a-a8a35277d001 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:37.215799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3eb3-7aa3-4c14-879a-a8a35277d001 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:37.216668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3eb3-7aa3-4c14-879a-a8a35277d001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:37.219118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd3eb3-7aa3-4c14-879a-a8a35277d001 None admin] RBAC: Adding query filter params (group.id=cfe327c3c3b744f0b28f999c7231303a, role.id=87593f63c4744eac870c07b006022e77, scope.project.id=71c3490c70ac4566897a6b15fddccf92) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:37.219709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd3eb3-7aa3-4c14-879a-a8a35277d001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:37.221764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd3eb3-7aa3-4c14-879a-a8a35277d001 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:37.238015 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 197/377] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Jul 15 15:11:36 2022] GET /identity/v3/role_assignments?group.id=cfe327c3c3b744f0b28f999c7231303a&scope.project.id=71c3490c70ac4566897a6b15fddccf92&role.id=87593f63c4744eac870c07b006022e77 => generated 260 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:37.313772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:37.355707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8d53c-e64b-40e1-8220-caec99504399 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:37.383942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b483205-c09a-46a8-b588-bd46d7a00d7f None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:37.384551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b483205-c09a-46a8-b588-bd46d7a00d7f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:37.385042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b483205-c09a-46a8-b588-bd46d7a00d7f None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:37.386781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 198/378] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:37.392689 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86d93e-9e69-46e8-8580-8d5a0a44ab12 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:37.393021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86d93e-9e69-46e8-8580-8d5a0a44ab12 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:37.393342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86d93e-9e69-46e8-8580-8d5a0a44ab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:37.407054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4fa08-c250-4fda-ab86-a64e38d1a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:37.409198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4fa08-c250-4fda-ab86-a64e38d1a5da None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:37.409873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4fa08-c250-4fda-ab86-a64e38d1a5da None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:37.410367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4fa08-c250-4fda-ab86-a64e38d1a5da None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:37.412854 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4fa08-c250-4fda-ab86-a64e38d1a5da None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:37.415173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4fa08-c250-4fda-ab86-a64e38d1a5da None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:37.418243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 181/379] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:37 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:37.432522 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4fa08-c250-4fda-ab86-a64e38d1a5da None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:37.441822 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8d86d93e-9e69-46e8-8580-8d5a0a44ab12 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:37.446964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8d86d93e-9e69-46e8-8580-8d5a0a44ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:37.566664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 199/380] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:37.609912 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86d93e-9e69-46e8-8580-8d5a0a44ab12 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:37.684968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4fa08-c250-4fda-ab86-a64e38d1a5da None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:37.780250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:37.786284 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c22d7f-ff28-4b3f-a614-36731da4de33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:37.787477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c22d7f-ff28-4b3f-a614-36731da4de33 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:37.787966 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c22d7f-ff28-4b3f-a614-36731da4de33 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:37.788469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c22d7f-ff28-4b3f-a614-36731da4de33 None admin] PATH_INFO: `/v3/groups/eb7cd5266c4a4def9325ad9e705255fb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:37.790085 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c22d7f-ff28-4b3f-a614-36731da4de33 None admin] RBAC: Authorizing `identity:get_group(group_id=eb7cd5266c4a4def9325ad9e705255fb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:37.791779 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c22d7f-ff28-4b3f-a614-36731da4de33 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:37.794019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 182/381] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:37 2022] GET /identity/v3/groups/eb7cd5266c4a4def9325ad9e705255fb => generated 226 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:37.800337 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c22d7f-ff28-4b3f-a614-36731da4de33 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:37.816281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:37.845110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86d93e-9e69-46e8-8580-8d5a0a44ab12 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:37.895795 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac1b4b-1738-4cc2-9a4c-f76d64329b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:37.897543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac1b4b-1738-4cc2-9a4c-f76d64329b82 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:37.898039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac1b4b-1738-4cc2-9a4c-f76d64329b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:37.898546 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac1b4b-1738-4cc2-9a4c-f76d64329b82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:37.917972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac1b4b-1738-4cc2-9a4c-f76d64329b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-b7ac1b4b-1738-4cc2-9a4c-f76d64329b82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:37.927697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:37.928623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:37.929461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:37.929461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:37.929461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:37.929461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:37.929461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:37.929461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:37.929461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:37.929461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:37.929461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:37.929461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:37.929461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:37.929461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:37.932218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 200/382] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:37.938833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac1b4b-1738-4cc2-9a4c-f76d64329b82 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:38.047675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c22d7f-ff28-4b3f-a614-36731da4de33 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:38.067073 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac1b4b-1738-4cc2-9a4c-f76d64329b82 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:38.110379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:38.123018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36400085-a9a5-485e-91e5-dd4d9bd248e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:38.124064 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36400085-a9a5-485e-91e5-dd4d9bd248e8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:38.124867 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36400085-a9a5-485e-91e5-dd4d9bd248e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:38.125405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36400085-a9a5-485e-91e5-dd4d9bd248e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:38.126970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36400085-a9a5-485e-91e5-dd4d9bd248e8 None admin] RBAC: Adding query filter params (group.id=eb7cd5266c4a4def9325ad9e705255fb, role.id=f5fb67c95c834bc9b359a5141ae0f60c, scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:38.127783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3070ba-096a-4b13-8618-8904a170e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:38.129259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3070ba-096a-4b13-8618-8904a170e191 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:38.130173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36400085-a9a5-485e-91e5-dd4d9bd248e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:38.130678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3070ba-096a-4b13-8618-8904a170e191 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:38.132346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36400085-a9a5-485e-91e5-dd4d9bd248e8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:38.132840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3070ba-096a-4b13-8618-8904a170e191 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:38.133855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3070ba-096a-4b13-8618-8904a170e191 None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:38.134375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3070ba-096a-4b13-8618-8904a170e191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:38.138256 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3070ba-096a-4b13-8618-8904a170e191 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:38.148775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 183/383] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Jul 15 15:11:37 2022] GET /identity/v3/role_assignments?group.id=eb7cd5266c4a4def9325ad9e705255fb&scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f&role.id=f5fb67c95c834bc9b359a5141ae0f60c => generated 260 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:38.152799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 201/384] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:38.159073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36400085-a9a5-485e-91e5-dd4d9bd248e8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:38.254465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:38.314982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36400085-a9a5-485e-91e5-dd4d9bd248e8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:38.370946 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb26c79-06c2-4947-aff5-f33fbf9c608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:38.372191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb26c79-06c2-4947-aff5-f33fbf9c608b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:38.372702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb26c79-06c2-4947-aff5-f33fbf9c608b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:38.373228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb26c79-06c2-4947-aff5-f33fbf9c608b None admin] PATH_INFO: `/v3/groups/eb7cd5266c4a4def9325ad9e705255fb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:38.374653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb26c79-06c2-4947-aff5-f33fbf9c608b None admin] RBAC: Authorizing `identity:get_group(group_id=eb7cd5266c4a4def9325ad9e705255fb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:38.376369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb26c79-06c2-4947-aff5-f33fbf9c608b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:38.378314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 184/385] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:38 2022] GET /identity/v3/groups/eb7cd5266c4a4def9325ad9e705255fb => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:38.384389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3070ba-096a-4b13-8618-8904a170e191 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:38.507583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3070ba-096a-4b13-8618-8904a170e191 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:38.546107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26a132-52cd-44fa-93c7-a491f5f13ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:38.548017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26a132-52cd-44fa-93c7-a491f5f13ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:38.548649 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26a132-52cd-44fa-93c7-a491f5f13ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:38.549282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26a132-52cd-44fa-93c7-a491f5f13ab1 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:38.550810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26a132-52cd-44fa-93c7-a491f5f13ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:38.552503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26a132-52cd-44fa-93c7-a491f5f13ab1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:38.554840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 202/386] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:38 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:38.560266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb26c79-06c2-4947-aff5-f33fbf9c608b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:38.705487 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb26c79-06c2-4947-aff5-f33fbf9c608b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:38.751239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb947c-1269-4036-b744-b4cd9139496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:38.752173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb947c-1269-4036-b744-b4cd9139496e None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:38.752470 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb947c-1269-4036-b744-b4cd9139496e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:38.752951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb947c-1269-4036-b744-b4cd9139496e None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a/groups/eb7cd5266c4a4def9325ad9e705255fb/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:38.756732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb947c-1269-4036-b744-b4cd9139496e None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf7151ce6284a59851d3c6ec893ff7a, group_id=eb7cd5266c4a4def9325ad9e705255fb, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:38.759557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb947c-1269-4036-b744-b4cd9139496e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:38.766468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee41d62-6347-47c2-8e7d-dc1bc5b209ba None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:38.766919 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee41d62-6347-47c2-8e7d-dc1bc5b209ba None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:38.767420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee41d62-6347-47c2-8e7d-dc1bc5b209ba None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:38.771006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 203/387] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:38.773147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:38.781910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 185/388] 10.222.0.64 () {58 vars in 1442 bytes} [Fri Jul 15 15:11:38 2022] PUT /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a/groups/eb7cd5266c4a4def9325ad9e705255fb/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:11:38.782811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56a070-5fb6-47a3-af6f-9c2b535d7c61 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:38.783626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56a070-5fb6-47a3-af6f-9c2b535d7c61 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:38.784440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56a070-5fb6-47a3-af6f-9c2b535d7c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:38.815330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-fa56a070-5fb6-47a3-af6f-9c2b535d7c61 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:38.817947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fa56a070-5fb6-47a3-af6f-9c2b535d7c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:38.886531 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:38.903382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 204/389] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:38.945053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb947c-1269-4036-b744-b4cd9139496e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:39.106448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb947c-1269-4036-b744-b4cd9139496e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:39.150976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffd018-3e8b-4ef7-b190-00a0f933a3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:39.151903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffd018-3e8b-4ef7-b190-00a0f933a3cb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:39.152198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffd018-3e8b-4ef7-b190-00a0f933a3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:39.152478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffd018-3e8b-4ef7-b190-00a0f933a3cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:39.163556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffd018-3e8b-4ef7-b190-00a0f933a3cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-7cffd018-3e8b-4ef7-b190-00a0f933a3cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:39.172162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:39.173556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:39.174714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 186/390] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:11:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:39.179934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56a070-5fb6-47a3-af6f-9c2b535d7c61 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:39.322943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56a070-5fb6-47a3-af6f-9c2b535d7c61 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:39.360782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a232c-bfd3-48bb-9988-402e2a8d2500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:39.361380 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a232c-bfd3-48bb-9988-402e2a8d2500 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:39.361663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a232c-bfd3-48bb-9988-402e2a8d2500 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:39.361951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a232c-bfd3-48bb-9988-402e2a8d2500 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:39.362719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a232c-bfd3-48bb-9988-402e2a8d2500 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:39.363558 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a232c-bfd3-48bb-9988-402e2a8d2500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:39.364940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a232c-bfd3-48bb-9988-402e2a8d2500 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:39.380020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 205/391] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:39.382968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b446aa-9a9b-484b-b1ef-6219c4623548 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:39.383409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b446aa-9a9b-484b-b1ef-6219c4623548 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:39.383595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b446aa-9a9b-484b-b1ef-6219c4623548 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:39.385192 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 187/392] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:39.390179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3feb6-cb6c-4612-8fde-dc1d36febd82 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:39.390306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a232c-bfd3-48bb-9988-402e2a8d2500 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:39.390678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3feb6-cb6c-4612-8fde-dc1d36febd82 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:39.390751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3feb6-cb6c-4612-8fde-dc1d36febd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:39.408281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8fa3feb6-cb6c-4612-8fde-dc1d36febd82 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:39.409617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8fa3feb6-cb6c-4612-8fde-dc1d36febd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:39.500683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:39.514033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:39.533370 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 188/393] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:39.556035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3feb6-cb6c-4612-8fde-dc1d36febd82 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:39.594209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a232c-bfd3-48bb-9988-402e2a8d2500 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:39.665998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddaae2-3f3c-4c20-8c6f-29f7c6e24d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:39.666790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddaae2-3f3c-4c20-8c6f-29f7c6e24d01 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:39.667077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddaae2-3f3c-4c20-8c6f-29f7c6e24d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:39.667357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddaae2-3f3c-4c20-8c6f-29f7c6e24d01 None admin] PATH_INFO: `/v3/groups/eb7cd5266c4a4def9325ad9e705255fb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:39.668578 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddaae2-3f3c-4c20-8c6f-29f7c6e24d01 None admin] RBAC: Authorizing `identity:get_group(group_id=eb7cd5266c4a4def9325ad9e705255fb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:39.670077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddaae2-3f3c-4c20-8c6f-29f7c6e24d01 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:39.672887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 206/394] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:39 2022] GET /identity/v3/groups/eb7cd5266c4a4def9325ad9e705255fb => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:39.679303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddaae2-3f3c-4c20-8c6f-29f7c6e24d01 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:39.748479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3feb6-cb6c-4612-8fde-dc1d36febd82 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:39.836780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2a11e-c66e-43c4-be71-0f7fc629f727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:39.837623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2a11e-c66e-43c4-be71-0f7fc629f727 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:39.837906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2a11e-c66e-43c4-be71-0f7fc629f727 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:39.838183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2a11e-c66e-43c4-be71-0f7fc629f727 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:39.859746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2a11e-c66e-43c4-be71-0f7fc629f727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-98a2a11e-c66e-43c4-be71-0f7fc629f727 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:39.874678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:39.875685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:39.876482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 189/395] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:39.884152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2a11e-c66e-43c4-be71-0f7fc629f727 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:39.893619 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddaae2-3f3c-4c20-8c6f-29f7c6e24d01 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:39.931754 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:39.966190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7ed4-d3c8-4905-a681-d4f2ec9e1e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:39.967134 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7ed4-d3c8-4905-a681-d4f2ec9e1e21 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:39.967421 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7ed4-d3c8-4905-a681-d4f2ec9e1e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:39.967699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7ed4-d3c8-4905-a681-d4f2ec9e1e21 None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:39.970534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a7ed4-d3c8-4905-a681-d4f2ec9e1e21 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:39.972000 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a7ed4-d3c8-4905-a681-d4f2ec9e1e21 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:39.974321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 207/396] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:39 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:39.985987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7ed4-d3c8-4905-a681-d4f2ec9e1e21 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:39.995451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:40.094875 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2a11e-c66e-43c4-be71-0f7fc629f727 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:40.147323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23af256-cf2d-4347-943d-cc831e210349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:40.148431 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23af256-cf2d-4347-943d-cc831e210349 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:40.148925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23af256-cf2d-4347-943d-cc831e210349 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:40.149456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23af256-cf2d-4347-943d-cc831e210349 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:40.150478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23af256-cf2d-4347-943d-cc831e210349 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:40.151010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23af256-cf2d-4347-943d-cc831e210349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:40.158671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23af256-cf2d-4347-943d-cc831e210349 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:40.177188 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7ed4-d3c8-4905-a681-d4f2ec9e1e21 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:40.177673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 190/397] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:40.183044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23af256-cf2d-4347-943d-cc831e210349 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:40.240507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff524b01-8301-49f0-ae51-ce5e2b3f2fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:40.242579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff524b01-8301-49f0-ae51-ce5e2b3f2fbc None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:40.243352 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff524b01-8301-49f0-ae51-ce5e2b3f2fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:40.244161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff524b01-8301-49f0-ae51-ce5e2b3f2fbc None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a/groups/eb7cd5266c4a4def9325ad9e705255fb/roles/f5fb67c95c834bc9b359a5141ae0f60c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:40.252725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff524b01-8301-49f0-ae51-ce5e2b3f2fbc None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf7151ce6284a59851d3c6ec893ff7a, group_id=eb7cd5266c4a4def9325ad9e705255fb, role_id=f5fb67c95c834bc9b359a5141ae0f60c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:40.256281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff524b01-8301-49f0-ae51-ce5e2b3f2fbc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:40.287085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 208/398] 10.222.0.64 () {58 vars in 1442 bytes} [Fri Jul 15 15:11:39 2022] PUT /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a/groups/eb7cd5266c4a4def9325ad9e705255fb/roles/f5fb67c95c834bc9b359a5141ae0f60c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:11:40.379196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23af256-cf2d-4347-943d-cc831e210349 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:40.401654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:40.403042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c091db-2e1b-47bf-a78e-22b412eee62c None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:40.404031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c091db-2e1b-47bf-a78e-22b412eee62c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:40.404418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c091db-2e1b-47bf-a78e-22b412eee62c None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:40.406058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 209/399] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:11:40.416447 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96becd52-a25f-4a67-8aa3-9b9cd9d2bd37 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:40.416772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96becd52-a25f-4a67-8aa3-9b9cd9d2bd37 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:40.417021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96becd52-a25f-4a67-8aa3-9b9cd9d2bd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:40.451215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-96becd52-a25f-4a67-8aa3-9b9cd9d2bd37 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:40.452376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-96becd52-a25f-4a67-8aa3-9b9cd9d2bd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:40.459080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626b639-ec80-41c9-bc07-203042edeb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:40.459976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626b639-ec80-41c9-bc07-203042edeb09 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:40.460265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626b639-ec80-41c9-bc07-203042edeb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:40.460547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626b639-ec80-41c9-bc07-203042edeb09 None admin] PATH_INFO: `/v3/groups/eb7cd5266c4a4def9325ad9e705255fb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:40.461810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626b639-ec80-41c9-bc07-203042edeb09 None admin] RBAC: Authorizing `identity:get_group(group_id=eb7cd5266c4a4def9325ad9e705255fb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:40.463308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626b639-ec80-41c9-bc07-203042edeb09 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:40.465022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 191/400] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:40 2022] GET /identity/v3/groups/eb7cd5266c4a4def9325ad9e705255fb => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:40.472246 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626b639-ec80-41c9-bc07-203042edeb09 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:40.549827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:40.622316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 210/401] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:40.650852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96becd52-a25f-4a67-8aa3-9b9cd9d2bd37 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:40.689881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626b639-ec80-41c9-bc07-203042edeb09 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:40.743304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7380d8-5417-4c15-8cf6-248370da95f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:40.744846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7380d8-5417-4c15-8cf6-248370da95f8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:40.745735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7380d8-5417-4c15-8cf6-248370da95f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:40.746528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7380d8-5417-4c15-8cf6-248370da95f8 None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:40.748192 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7380d8-5417-4c15-8cf6-248370da95f8 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:40.750668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7380d8-5417-4c15-8cf6-248370da95f8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:40.754054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 192/402] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:40 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:40.762296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7380d8-5417-4c15-8cf6-248370da95f8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:40.884334 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96becd52-a25f-4a67-8aa3-9b9cd9d2bd37 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:40.916355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:40.924943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744ff51-bf62-42ba-b1ab-07193d5d0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:40.926252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744ff51-bf62-42ba-b1ab-07193d5d0849 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:40.926754 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744ff51-bf62-42ba-b1ab-07193d5d0849 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:40.927310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744ff51-bf62-42ba-b1ab-07193d5d0849 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:40.938981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744ff51-bf62-42ba-b1ab-07193d5d0849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-f744ff51-bf62-42ba-b1ab-07193d5d0849 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:40.947255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:40.948171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:40.948961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:40.948961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:40.948961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:40.948961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:40.948961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:40.948961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:40.948961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:40.948961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:40.948961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:40.948961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:40.948961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:40.948961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:40.951421 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 211/403] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:11:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:40.958630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6304898-60ed-4cea-a3e8-f4f371d15530 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:40.959206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6304898-60ed-4cea-a3e8-f4f371d15530 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:40.959687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6304898-60ed-4cea-a3e8-f4f371d15530 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:40.961644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 212/404] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:40.962586 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6304898-60ed-4cea-a3e8-f4f371d15530 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:41.006437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:41.024196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7380d8-5417-4c15-8cf6-248370da95f8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:41.080810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885706b-93e6-4f26-ad00-100a0789a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:41.082769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885706b-93e6-4f26-ad00-100a0789a373 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:41.083279 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885706b-93e6-4f26-ad00-100a0789a373 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:41.083763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885706b-93e6-4f26-ad00-100a0789a373 None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f/groups/eb7cd5266c4a4def9325ad9e705255fb/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:41.086166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885706b-93e6-4f26-ad00-100a0789a373 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffa8c33444b7494fbfbe8ad5eadb219f, group_id=eb7cd5266c4a4def9325ad9e705255fb, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:41.086969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6304898-60ed-4cea-a3e8-f4f371d15530 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:41.088006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885706b-93e6-4f26-ad00-100a0789a373 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:41.107189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 193/405] 10.222.0.64 () {58 vars in 1442 bytes} [Fri Jul 15 15:11:40 2022] PUT /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f/groups/eb7cd5266c4a4def9325ad9e705255fb/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:41.109089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518490f-8bf8-449a-afdc-ed40b262bb26 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:41.109635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518490f-8bf8-449a-afdc-ed40b262bb26 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:41.110122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518490f-8bf8-449a-afdc-ed40b262bb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:41.129207 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474727-692f-4daa-b39a-7ff991b96de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:41.130194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474727-692f-4daa-b39a-7ff991b96de7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:41.130652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474727-692f-4daa-b39a-7ff991b96de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:41.130790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f518490f-8bf8-449a-afdc-ed40b262bb26 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:41.131204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474727-692f-4daa-b39a-7ff991b96de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:41.132146 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae474727-692f-4daa-b39a-7ff991b96de7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:41.132266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f518490f-8bf8-449a-afdc-ed40b262bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:41.132703 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae474727-692f-4daa-b39a-7ff991b96de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:41.134480 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae474727-692f-4daa-b39a-7ff991b96de7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:41.148742 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 213/406] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:41.155912 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474727-692f-4daa-b39a-7ff991b96de7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:41.225320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 194/407] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:41.308960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518490f-8bf8-449a-afdc-ed40b262bb26 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:41.312400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474727-692f-4daa-b39a-7ff991b96de7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:41.316748 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:41.368429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab31233-49ce-44b6-81b7-1463ff71a296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:41.370284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31233-49ce-44b6-81b7-1463ff71a296 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:41.371024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31233-49ce-44b6-81b7-1463ff71a296 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:41.371477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31233-49ce-44b6-81b7-1463ff71a296 None admin] PATH_INFO: `/v3/groups/cfe327c3c3b744f0b28f999c7231303a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:41.374465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab31233-49ce-44b6-81b7-1463ff71a296 None admin] RBAC: Authorizing `identity:get_group(group_id=cfe327c3c3b744f0b28f999c7231303a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:41.378119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab31233-49ce-44b6-81b7-1463ff71a296 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:41.383055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 214/408] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:41 2022] GET /identity/v3/groups/cfe327c3c3b744f0b28f999c7231303a => generated 229 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:41.384433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:41.390701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9f4cc-282e-4c07-a88f-f78a46dfdc27 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:41.390701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9f4cc-282e-4c07-a88f-f78a46dfdc27 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:41.390701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9f4cc-282e-4c07-a88f-f78a46dfdc27 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:41.393677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 215/409] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:41.399435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9f4cc-282e-4c07-a88f-f78a46dfdc27 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:41.473958 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518490f-8bf8-449a-afdc-ed40b262bb26 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:41.524248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29759b9a-7012-452f-9c24-8c4f9fa73a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:41.525973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29759b9a-7012-452f-9c24-8c4f9fa73a86 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:41.526746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29759b9a-7012-452f-9c24-8c4f9fa73a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:41.527231 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29759b9a-7012-452f-9c24-8c4f9fa73a86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:41.547803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29759b9a-7012-452f-9c24-8c4f9fa73a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:41.556705 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9f4cc-282e-4c07-a88f-f78a46dfdc27 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-29759b9a-7012-452f-9c24-8c4f9fa73a86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:41.559930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:41.561002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:41.562256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 195/410] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:11:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:41.564142 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2a861-0345-424b-a955-a7b1ea919218 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:41.564500 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2a861-0345-424b-a955-a7b1ea919218 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:41.564841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2a861-0345-424b-a955-a7b1ea919218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:41.592535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-58e2a861-0345-424b-a955-a7b1ea919218 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:41.593911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-58e2a861-0345-424b-a955-a7b1ea919218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:41.629195 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19374c72-8e96-4052-b94f-a6d0b9e4178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:41.630482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19374c72-8e96-4052-b94f-a6d0b9e4178b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:41.630781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19374c72-8e96-4052-b94f-a6d0b9e4178b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:41.631227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19374c72-8e96-4052-b94f-a6d0b9e4178b None admin] PATH_INFO: `/v3/projects/71c3490c70ac4566897a6b15fddccf92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:41.633713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19374c72-8e96-4052-b94f-a6d0b9e4178b None admin] RBAC: Authorizing `identity:get_project(project_id=71c3490c70ac4566897a6b15fddccf92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:41.634423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19374c72-8e96-4052-b94f-a6d0b9e4178b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:41.641129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 216/411] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:41 2022] GET /identity/v3/projects/71c3490c70ac4566897a6b15fddccf92 => generated 344 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:41.641129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19374c72-8e96-4052-b94f-a6d0b9e4178b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:41.711400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:41.730780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 196/412] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:41.732753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2a861-0345-424b-a955-a7b1ea919218 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:41.793506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:41.805844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19374c72-8e96-4052-b94f-a6d0b9e4178b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:41.852785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121b6ce-d21c-44d3-bca2-e1885edc11b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:41.853927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121b6ce-d21c-44d3-bca2-e1885edc11b0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:41.854789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121b6ce-d21c-44d3-bca2-e1885edc11b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:41.855707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121b6ce-d21c-44d3-bca2-e1885edc11b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:41.857305 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121b6ce-d21c-44d3-bca2-e1885edc11b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:41.857848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121b6ce-d21c-44d3-bca2-e1885edc11b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:41.859722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121b6ce-d21c-44d3-bca2-e1885edc11b0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:41.863955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2a861-0345-424b-a955-a7b1ea919218 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:41.872744 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 217/413] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:41.874201 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121b6ce-d21c-44d3-bca2-e1885edc11b0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:41.914579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda1dc3-2c82-4802-96f2-daa180d13316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:41.915468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1dc3-2c82-4802-96f2-daa180d13316 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:41.915755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1dc3-2c82-4802-96f2-daa180d13316 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:41.916036 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1dc3-2c82-4802-96f2-daa180d13316 None admin] PATH_INFO: `/v3/projects/71c3490c70ac4566897a6b15fddccf92/groups/cfe327c3c3b744f0b28f999c7231303a/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:41.918199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda1dc3-2c82-4802-96f2-daa180d13316 None admin] RBAC: Authorizing `identity:create_grant(project_id=71c3490c70ac4566897a6b15fddccf92, group_id=cfe327c3c3b744f0b28f999c7231303a, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:41.920758 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda1dc3-2c82-4802-96f2-daa180d13316 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:41.941753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 197/414] 10.222.0.64 () {58 vars in 1442 bytes} [Fri Jul 15 15:11:41 2022] PUT /identity/v3/projects/71c3490c70ac4566897a6b15fddccf92/groups/cfe327c3c3b744f0b28f999c7231303a/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:41.942810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda1dc3-2c82-4802-96f2-daa180d13316 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:42.021678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:42.035435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121b6ce-d21c-44d3-bca2-e1885edc11b0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:42.052188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:42.075179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda1dc3-2c82-4802-96f2-daa180d13316 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:42.101403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a884d-c6ae-411c-a884-c16a949ecc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:42.103173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a884d-c6ae-411c-a884-c16a949ecc81 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:42.103690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a884d-c6ae-411c-a884-c16a949ecc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:42.104220 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a884d-c6ae-411c-a884-c16a949ecc81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:42.116924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af729578-a7db-48b3-99a0-ad07ec0a6bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:42.117840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af729578-a7db-48b3-99a0-ad07ec0a6bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:42.118124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af729578-a7db-48b3-99a0-ad07ec0a6bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:42.118397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af729578-a7db-48b3-99a0-ad07ec0a6bf0 None admin] PATH_INFO: `/v3/groups/eb7cd5266c4a4def9325ad9e705255fb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:42.119710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af729578-a7db-48b3-99a0-ad07ec0a6bf0 None admin] RBAC: Authorizing `identity:get_group(group_id=eb7cd5266c4a4def9325ad9e705255fb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:42.120335 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a884d-c6ae-411c-a884-c16a949ecc81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:42.121436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af729578-a7db-48b3-99a0-ad07ec0a6bf0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:42.127965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 198/415] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:41 2022] GET /identity/v3/groups/eb7cd5266c4a4def9325ad9e705255fb => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:42.129426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af729578-a7db-48b3-99a0-ad07ec0a6bf0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-107a884d-c6ae-411c-a884-c16a949ecc81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:42.130806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:42.131891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:42.132827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:42.132827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:42.132827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:42.132827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:42.132827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:42.132827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:42.132827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:42.132827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:42.132827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:42.132827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:42.132827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:42.132827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:42.136279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 218/416] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:42.147626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a884d-c6ae-411c-a884-c16a949ecc81 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:42.320275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a884d-c6ae-411c-a884-c16a949ecc81 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:42.332358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af729578-a7db-48b3-99a0-ad07ec0a6bf0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:42.366089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88815ae1-803b-4d61-a8d1-2ab9ec78aa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:42.366712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88815ae1-803b-4d61-a8d1-2ab9ec78aa8c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:42.367001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88815ae1-803b-4d61-a8d1-2ab9ec78aa8c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:42.367285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88815ae1-803b-4d61-a8d1-2ab9ec78aa8c None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:42.368152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88815ae1-803b-4d61-a8d1-2ab9ec78aa8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:42.368669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88815ae1-803b-4d61-a8d1-2ab9ec78aa8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:42.370880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88815ae1-803b-4d61-a8d1-2ab9ec78aa8c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:42.390516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 219/417] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:42.397320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88815ae1-803b-4d61-a8d1-2ab9ec78aa8c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:42.403014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169eb53-c7a8-4e53-a8a0-881d68d9e86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:42.404351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169eb53-c7a8-4e53-a8a0-881d68d9e86d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:42.404788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169eb53-c7a8-4e53-a8a0-881d68d9e86d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:42.405246 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169eb53-c7a8-4e53-a8a0-881d68d9e86d None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:42.406797 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169eb53-c7a8-4e53-a8a0-881d68d9e86d None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:42.409268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169eb53-c7a8-4e53-a8a0-881d68d9e86d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:42.419507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 199/418] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:42 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:42.423982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:42.425610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169eb53-c7a8-4e53-a8a0-881d68d9e86d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:42.502741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:42.527466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88815ae1-803b-4d61-a8d1-2ab9ec78aa8c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:42.578811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29545d8-71a7-4918-88f1-a160ca0182af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:42.580465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29545d8-71a7-4918-88f1-a160ca0182af None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:42.580991 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29545d8-71a7-4918-88f1-a160ca0182af None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:42.582180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29545d8-71a7-4918-88f1-a160ca0182af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:42.665646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29545d8-71a7-4918-88f1-a160ca0182af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:42.668173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29545d8-71a7-4918-88f1-a160ca0182af None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:42.676748 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169eb53-c7a8-4e53-a8a0-881d68d9e86d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:42.705454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:42.724904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc39a84-8d06-4678-ba16-b7e609d9a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:42.724904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc39a84-8d06-4678-ba16-b7e609d9a6b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:42.724904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc39a84-8d06-4678-ba16-b7e609d9a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:42.724904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc39a84-8d06-4678-ba16-b7e609d9a6b2 None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f/groups/eb7cd5266c4a4def9325ad9e705255fb/roles/f5fb67c95c834bc9b359a5141ae0f60c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:42.726461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc39a84-8d06-4678-ba16-b7e609d9a6b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffa8c33444b7494fbfbe8ad5eadb219f, group_id=eb7cd5266c4a4def9325ad9e705255fb, role_id=f5fb67c95c834bc9b359a5141ae0f60c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:42.728321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc39a84-8d06-4678-ba16-b7e609d9a6b2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:42.759816 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 200/419] 10.222.0.64 () {58 vars in 1442 bytes} [Fri Jul 15 15:11:42 2022] PUT /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f/groups/eb7cd5266c4a4def9325ad9e705255fb/roles/f5fb67c95c834bc9b359a5141ae0f60c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:11:42.855455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 220/420] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:42.861854 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc39a84-8d06-4678-ba16-b7e609d9a6b2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:42.978054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:42.995526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc39a84-8d06-4678-ba16-b7e609d9a6b2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:43.037198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec48a14-f149-4d6f-8792-439c7af530de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:43.038084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48a14-f149-4d6f-8792-439c7af530de None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:43.038367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48a14-f149-4d6f-8792-439c7af530de None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:43.038642 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48a14-f149-4d6f-8792-439c7af530de None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:43.039914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec48a14-f149-4d6f-8792-439c7af530de None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:43.041475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec48a14-f149-4d6f-8792-439c7af530de None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:43.043673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 201/421] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:42 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:43.049945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29545d8-71a7-4918-88f1-a160ca0182af None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:43.078547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bc6b0-18d0-48dd-8d06-70e73f0e872a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:43.078981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bc6b0-18d0-48dd-8d06-70e73f0e872a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:43.079363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bc6b0-18d0-48dd-8d06-70e73f0e872a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:43.082185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 202/422] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:43.087314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865dbce-2c43-43ab-89c7-8b3b889946f9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:43.087601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865dbce-2c43-43ab-89c7-8b3b889946f9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:43.087930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865dbce-2c43-43ab-89c7-8b3b889946f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:43.118217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4865dbce-2c43-43ab-89c7-8b3b889946f9 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:43.119444 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4865dbce-2c43-43ab-89c7-8b3b889946f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:43.189219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29545d8-71a7-4918-88f1-a160ca0182af None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:43.227689 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:43.251113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 203/423] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:43.266167 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c75cc-d3d2-493a-89eb-bb7f30f55e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:43.267672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c75cc-d3d2-493a-89eb-bb7f30f55e89 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:43.268169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c75cc-d3d2-493a-89eb-bb7f30f55e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:43.268708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c75cc-d3d2-493a-89eb-bb7f30f55e89 None admin] PATH_INFO: `/v3/groups/eb7cd5266c4a4def9325ad9e705255fb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:43.273866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c75cc-d3d2-493a-89eb-bb7f30f55e89 None admin] RBAC: Authorizing `identity:get_group(group_id=eb7cd5266c4a4def9325ad9e705255fb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:43.275356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c75cc-d3d2-493a-89eb-bb7f30f55e89 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:43.277652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865dbce-2c43-43ab-89c7-8b3b889946f9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:43.281371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 221/424] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:43 2022] GET /identity/v3/groups/eb7cd5266c4a4def9325ad9e705255fb => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:43.287001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c75cc-d3d2-493a-89eb-bb7f30f55e89 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:43.422270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:43.457205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c75cc-d3d2-493a-89eb-bb7f30f55e89 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:43.469052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865dbce-2c43-43ab-89c7-8b3b889946f9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:43.521871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a1c01-145f-4ff4-83d4-c0705ede4dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:43.523816 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a1c01-145f-4ff4-83d4-c0705ede4dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:43.524115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a1c01-145f-4ff4-83d4-c0705ede4dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:43.524393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a1c01-145f-4ff4-83d4-c0705ede4dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:43.525339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a1c01-145f-4ff4-83d4-c0705ede4dc3 None admin] RBAC: Adding query filter params (group.id=eb7cd5266c4a4def9325ad9e705255fb, role.id=b670784e829b4bffb77b03422132634a, scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:43.525681 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a1c01-145f-4ff4-83d4-c0705ede4dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:43.527218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a1c01-145f-4ff4-83d4-c0705ede4dc3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:43.534997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 222/425] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Jul 15 15:11:43 2022] GET /identity/v3/role_assignments?group.id=eb7cd5266c4a4def9325ad9e705255fb&scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a&role.id=b670784e829b4bffb77b03422132634a => generated 611 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:43.539062 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ca208-0df2-4633-b3b6-cf6396768956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:43.540604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ca208-0df2-4633-b3b6-cf6396768956 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:43.541056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ca208-0df2-4633-b3b6-cf6396768956 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:43.541515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ca208-0df2-4633-b3b6-cf6396768956 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:43.557264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ca208-0df2-4633-b3b6-cf6396768956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-5b2ca208-0df2-4633-b3b6-cf6396768956 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:43.570055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:43.571983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:43.573158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:43.573158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:43.573158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:43.573158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:43.573158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:43.573158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:43.573158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:43.573158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:43.573158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:43.573158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:43.573158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:43.573158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:43.575624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 204/426] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:11:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:43.584617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a1c01-145f-4ff4-83d4-c0705ede4dc3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:43.674592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:43.744596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a1c01-145f-4ff4-83d4-c0705ede4dc3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:43.780426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a849a8c-d5d2-49ac-ab8b-6742070310cd None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:43.780710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a849a8c-d5d2-49ac-ab8b-6742070310cd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:43.780919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a849a8c-d5d2-49ac-ab8b-6742070310cd None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:43.782501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 205/427] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:11:43.789668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf33884-03ed-4357-86ef-cccb5bd65fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:43.790910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f0fb0-874e-457e-8de2-4adfc658f0ea None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:43.791201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f0fb0-874e-457e-8de2-4adfc658f0ea None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:43.791479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f0fb0-874e-457e-8de2-4adfc658f0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:43.791944 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf33884-03ed-4357-86ef-cccb5bd65fac None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:43.792486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf33884-03ed-4357-86ef-cccb5bd65fac None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:43.792971 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf33884-03ed-4357-86ef-cccb5bd65fac None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:43.793989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf33884-03ed-4357-86ef-cccb5bd65fac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:43.794795 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf33884-03ed-4357-86ef-cccb5bd65fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:43.797501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf33884-03ed-4357-86ef-cccb5bd65fac None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:43.811741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-092f0fb0-874e-457e-8de2-4adfc658f0ea None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:43.812959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-092f0fb0-874e-457e-8de2-4adfc658f0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:43.813415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 223/428] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:43.819374 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf33884-03ed-4357-86ef-cccb5bd65fac None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:43.949552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 206/429] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:43.975194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf33884-03ed-4357-86ef-cccb5bd65fac None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:43.979603 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f0fb0-874e-457e-8de2-4adfc658f0ea None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:43.992173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:44.033651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf6444-70e9-4531-840d-f53fb841c762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:44.034372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6444-70e9-4531-840d-f53fb841c762 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:44.035141 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6444-70e9-4531-840d-f53fb841c762 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:44.035423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6444-70e9-4531-840d-f53fb841c762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:44.090721 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:44.123500 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf6444-70e9-4531-840d-f53fb841c762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:44.125042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf6444-70e9-4531-840d-f53fb841c762 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:44.126159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f0fb0-874e-457e-8de2-4adfc658f0ea None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:44.170175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d9cc6-19cf-495f-8d8d-68a62b6ed2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:44.171272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d9cc6-19cf-495f-8d8d-68a62b6ed2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:44.171563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d9cc6-19cf-495f-8d8d-68a62b6ed2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:44.171844 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d9cc6-19cf-495f-8d8d-68a62b6ed2a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:44.185301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d9cc6-19cf-495f-8d8d-68a62b6ed2a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4e1d9cc6-19cf-495f-8d8d-68a62b6ed2a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:44.195725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:44.196662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:44.197499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:44.197499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:44.197499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:44.197499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:44.197499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:44.197499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:44.197499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:44.197499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:44.197499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:44.197499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:44.197499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:11:44.197499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:44.201217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 207/430] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:44.203928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d9cc6-19cf-495f-8d8d-68a62b6ed2a8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:44.272741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 224/431] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 15:11:44.279003 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf6444-70e9-4531-840d-f53fb841c762 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:44.298998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:44.324018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d9cc6-19cf-495f-8d8d-68a62b6ed2a8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:44.357808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:44.363996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82820e22-a28f-4c54-9816-4d8c6b7bef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:44.364686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82820e22-a28f-4c54-9816-4d8c6b7bef33 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:44.364974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82820e22-a28f-4c54-9816-4d8c6b7bef33 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:44.365292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82820e22-a28f-4c54-9816-4d8c6b7bef33 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:44.366062 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82820e22-a28f-4c54-9816-4d8c6b7bef33 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:44.366375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82820e22-a28f-4c54-9816-4d8c6b7bef33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:44.367781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82820e22-a28f-4c54-9816-4d8c6b7bef33 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:44.383072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 208/432] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:11:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:44.384374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82820e22-a28f-4c54-9816-4d8c6b7bef33 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:44.425434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf6444-70e9-4531-840d-f53fb841c762 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:44.473492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ccc74-f68e-4f9a-a341-23c15b50d90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:44.475927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ccc74-f68e-4f9a-a341-23c15b50d90b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:44.476465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ccc74-f68e-4f9a-a341-23c15b50d90b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:44.476895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ccc74-f68e-4f9a-a341-23c15b50d90b None admin] PATH_INFO: `/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:44.478467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ccc74-f68e-4f9a-a341-23c15b50d90b None admin] RBAC: Authorizing `identity:get_project(project_id=dbf7151ce6284a59851d3c6ec893ff7a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:44.480182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ccc74-f68e-4f9a-a341-23c15b50d90b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:44.482562 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 225/433] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:44 2022] GET /identity/v3/projects/dbf7151ce6284a59851d3c6ec893ff7a => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:44.489112 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ccc74-f68e-4f9a-a341-23c15b50d90b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:44.501746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82820e22-a28f-4c54-9816-4d8c6b7bef33 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:44.541860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94fb5e-ace2-4ee8-a702-64edc7356a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:44.542540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94fb5e-ace2-4ee8-a702-64edc7356a0a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:44.542819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94fb5e-ace2-4ee8-a702-64edc7356a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:44.543106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94fb5e-ace2-4ee8-a702-64edc7356a0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:44.594573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:44.615849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:44.625991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94fb5e-ace2-4ee8-a702-64edc7356a0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:44.627764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94fb5e-ace2-4ee8-a702-64edc7356a0a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:44.629439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ccc74-f68e-4f9a-a341-23c15b50d90b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:44.668786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3202ac-4159-4f38-85b5-4d33f11b4cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:44.669699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3202ac-4159-4f38-85b5-4d33f11b4cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:44.669989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3202ac-4159-4f38-85b5-4d33f11b4cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:44.670268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3202ac-4159-4f38-85b5-4d33f11b4cc7 None admin] PATH_INFO: `/v3/groups/eb7cd5266c4a4def9325ad9e705255fb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:44.672064 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3202ac-4159-4f38-85b5-4d33f11b4cc7 None admin] RBAC: Authorizing `identity:get_group(group_id=eb7cd5266c4a4def9325ad9e705255fb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:44.673599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3202ac-4159-4f38-85b5-4d33f11b4cc7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:44.681432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 226/434] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:44 2022] GET /identity/v3/groups/eb7cd5266c4a4def9325ad9e705255fb => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:44.683150 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3202ac-4159-4f38-85b5-4d33f11b4cc7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:44.751179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 209/435] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:44.752524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982777d7-d56a-48d8-8cb8-55d8ec377a31 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:44.752812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982777d7-d56a-48d8-8cb8-55d8ec377a31 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:44.753164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982777d7-d56a-48d8-8cb8-55d8ec377a31 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:44.755493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 210/436] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:44.760116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982777d7-d56a-48d8-8cb8-55d8ec377a31 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:44.817521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3202ac-4159-4f38-85b5-4d33f11b4cc7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:44.859782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c60ea-2b3e-4f66-8af1-bf62207804e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:44.859975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c60ea-2b3e-4f66-8af1-bf62207804e0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:44.860229 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c60ea-2b3e-4f66-8af1-bf62207804e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:44.860701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c60ea-2b3e-4f66-8af1-bf62207804e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:44.861791 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c60ea-2b3e-4f66-8af1-bf62207804e0 None admin] RBAC: Adding query filter params (group.id=eb7cd5266c4a4def9325ad9e705255fb, role.id=f5fb67c95c834bc9b359a5141ae0f60c, scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:44.862115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c60ea-2b3e-4f66-8af1-bf62207804e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:44.864198 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c60ea-2b3e-4f66-8af1-bf62207804e0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:44.881100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 227/437] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Jul 15 15:11:44 2022] GET /identity/v3/role_assignments?group.id=eb7cd5266c4a4def9325ad9e705255fb&scope.project.id=dbf7151ce6284a59851d3c6ec893ff7a&role.id=f5fb67c95c834bc9b359a5141ae0f60c => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:44.881100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c840358-c4d5-4980-9b2e-49174a11bb69 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:44.881100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c840358-c4d5-4980-9b2e-49174a11bb69 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:44.881100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c840358-c4d5-4980-9b2e-49174a11bb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:44.895329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:44.902966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1c840358-c4d5-4980-9b2e-49174a11bb69 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:44.904290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1c840358-c4d5-4980-9b2e-49174a11bb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:44.906767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982777d7-d56a-48d8-8cb8-55d8ec377a31 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:44.915424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:44.967231 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad485781-9d82-4ea6-bd92-bb0f1802c913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:44.968574 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad485781-9d82-4ea6-bd92-bb0f1802c913 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:44.968864 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad485781-9d82-4ea6-bd92-bb0f1802c913 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:44.969202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad485781-9d82-4ea6-bd92-bb0f1802c913 None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:44.970780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad485781-9d82-4ea6-bd92-bb0f1802c913 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:44.973317 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad485781-9d82-4ea6-bd92-bb0f1802c913 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:44.977123 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 211/438] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:44 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:44.982666 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad485781-9d82-4ea6-bd92-bb0f1802c913 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:45.010620 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 228/439] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:45.035896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c840358-c4d5-4980-9b2e-49174a11bb69 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:45.121132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad485781-9d82-4ea6-bd92-bb0f1802c913 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:45.172540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d1b6a-440d-45e2-88fe-fc093afab712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:45.173497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d1b6a-440d-45e2-88fe-fc093afab712 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:45.173784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d1b6a-440d-45e2-88fe-fc093afab712 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:45.174060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d1b6a-440d-45e2-88fe-fc093afab712 None admin] PATH_INFO: `/v3/groups/eb7cd5266c4a4def9325ad9e705255fb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:45.179687 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d1b6a-440d-45e2-88fe-fc093afab712 None admin] RBAC: Authorizing `identity:get_group(group_id=eb7cd5266c4a4def9325ad9e705255fb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:45.179687 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d1b6a-440d-45e2-88fe-fc093afab712 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:45.180149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 212/440] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:44 2022] GET /identity/v3/groups/eb7cd5266c4a4def9325ad9e705255fb => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:45.185949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d1b6a-440d-45e2-88fe-fc093afab712 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:45.189468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c840358-c4d5-4980-9b2e-49174a11bb69 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:45.230170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:45.242560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6774f-830a-4386-a4e5-d7b9ee90dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:45.243725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6774f-830a-4386-a4e5-d7b9ee90dbef None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:45.244017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6774f-830a-4386-a4e5-d7b9ee90dbef None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:45.244295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6774f-830a-4386-a4e5-d7b9ee90dbef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:45.259514 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6774f-830a-4386-a4e5-d7b9ee90dbef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-cca6774f-830a-4386-a4e5-d7b9ee90dbef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:45.269387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:45.270326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:45.271099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 229/441] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:11:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:45.277036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6774f-830a-4386-a4e5-d7b9ee90dbef None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:45.280773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:45.336657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d1b6a-440d-45e2-88fe-fc093afab712 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:45.418968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6d048-8d67-48c7-9941-bdf70c21843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:45.420297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6d048-8d67-48c7-9941-bdf70c21843b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:45.420297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6d048-8d67-48c7-9941-bdf70c21843b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:45.420496 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6d048-8d67-48c7-9941-bdf70c21843b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:45.421441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6d048-8d67-48c7-9941-bdf70c21843b None admin] RBAC: Adding query filter params (group.id=eb7cd5266c4a4def9325ad9e705255fb, role.id=b670784e829b4bffb77b03422132634a, scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:45.421872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6d048-8d67-48c7-9941-bdf70c21843b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:45.423809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6d048-8d67-48c7-9941-bdf70c21843b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:45.432320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 213/442] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Jul 15 15:11:45 2022] GET /identity/v3/role_assignments?group.id=eb7cd5266c4a4def9325ad9e705255fb&scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f&role.id=b670784e829b4bffb77b03422132634a => generated 611 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:45.464308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6774f-830a-4386-a4e5-d7b9ee90dbef None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:45.492524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ecec4-7c69-4c63-8dea-e2608bcceb73 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:45.492823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ecec4-7c69-4c63-8dea-e2608bcceb73 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:45.493155 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ecec4-7c69-4c63-8dea-e2608bcceb73 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:45.494649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 214/443] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:11:45.500548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc024-b913-4741-b897-b6e05807574d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:45.500841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc024-b913-4741-b897-b6e05807574d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:45.501167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc024-b913-4741-b897-b6e05807574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:45.513868 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de2abc-3337-409f-83cc-3e2e66af29fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:45.514582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de2abc-3337-409f-83cc-3e2e66af29fc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:45.514941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de2abc-3337-409f-83cc-3e2e66af29fc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:45.515423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de2abc-3337-409f-83cc-3e2e66af29fc None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:45.516820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de2abc-3337-409f-83cc-3e2e66af29fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:45.517388 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de2abc-3337-409f-83cc-3e2e66af29fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:45.520324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de2abc-3337-409f-83cc-3e2e66af29fc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:45.520736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-951dc024-b913-4741-b897-b6e05807574d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:45.522038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-951dc024-b913-4741-b897-b6e05807574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:45.532515 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 230/444] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:45.539071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de2abc-3337-409f-83cc-3e2e66af29fc None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:45.627663 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 215/445] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:45.629237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:45.652976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dc024-b913-4741-b897-b6e05807574d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:45.685720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:45.688432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de2abc-3337-409f-83cc-3e2e66af29fc None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:45.740342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba6c71-583e-456e-b30b-3d9feefe6dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:45.740997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba6c71-583e-456e-b30b-3d9feefe6dea None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:45.741319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba6c71-583e-456e-b30b-3d9feefe6dea None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:45.741601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba6c71-583e-456e-b30b-3d9feefe6dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:45.808791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dc024-b913-4741-b897-b6e05807574d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:45.843823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba6c71-583e-456e-b30b-3d9feefe6dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:45.843823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba6c71-583e-456e-b30b-3d9feefe6dea None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:45.857206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf555cd1-25f8-41df-834a-a69573f8c394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:45.858037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf555cd1-25f8-41df-834a-a69573f8c394 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:45.858327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf555cd1-25f8-41df-834a-a69573f8c394 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:45.858600 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf555cd1-25f8-41df-834a-a69573f8c394 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:45.884479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf555cd1-25f8-41df-834a-a69573f8c394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-cf555cd1-25f8-41df-834a-a69573f8c394 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:45.893582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:45.895951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:45.897540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 216/446] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:11:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:45.903085 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf555cd1-25f8-41df-834a-a69573f8c394 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:45.918019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:45.961363 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 231/447] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 15:11:45.967137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba6c71-583e-456e-b30b-3d9feefe6dea None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:45.999571 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:46.019483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf555cd1-25f8-41df-834a-a69573f8c394 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:46.055363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eed18a-d165-424f-828c-1d71e538c899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:46.056113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eed18a-d165-424f-828c-1d71e538c899 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:46.056331 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eed18a-d165-424f-828c-1d71e538c899 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:46.056614 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eed18a-d165-424f-828c-1d71e538c899 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:46.057495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eed18a-d165-424f-828c-1d71e538c899 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:46.057822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eed18a-d165-424f-828c-1d71e538c899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:46.059248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eed18a-d165-424f-828c-1d71e538c899 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:46.070519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 217/448] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:46.076570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eed18a-d165-424f-828c-1d71e538c899 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:46.087390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba6c71-583e-456e-b30b-3d9feefe6dea None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:46.126341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da6aed-b683-4594-b044-8b81a898280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:46.127203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da6aed-b683-4594-b044-8b81a898280c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:46.127484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da6aed-b683-4594-b044-8b81a898280c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:46.127758 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da6aed-b683-4594-b044-8b81a898280c None admin] PATH_INFO: `/v3/projects/71c3490c70ac4566897a6b15fddccf92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:46.129859 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da6aed-b683-4594-b044-8b81a898280c None admin] RBAC: Authorizing `identity:get_project(project_id=71c3490c70ac4566897a6b15fddccf92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:46.131401 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da6aed-b683-4594-b044-8b81a898280c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:46.133139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 232/449] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:45 2022] GET /identity/v3/projects/71c3490c70ac4566897a6b15fddccf92 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:46.138969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da6aed-b683-4594-b044-8b81a898280c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:46.188140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:46.208579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eed18a-d165-424f-828c-1d71e538c899 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:46.245152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67617acd-7f6b-4564-95b0-d81dae5edcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:46.245722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67617acd-7f6b-4564-95b0-d81dae5edcf9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:46.246010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67617acd-7f6b-4564-95b0-d81dae5edcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:46.246298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67617acd-7f6b-4564-95b0-d81dae5edcf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:46.263288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:46.275247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da6aed-b683-4594-b044-8b81a898280c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:46.312898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fef24-2312-48d5-95f1-49d1360599b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:46.313793 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fef24-2312-48d5-95f1-49d1360599b9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:46.314079 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fef24-2312-48d5-95f1-49d1360599b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:46.314353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fef24-2312-48d5-95f1-49d1360599b9 None admin] PATH_INFO: `/v3/groups/cfe327c3c3b744f0b28f999c7231303a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:46.315624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fef24-2312-48d5-95f1-49d1360599b9 None admin] RBAC: Authorizing `identity:get_group(group_id=cfe327c3c3b744f0b28f999c7231303a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:46.317661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fef24-2312-48d5-95f1-49d1360599b9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:46.319501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 233/450] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:46 2022] GET /identity/v3/groups/cfe327c3c3b744f0b28f999c7231303a => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:46.325249 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fef24-2312-48d5-95f1-49d1360599b9 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:46.341172 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67617acd-7f6b-4564-95b0-d81dae5edcf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:46.342657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67617acd-7f6b-4564-95b0-d81dae5edcf9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:46.442515 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:46.447368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fef24-2312-48d5-95f1-49d1360599b9 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:46.463765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 218/451] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 15:11:46.469915 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67617acd-7f6b-4564-95b0-d81dae5edcf9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:46.494672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b2365-81c9-4f93-a05b-ba972adc0390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:46.495425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2365-81c9-4f93-a05b-ba972adc0390 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:46.495728 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2365-81c9-4f93-a05b-ba972adc0390 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:46.496019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2365-81c9-4f93-a05b-ba972adc0390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:46.497114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b2365-81c9-4f93-a05b-ba972adc0390 None admin] RBAC: Adding query filter params (group.id=cfe327c3c3b744f0b28f999c7231303a, role.id=87593f63c4744eac870c07b006022e77, scope.project.id=71c3490c70ac4566897a6b15fddccf92) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:46.497443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b2365-81c9-4f93-a05b-ba972adc0390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:46.499259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b2365-81c9-4f93-a05b-ba972adc0390 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:46.507630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 234/452] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Jul 15 15:11:46 2022] GET /identity/v3/role_assignments?group.id=cfe327c3c3b744f0b28f999c7231303a&scope.project.id=71c3490c70ac4566897a6b15fddccf92&role.id=87593f63c4744eac870c07b006022e77 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:46.522871 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:46.594792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67617acd-7f6b-4564-95b0-d81dae5edcf9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:46.638038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad82e2-1a94-4656-aaca-5b5db5fcb901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:46.638912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad82e2-1a94-4656-aaca-5b5db5fcb901 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:46.639190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad82e2-1a94-4656-aaca-5b5db5fcb901 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:46.639463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad82e2-1a94-4656-aaca-5b5db5fcb901 None admin] PATH_INFO: `/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:46.640757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad82e2-1a94-4656-aaca-5b5db5fcb901 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa8c33444b7494fbfbe8ad5eadb219f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:46.642417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad82e2-1a94-4656-aaca-5b5db5fcb901 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:46.644709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 219/453] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:11:46 2022] GET /identity/v3/projects/ffa8c33444b7494fbfbe8ad5eadb219f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:46.650551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b2365-81c9-4f93-a05b-ba972adc0390 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:46.780496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b2365-81c9-4f93-a05b-ba972adc0390 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:46.814873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94303-bcb3-45fc-90a1-46c1f25d0300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:46.815745 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94303-bcb3-45fc-90a1-46c1f25d0300 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:46.816028 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94303-bcb3-45fc-90a1-46c1f25d0300 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:46.816304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94303-bcb3-45fc-90a1-46c1f25d0300 None admin] PATH_INFO: `/v3/groups/eb7cd5266c4a4def9325ad9e705255fb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:46.817511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae94303-bcb3-45fc-90a1-46c1f25d0300 None admin] RBAC: Authorizing `identity:get_group(group_id=eb7cd5266c4a4def9325ad9e705255fb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:46.818967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae94303-bcb3-45fc-90a1-46c1f25d0300 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:46.820585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 235/454] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Jul 15 15:11:46 2022] GET /identity/v3/groups/eb7cd5266c4a4def9325ad9e705255fb => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:46.826525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad82e2-1a94-4656-aaca-5b5db5fcb901 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:46.930756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad82e2-1a94-4656-aaca-5b5db5fcb901 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:46.945880 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:46.966947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6170c6d-7258-4a2f-b764-077da27eeacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:46.967617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6170c6d-7258-4a2f-b764-077da27eeacf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:46.967896 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6170c6d-7258-4a2f-b764-077da27eeacf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:46.968172 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6170c6d-7258-4a2f-b764-077da27eeacf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:46.969011 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6170c6d-7258-4a2f-b764-077da27eeacf None admin] RBAC: Adding query filter params (group.id=eb7cd5266c4a4def9325ad9e705255fb, role.id=f5fb67c95c834bc9b359a5141ae0f60c, scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:46.969347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6170c6d-7258-4a2f-b764-077da27eeacf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:46.970802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6170c6d-7258-4a2f-b764-077da27eeacf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:46.977544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 220/455] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Jul 15 15:11:46 2022] GET /identity/v3/role_assignments?group.id=eb7cd5266c4a4def9325ad9e705255fb&scope.project.id=ffa8c33444b7494fbfbe8ad5eadb219f&role.id=f5fb67c95c834bc9b359a5141ae0f60c => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:50.313522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a2d89-dd03-419d-8e67-132071061086 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:50.314075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a2d89-dd03-419d-8e67-132071061086 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:50.314535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a2d89-dd03-419d-8e67-132071061086 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:50.317786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 236/456] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:50.330564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c10b-c388-47f1-92ac-b95e355cd49a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:50.331581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c10b-c388-47f1-92ac-b95e355cd49a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:50.331800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c10b-c388-47f1-92ac-b95e355cd49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:50.352644 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e356c10b-c388-47f1-92ac-b95e355cd49a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:50.353892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e356c10b-c388-47f1-92ac-b95e355cd49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:50.437474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 221/457] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:50.485154 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a2d89-dd03-419d-8e67-132071061086 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:50.576308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:50.680723 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b1bc9-81e2-4901-bef2-4b82eaf57cdb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:50.681277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b1bc9-81e2-4901-bef2-4b82eaf57cdb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:50.681738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b1bc9-81e2-4901-bef2-4b82eaf57cdb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:50.683736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 222/458] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:50.689752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40107f5c-8d53-4eb3-bc35-2906fe2a596d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:50.690288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40107f5c-8d53-4eb3-bc35-2906fe2a596d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:50.691256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40107f5c-8d53-4eb3-bc35-2906fe2a596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:50.736485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-40107f5c-8d53-4eb3-bc35-2906fe2a596d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:50.738294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-40107f5c-8d53-4eb3-bc35-2906fe2a596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:50.758111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a2d89-dd03-419d-8e67-132071061086 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:50.810753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ec99c-8e4e-42ab-8437-f571673c250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:50.811557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ec99c-8e4e-42ab-8437-f571673c250f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:50.811847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ec99c-8e4e-42ab-8437-f571673c250f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:50.812127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ec99c-8e4e-42ab-8437-f571673c250f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:50.833841 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ec99c-8e4e-42ab-8437-f571673c250f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:50.835354 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ec99c-8e4e-42ab-8437-f571673c250f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-da7ec99c-8e4e-42ab-8437-f571673c250f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:11:50.874153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:50.875094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:50.875916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:11:50.875916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:11:50.875916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:50.875916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:50.875916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 237/459] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:50.882289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ec99c-8e4e-42ab-8437-f571673c250f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:50.897212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 223/460] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:50.922646 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40107f5c-8d53-4eb3-bc35-2906fe2a596d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:50.969502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:51.061471 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:51.076937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40107f5c-8d53-4eb3-bc35-2906fe2a596d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:51.095536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ec99c-8e4e-42ab-8437-f571673c250f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:51.138561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c1495-d177-4d1b-8cd9-78e195ec6450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:51.139821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c1495-d177-4d1b-8cd9-78e195ec6450 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.140281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c1495-d177-4d1b-8cd9-78e195ec6450 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.140970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c1495-d177-4d1b-8cd9-78e195ec6450 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.141869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c1495-d177-4d1b-8cd9-78e195ec6450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:51.142325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c1495-d177-4d1b-8cd9-78e195ec6450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:51.144282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c1495-d177-4d1b-8cd9-78e195ec6450 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:51.149089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e435b46-4e33-4931-a409-864390652148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:51.150449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e435b46-4e33-4931-a409-864390652148 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.150929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e435b46-4e33-4931-a409-864390652148 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.151411 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e435b46-4e33-4931-a409-864390652148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.161718 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 238/461] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:51.164690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b8b41-0946-4e27-b539-8e3c2a30c92c None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.165236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b8b41-0946-4e27-b539-8e3c2a30c92c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.165804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b8b41-0946-4e27-b539-8e3c2a30c92c None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.168540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 239/462] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:51.168705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e435b46-4e33-4931-a409-864390652148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:51.169663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b8b41-0946-4e27-b539-8e3c2a30c92c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:51.174600 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e435b46-4e33-4931-a409-864390652148 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4e435b46-4e33-4931-a409-864390652148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:11:51.195904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:51.196831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:51.197732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:11:51.197732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:11:51.197732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:51.197732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:51.197732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 224/463] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:51.198765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2b8af-1533-4d16-b514-735ebdabadb7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.199059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2b8af-1533-4d16-b514-735ebdabadb7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.199338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2b8af-1533-4d16-b514-735ebdabadb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.216807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-eef2b8af-1533-4d16-b514-735ebdabadb7 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:51.218056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eef2b8af-1533-4d16-b514-735ebdabadb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:51.285565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 225/464] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:51.286909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064df1f9-acb0-4334-9abf-d3fe123e9618 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.287198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064df1f9-acb0-4334-9abf-d3fe123e9618 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.287475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064df1f9-acb0-4334-9abf-d3fe123e9618 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.288715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 226/465] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:51.289799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e3121-c9fb-4234-8bf8-9d1918ebc3c8 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.290115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e3121-c9fb-4234-8bf8-9d1918ebc3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.290396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e3121-c9fb-4234-8bf8-9d1918ebc3c8 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.291781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 227/466] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:51.293847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e3121-c9fb-4234-8bf8-9d1918ebc3c8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:51.308646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b8b41-0946-4e27-b539-8e3c2a30c92c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:51.320242 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:51.348823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d37a7-816d-43f6-b2d7-6f84e8a9a763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:51.349444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d37a7-816d-43f6-b2d7-6f84e8a9a763 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.349729 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d37a7-816d-43f6-b2d7-6f84e8a9a763 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.350006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d37a7-816d-43f6-b2d7-6f84e8a9a763 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.350710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d37a7-816d-43f6-b2d7-6f84e8a9a763 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:51.352176 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d37a7-816d-43f6-b2d7-6f84e8a9a763 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:51.369896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:51.375296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 240/467] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:11:51 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:11:51.376765 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac1961-9c0a-4686-9997-6b4ddc9b2d64 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.377074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac1961-9c0a-4686-9997-6b4ddc9b2d64 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.377760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac1961-9c0a-4686-9997-6b4ddc9b2d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.396363 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-23ac1961-9c0a-4686-9997-6b4ddc9b2d64 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:51.397714 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-23ac1961-9c0a-4686-9997-6b4ddc9b2d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:51.419516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e3121-c9fb-4234-8bf8-9d1918ebc3c8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:51.462887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add8961-9a99-46c1-b318-564e9ac20387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:51.463584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add8961-9a99-46c1-b318-564e9ac20387 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.463872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add8961-9a99-46c1-b318-564e9ac20387 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.464179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add8961-9a99-46c1-b318-564e9ac20387 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.464976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add8961-9a99-46c1-b318-564e9ac20387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:51.465349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add8961-9a99-46c1-b318-564e9ac20387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:51.466780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add8961-9a99-46c1-b318-564e9ac20387 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:51.494371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 228/468] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:51.494371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06a0ec-45a8-4492-968b-d662e917acad None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.494371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06a0ec-45a8-4492-968b-d662e917acad None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.494371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06a0ec-45a8-4492-968b-d662e917acad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.500615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 241/469] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:51.510214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac1961-9c0a-4686-9997-6b4ddc9b2d64 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:51.519076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1e06a0ec-45a8-4492-968b-d662e917acad None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:51.520397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1e06a0ec-45a8-4492-968b-d662e917acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:51.612161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 229/470] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:51.613124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06a0ec-45a8-4492-968b-d662e917acad None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:51.641706 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:51.649418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac1961-9c0a-4686-9997-6b4ddc9b2d64 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:51.686192 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:51.696561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d9777-39a5-44cc-9365-dc68631f9225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:51.697473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d9777-39a5-44cc-9365-dc68631f9225 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.697782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d9777-39a5-44cc-9365-dc68631f9225 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.698036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d9777-39a5-44cc-9365-dc68631f9225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.709938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d9777-39a5-44cc-9365-dc68631f9225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:51.711501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d9777-39a5-44cc-9365-dc68631f9225 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ba3d9777-39a5-44cc-9365-dc68631f9225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:11:51.737383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:51.738462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:51.739408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:11:51.739408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:11:51.739408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:51.739408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:51.739408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 242/471] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:51.739408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d9777-39a5-44cc-9365-dc68631f9225 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:51.747770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06a0ec-45a8-4492-968b-d662e917acad None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:51.791824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2db08-58f5-47ee-8c2f-88db1c80960b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:51.792561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2db08-58f5-47ee-8c2f-88db1c80960b None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.792854 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2db08-58f5-47ee-8c2f-88db1c80960b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.793195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2db08-58f5-47ee-8c2f-88db1c80960b None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.793919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2db08-58f5-47ee-8c2f-88db1c80960b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:51.795413 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2db08-58f5-47ee-8c2f-88db1c80960b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:51.819168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 230/472] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:11:51 2022] POST /identity/v3/users => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:11:51.820136 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2db08-58f5-47ee-8c2f-88db1c80960b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:51.896489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d9777-39a5-44cc-9365-dc68631f9225 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:51.924087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:51.951085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477c004-ed1b-42d2-a3f4-fb2a2d595a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:51.952538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477c004-ed1b-42d2-a3f4-fb2a2d595a7e None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:51.953042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477c004-ed1b-42d2-a3f4-fb2a2d595a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:51.953603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477c004-ed1b-42d2-a3f4-fb2a2d595a7e None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:51.955604 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477c004-ed1b-42d2-a3f4-fb2a2d595a7e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:51.958726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477c004-ed1b-42d2-a3f4-fb2a2d595a7e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:51.967324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.sql.core [None req-c477c004-ed1b-42d2-a3f4-fb2a2d595a7e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 15:11:51.967324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 15 15:11:51.967324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [parameters: {'id': 'b7977d4be9e94b4bb276c9d3c5186a94', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 15 15:11:51.967324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80236) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 15:11:51.988015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2db08-58f5-47ee-8c2f-88db1c80960b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c477c004-ed1b-42d2-a3f4-fb2a2d595a7e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application conn.query(q) Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result.read() Jul 15 15:11:51.994820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return ref.to_dict() Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 15:11:51.995969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application next(self.gen) Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application yield resource Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application next(self.gen) Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise self.value Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application session.commit() Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 15:11:51.997221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.session.flush() Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application compat.raise_( Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 15:11:51.998390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 15:11:51.999579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application conn.query(q) Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result.read() Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 15:11:52.000493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [parameters: {'id': 'b7977d4be9e94b4bb276c9d3c5186a94', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:52.001557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 15 15:11:52.002693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:52.008567 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 243/473] 10.222.0.64 () {60 vars in 1131 bytes} [Fri Jul 15 15:11:51 2022] POST /identity/v3/roles => generated 144 bytes in 268 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:52.008567 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477c004-ed1b-42d2-a3f4-fb2a2d595a7e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:52.045754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bdad1-aa9b-48e4-98d0-6e5846ef6730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:52.046590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bdad1-aa9b-48e4-98d0-6e5846ef6730 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:52.046881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bdad1-aa9b-48e4-98d0-6e5846ef6730 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:52.047164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bdad1-aa9b-48e4-98d0-6e5846ef6730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:52.061179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bdad1-aa9b-48e4-98d0-6e5846ef6730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:52.062924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bdad1-aa9b-48e4-98d0-6e5846ef6730 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:52.083689 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9e1bdad1-aa9b-48e4-98d0-6e5846ef6730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:11:52.086608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:52.087767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:52.089041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:11:52.089041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:11:52.089041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:52.089041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:52.089041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 231/474] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:52.089041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bdad1-aa9b-48e4-98d0-6e5846ef6730 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:52.177243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477c004-ed1b-42d2-a3f4-fb2a2d595a7e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:52.239502 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af0a78-83fb-4d31-85cf-4a408e3ef766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:52.240373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af0a78-83fb-4d31-85cf-4a408e3ef766 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:52.240672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af0a78-83fb-4d31-85cf-4a408e3ef766 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:52.240963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af0a78-83fb-4d31-85cf-4a408e3ef766 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:52.241977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af0a78-83fb-4d31-85cf-4a408e3ef766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:52.242307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af0a78-83fb-4d31-85cf-4a408e3ef766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:52.244489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af0a78-83fb-4d31-85cf-4a408e3ef766 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:52.251684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bdad1-aa9b-48e4-98d0-6e5846ef6730 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:52.269162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 244/475] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:52.270429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af0a78-83fb-4d31-85cf-4a408e3ef766 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:52.282034 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:52.309320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05e691-ae33-4470-a713-5058ff0bcc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:52.309653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e691-ae33-4470-a713-5058ff0bcc74 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:52.309911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e691-ae33-4470-a713-5058ff0bcc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:52.310193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e691-ae33-4470-a713-5058ff0bcc74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:52.326159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05e691-ae33-4470-a713-5058ff0bcc74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3e05e691-ae33-4470-a713-5058ff0bcc74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:52.337695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:52.339504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 232/476] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:11:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:52.340887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05e691-ae33-4470-a713-5058ff0bcc74 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:52.418995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af0a78-83fb-4d31-85cf-4a408e3ef766 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:52.428358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:52.463600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40786bc2-f8f4-4de3-bc8a-1b197f70e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:52.463804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05e691-ae33-4470-a713-5058ff0bcc74 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:52.465140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40786bc2-f8f4-4de3-bc8a-1b197f70e3ef None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:52.465866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40786bc2-f8f4-4de3-bc8a-1b197f70e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:52.467259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40786bc2-f8f4-4de3-bc8a-1b197f70e3ef None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:52.468206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40786bc2-f8f4-4de3-bc8a-1b197f70e3ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:52.468741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40786bc2-f8f4-4de3-bc8a-1b197f70e3ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:52.472710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40786bc2-f8f4-4de3-bc8a-1b197f70e3ef None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:52.492991 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 245/477] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:52.494961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40786bc2-f8f4-4de3-bc8a-1b197f70e3ef None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:52.502234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeb6a7-f6ee-4dbc-8e93-42af96def3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:52.503042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeb6a7-f6ee-4dbc-8e93-42af96def3a0 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:52.503336 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeb6a7-f6ee-4dbc-8e93-42af96def3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:52.503620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeb6a7-f6ee-4dbc-8e93-42af96def3a0 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:52.504609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aeb6a7-f6ee-4dbc-8e93-42af96def3a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:52.506141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aeb6a7-f6ee-4dbc-8e93-42af96def3a0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:52.530531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 233/478] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:11:52 2022] POST /identity/v3/users => generated 249 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:11:52.535064 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeb6a7-f6ee-4dbc-8e93-42af96def3a0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:52.609546 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:52.692916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40786bc2-f8f4-4de3-bc8a-1b197f70e3ef None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:52.732564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96670ee7-ccfa-4746-83f4-60780925d5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:52.733280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96670ee7-ccfa-4746-83f4-60780925d5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:52.733572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96670ee7-ccfa-4746-83f4-60780925d5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:52.733852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96670ee7-ccfa-4746-83f4-60780925d5d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:52.734617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96670ee7-ccfa-4746-83f4-60780925d5d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:52.734945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96670ee7-ccfa-4746-83f4-60780925d5d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:52.736337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96670ee7-ccfa-4746-83f4-60780925d5d9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:52.748048 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 246/479] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:52.776144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeb6a7-f6ee-4dbc-8e93-42af96def3a0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:52.820089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d333906-7ffa-4522-a437-c9aeed997240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:52.820813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333906-7ffa-4522-a437-c9aeed997240 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:52.821161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333906-7ffa-4522-a437-c9aeed997240 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:52.821414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333906-7ffa-4522-a437-c9aeed997240 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:52.822174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d333906-7ffa-4522-a437-c9aeed997240 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:52.823734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d333906-7ffa-4522-a437-c9aeed997240 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:52.849721 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 234/480] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:11:52 2022] POST /identity/v3/users => generated 248 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:11:53.687939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef56537-e878-4ced-bda1-858ad7174eb1 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:53.688457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef56537-e878-4ced-bda1-858ad7174eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:53.688457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef56537-e878-4ced-bda1-858ad7174eb1 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:53.692889 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 247/481] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:53.699976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e969-bda3-47fe-b37a-bd1683f4af35 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:53.700480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e969-bda3-47fe-b37a-bd1683f4af35 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:53.700558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e969-bda3-47fe-b37a-bd1683f4af35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:53.726093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3ea8e969-bda3-47fe-b37a-bd1683f4af35 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:53.727333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3ea8e969-bda3-47fe-b37a-bd1683f4af35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:53.824660 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 235/482] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:53.858755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef56537-e878-4ced-bda1-858ad7174eb1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:53.904037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:54.018910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef56537-e878-4ced-bda1-858ad7174eb1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:54.077917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f5f5f-cbb1-4f5e-8f28-dae0ca790363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:54.078788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f5f5f-cbb1-4f5e-8f28-dae0ca790363 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:54.079076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f5f5f-cbb1-4f5e-8f28-dae0ca790363 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:54.079356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f5f5f-cbb1-4f5e-8f28-dae0ca790363 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:54.096916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f5f5f-cbb1-4f5e-8f28-dae0ca790363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-6e3f5f5f-cbb1-4f5e-8f28-dae0ca790363 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:54.104827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:54.105820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:54.107067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 248/483] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:11:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:54.115273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e969-bda3-47fe-b37a-bd1683f4af35 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:54.143694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:54.270479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e969-bda3-47fe-b37a-bd1683f4af35 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:54.323199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242c59a-4219-4184-8f5d-2c41936a30c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:54.323886 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242c59a-4219-4184-8f5d-2c41936a30c6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:54.324174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242c59a-4219-4184-8f5d-2c41936a30c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:54.324453 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242c59a-4219-4184-8f5d-2c41936a30c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:54.325242 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242c59a-4219-4184-8f5d-2c41936a30c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:54.325554 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242c59a-4219-4184-8f5d-2c41936a30c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:54.326967 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242c59a-4219-4184-8f5d-2c41936a30c6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:54.341102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 236/484] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:11:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:54.347828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f5f5f-cbb1-4f5e-8f28-dae0ca790363 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:54.480514 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:54.496821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f5f5f-cbb1-4f5e-8f28-dae0ca790363 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:54.550487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804847e-2116-4b96-83ac-f941b57a0367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:54.551293 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804847e-2116-4b96-83ac-f941b57a0367 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:54.551579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804847e-2116-4b96-83ac-f941b57a0367 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:54.551858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804847e-2116-4b96-83ac-f941b57a0367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:54.573831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804847e-2116-4b96-83ac-f941b57a0367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:54.575340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804847e-2116-4b96-83ac-f941b57a0367 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-6804847e-2116-4b96-83ac-f941b57a0367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:11:54.600618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:54.601706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:54.602576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:11:54.602576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:11:54.602576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:54.602576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:54.602576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 249/485] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:54.609939 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242c59a-4219-4184-8f5d-2c41936a30c6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:54.612617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61f3a5-ea9d-4e1f-9cfe-16c1a0d4e930 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:54.612914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61f3a5-ea9d-4e1f-9cfe-16c1a0d4e930 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:54.613233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61f3a5-ea9d-4e1f-9cfe-16c1a0d4e930 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:54.614739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 250/486] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:54.622963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25678565-cf86-49d1-81fa-a498de28baa3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:54.623283 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25678565-cf86-49d1-81fa-a498de28baa3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:54.623531 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25678565-cf86-49d1-81fa-a498de28baa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:54.654323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-25678565-cf86-49d1-81fa-a498de28baa3 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:54.655546 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-25678565-cf86-49d1-81fa-a498de28baa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:54.759681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:54.790051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 251/487] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:11:54.792905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242c59a-4219-4184-8f5d-2c41936a30c6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:54.829715 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25678565-cf86-49d1-81fa-a498de28baa3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:54.852742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df355c-e2d7-4d95-946c-f106f8004449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:54.853499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df355c-e2d7-4d95-946c-f106f8004449 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:54.853785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df355c-e2d7-4d95-946c-f106f8004449 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:54.854065 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df355c-e2d7-4d95-946c-f106f8004449 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:54.854944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df355c-e2d7-4d95-946c-f106f8004449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:54.855258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df355c-e2d7-4d95-946c-f106f8004449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:54.856663 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df355c-e2d7-4d95-946c-f106f8004449 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:54.877103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 237/488] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:54.890132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df355c-e2d7-4d95-946c-f106f8004449 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:54.949631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:55.021491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25678565-cf86-49d1-81fa-a498de28baa3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:55.071931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21960431-11c0-4a26-a7a5-7ae3d188c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:55.074512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21960431-11c0-4a26-a7a5-7ae3d188c85e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.075058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21960431-11c0-4a26-a7a5-7ae3d188c85e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.076571 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21960431-11c0-4a26-a7a5-7ae3d188c85e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.104098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21960431-11c0-4a26-a7a5-7ae3d188c85e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-21960431-11c0-4a26-a7a5-7ae3d188c85e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:55.126577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:55.128105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:55.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:55.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:55.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:55.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:55.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:55.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:55.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:55.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:55.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:55.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:55.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:11:55.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:55.141279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 252/489] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:11:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:11:55.148341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21960431-11c0-4a26-a7a5-7ae3d188c85e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:55.151804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df355c-e2d7-4d95-946c-f106f8004449 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:55.197266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea62f1-837e-47df-b0e6-bd9e71cc530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:55.198562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea62f1-837e-47df-b0e6-bd9e71cc530c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.199064 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea62f1-837e-47df-b0e6-bd9e71cc530c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.199597 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea62f1-837e-47df-b0e6-bd9e71cc530c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.208838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea62f1-837e-47df-b0e6-bd9e71cc530c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:55.210858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea62f1-837e-47df-b0e6-bd9e71cc530c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-38ea62f1-837e-47df-b0e6-bd9e71cc530c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:11:55.229127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:55.230088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:55.231238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:55.231238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:55.231238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:11:55.231238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:11:55.231238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:11:55.231238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:11:55.231238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:11:55.231238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:11:55.231238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 15:11:55.231238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:55.234089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 238/490] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:55.240482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea62f1-837e-47df-b0e6-bd9e71cc530c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:55.243972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:55.300836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21960431-11c0-4a26-a7a5-7ae3d188c85e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:55.339172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:55.354916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305daf0-705c-4124-a18d-7b7af3d89027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:55.355606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305daf0-705c-4124-a18d-7b7af3d89027 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.355892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305daf0-705c-4124-a18d-7b7af3d89027 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.356168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305daf0-705c-4124-a18d-7b7af3d89027 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.356953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305daf0-705c-4124-a18d-7b7af3d89027 None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:55.357288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305daf0-705c-4124-a18d-7b7af3d89027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:55.358894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305daf0-705c-4124-a18d-7b7af3d89027 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:55.371073 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 253/491] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:11:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:55.378980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305daf0-705c-4124-a18d-7b7af3d89027 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:55.429403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea62f1-837e-47df-b0e6-bd9e71cc530c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:55.466488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a68f10-8225-4350-91be-93fafd3f5389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:55.467669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a68f10-8225-4350-91be-93fafd3f5389 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.468151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a68f10-8225-4350-91be-93fafd3f5389 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.468623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a68f10-8225-4350-91be-93fafd3f5389 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.469731 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a68f10-8225-4350-91be-93fafd3f5389 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:55.470325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a68f10-8225-4350-91be-93fafd3f5389 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:55.472613 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a68f10-8225-4350-91be-93fafd3f5389 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:55.514750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 239/492] 10.222.0.64 () {56 vars in 1137 bytes} [Fri Jul 15 15:11:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:11:55.521272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491f81-e30c-4876-af73-9666009cee94 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.521989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491f81-e30c-4876-af73-9666009cee94 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.522472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491f81-e30c-4876-af73-9666009cee94 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.524194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 240/493] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:55.525175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9491f81-e30c-4876-af73-9666009cee94 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:55.590554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305daf0-705c-4124-a18d-7b7af3d89027 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:55.609634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:55.645902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cd6ff-7685-4118-9de7-9eecaf7490ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:55.646721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cd6ff-7685-4118-9de7-9eecaf7490ab None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.647006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cd6ff-7685-4118-9de7-9eecaf7490ab None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.647285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cd6ff-7685-4118-9de7-9eecaf7490ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.659341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cd6ff-7685-4118-9de7-9eecaf7490ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:55.660812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cd6ff-7685-4118-9de7-9eecaf7490ab None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:55.661689 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9491f81-e30c-4876-af73-9666009cee94 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-e81cd6ff-7685-4118-9de7-9eecaf7490ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:11:55.681023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:55.682066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:55.682928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:11:55.682928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:11:55.682928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:55.682928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:55.682928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 254/494] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:55.686414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b5765-02ae-4b76-b495-162d6c7eb03c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.686803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b5765-02ae-4b76-b495-162d6c7eb03c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.687083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b5765-02ae-4b76-b495-162d6c7eb03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.701390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602d0fc-e709-4556-aed9-5354b3130e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:55.702195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602d0fc-e709-4556-aed9-5354b3130e1b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.702562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602d0fc-e709-4556-aed9-5354b3130e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.702924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602d0fc-e709-4556-aed9-5354b3130e1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.704754 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-012b5765-02ae-4b76-b495-162d6c7eb03c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:55.706510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-012b5765-02ae-4b76-b495-162d6c7eb03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:55.751261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:55.776785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602d0fc-e709-4556-aed9-5354b3130e1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:55.778299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602d0fc-e709-4556-aed9-5354b3130e1b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:55.781896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 255/495] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:55.783252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e2aa0-78f5-4863-a96c-1a9d64b735bd None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.783543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e2aa0-78f5-4863-a96c-1a9d64b735bd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.784449 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e2aa0-78f5-4863-a96c-1a9d64b735bd None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.786065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 256/496] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:55.790711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86640cd-88b7-4ecf-a270-8684a1ba4097 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.791268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86640cd-88b7-4ecf-a270-8684a1ba4097 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.791268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86640cd-88b7-4ecf-a270-8684a1ba4097 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.792587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 257/497] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:55.793570 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86640cd-88b7-4ecf-a270-8684a1ba4097 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:55.851975 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:55.897416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86640cd-88b7-4ecf-a270-8684a1ba4097 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:55.898155 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 241/498] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:55.899497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0fcd6-a1aa-438c-bc85-f615139be569 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.899790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0fcd6-a1aa-438c-bc85-f615139be569 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.900069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0fcd6-a1aa-438c-bc85-f615139be569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.918132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-54c0fcd6-a1aa-438c-bc85-f615139be569 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:55.919343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-54c0fcd6-a1aa-438c-bc85-f615139be569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:55.936045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc70eb-29cf-49dc-961f-d7f5e9a3f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:55.936725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc70eb-29cf-49dc-961f-d7f5e9a3f5ec None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.937022 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc70eb-29cf-49dc-961f-d7f5e9a3f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.937341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc70eb-29cf-49dc-961f-d7f5e9a3f5ec None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.938071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc70eb-29cf-49dc-961f-d7f5e9a3f5ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:55.938383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc70eb-29cf-49dc-961f-d7f5e9a3f5ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:55.939797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc70eb-29cf-49dc-961f-d7f5e9a3f5ec None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:55.951514 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 258/499] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:55.952834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5673c-eb9d-43f3-8ede-1daf37c80b0e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:55.953156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5673c-eb9d-43f3-8ede-1daf37c80b0e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:55.953444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5673c-eb9d-43f3-8ede-1daf37c80b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:55.970677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d5a5673c-eb9d-43f3-8ede-1daf37c80b0e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:55.972586 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d5a5673c-eb9d-43f3-8ede-1daf37c80b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:56.000300 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 242/500] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:56.001201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0fcd6-a1aa-438c-bc85-f615139be569 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:56.002762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:56.056074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 259/501] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:56.056935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5673c-eb9d-43f3-8ede-1daf37c80b0e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:56.105012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:56.116882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0fcd6-a1aa-438c-bc85-f615139be569 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:56.167029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ab929-bb43-423f-9ea5-b37005aa36bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:56.168275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ab929-bb43-423f-9ea5-b37005aa36bb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:56.168741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ab929-bb43-423f-9ea5-b37005aa36bb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:56.169231 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ab929-bb43-423f-9ea5-b37005aa36bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:56.185970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ab929-bb43-423f-9ea5-b37005aa36bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:56.188575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ab929-bb43-423f-9ea5-b37005aa36bb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:56.197653 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5673c-eb9d-43f3-8ede-1daf37c80b0e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-fc2ab929-bb43-423f-9ea5-b37005aa36bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:11:56.220212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:56.221157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:56.221989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:11:56.221989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:11:56.221989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:56.221989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:56.222458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 243/502] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:56.223636 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ab929-bb43-423f-9ea5-b37005aa36bb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:56.245377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56167c25-a354-4c7e-90fc-4d43f0ac4a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:56.246172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56167c25-a354-4c7e-90fc-4d43f0ac4a61 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:56.246457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56167c25-a354-4c7e-90fc-4d43f0ac4a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:56.246730 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56167c25-a354-4c7e-90fc-4d43f0ac4a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:56.257878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56167c25-a354-4c7e-90fc-4d43f0ac4a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:56.259350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56167c25-a354-4c7e-90fc-4d43f0ac4a61 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-56167c25-a354-4c7e-90fc-4d43f0ac4a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:11:56.278060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:56.279161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:56.280108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:11:56.280108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:11:56.280108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:56.280108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:56.280108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 260/503] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:56.280503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56167c25-a354-4c7e-90fc-4d43f0ac4a61 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:56.299274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:56.337510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ab929-bb43-423f-9ea5-b37005aa36bb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:56.375137 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a3240-a8b9-44d7-93bd-e054ba348ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:56.375828 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a3240-a8b9-44d7-93bd-e054ba348ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:56.376116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a3240-a8b9-44d7-93bd-e054ba348ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:56.376519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a3240-a8b9-44d7-93bd-e054ba348ea8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:56.389385 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a3240-a8b9-44d7-93bd-e054ba348ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:56.391490 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a3240-a8b9-44d7-93bd-e054ba348ea8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:56.397590 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56167c25-a354-4c7e-90fc-4d43f0ac4a61 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-605a3240-a8b9-44d7-93bd-e054ba348ea8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:11:56.416184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:56.418150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:56.419714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:56.419714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:56.419714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:11:56.419714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:11:56.419714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:11:56.419714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:11:56.419714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:11:56.419714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:11:56.419714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:11:56.419714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:56.419714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 244/504] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Jul 15 15:11:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:56.419714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a3240-a8b9-44d7-93bd-e054ba348ea8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:56.423188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:56.446695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7a430-fd36-461b-b0db-0773d1994365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:56.447496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7a430-fd36-461b-b0db-0773d1994365 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:56.447778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7a430-fd36-461b-b0db-0773d1994365 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:56.448052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7a430-fd36-461b-b0db-0773d1994365 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:56.461414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7a430-fd36-461b-b0db-0773d1994365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-67f7a430-fd36-461b-b0db-0773d1994365 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:56.469311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:56.470664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:56.471508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:56.471508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:56.471508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:56.471508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:56.471508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:56.471508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:56.471508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:56.471508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:56.471508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:56.471508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:56.471508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:11:56.471508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:56.476676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 261/505] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:56.479368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7a430-fd36-461b-b0db-0773d1994365 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:56.538747 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a3240-a8b9-44d7-93bd-e054ba348ea8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:56.570407 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:56.576482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d589-ef5a-4786-b230-b845453a820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:56.577352 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d589-ef5a-4786-b230-b845453a820e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:56.577649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d589-ef5a-4786-b230-b845453a820e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:56.577918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d589-ef5a-4786-b230-b845453a820e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:56.588869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69d589-ef5a-4786-b230-b845453a820e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:11:56.594245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7a430-fd36-461b-b0db-0773d1994365 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8b69d589-ef5a-4786-b230-b845453a820e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:11:56.597048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:56.598202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 245/506] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:56.604144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d589-ef5a-4786-b230-b845453a820e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:56.639399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d504b67-d44d-4a41-9a76-b945126c004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:56.639998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d504b67-d44d-4a41-9a76-b945126c004a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:56.640288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d504b67-d44d-4a41-9a76-b945126c004a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:56.640571 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d504b67-d44d-4a41-9a76-b945126c004a None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:56.641338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d504b67-d44d-4a41-9a76-b945126c004a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:56.641651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d504b67-d44d-4a41-9a76-b945126c004a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:56.643078 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d504b67-d44d-4a41-9a76-b945126c004a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:56.657435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 262/507] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:56.658291 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d504b67-d44d-4a41-9a76-b945126c004a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:56.676921 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:56.721344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d589-ef5a-4786-b230-b845453a820e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:56.760325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00b59-9375-4277-aa38-95a1dc53c7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:56.760998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00b59-9375-4277-aa38-95a1dc53c7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:56.761614 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00b59-9375-4277-aa38-95a1dc53c7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:56.761982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00b59-9375-4277-aa38-95a1dc53c7a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:56.762615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa00b59-9375-4277-aa38-95a1dc53c7a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:56.762926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa00b59-9375-4277-aa38-95a1dc53c7a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:56.764337 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa00b59-9375-4277-aa38-95a1dc53c7a9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:56.771486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d504b67-d44d-4a41-9a76-b945126c004a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:56.776286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 246/508] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:56.777154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00b59-9375-4277-aa38-95a1dc53c7a9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:56.810496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4eda6-d4a3-4e6f-9b9f-8044bf6c5067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:56.811182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4eda6-d4a3-4e6f-9b9f-8044bf6c5067 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:56.811485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4eda6-d4a3-4e6f-9b9f-8044bf6c5067 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:56.811767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4eda6-d4a3-4e6f-9b9f-8044bf6c5067 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:56.812890 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4eda6-d4a3-4e6f-9b9f-8044bf6c5067 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:56.813003 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4eda6-d4a3-4e6f-9b9f-8044bf6c5067 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:56.816226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4eda6-d4a3-4e6f-9b9f-8044bf6c5067 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:56.826188 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:56.854797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 263/509] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Jul 15 15:11:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:56.855657 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4eda6-d4a3-4e6f-9b9f-8044bf6c5067 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:56.887199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00b59-9375-4277-aa38-95a1dc53c7a9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:56.910737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:56.929376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d33aa-d27c-4756-9743-47af614b1c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:56.930119 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d33aa-d27c-4756-9743-47af614b1c1e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:56.930406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d33aa-d27c-4756-9743-47af614b1c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:56.930690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d33aa-d27c-4756-9743-47af614b1c1e None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:56.931459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d33aa-d27c-4756-9743-47af614b1c1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:56.931882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d33aa-d27c-4756-9743-47af614b1c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:56.933332 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d33aa-d27c-4756-9743-47af614b1c1e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:56.942190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 247/510] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:11:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:56.942908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d33aa-d27c-4756-9743-47af614b1c1e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:56.976208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4eda6-d4a3-4e6f-9b9f-8044bf6c5067 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:57.012507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282f62c-9dca-478b-a0f8-eb32b54102f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:57.013219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282f62c-9dca-478b-a0f8-eb32b54102f5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:57.013500 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282f62c-9dca-478b-a0f8-eb32b54102f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:57.013778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282f62c-9dca-478b-a0f8-eb32b54102f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:57.014536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282f62c-9dca-478b-a0f8-eb32b54102f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:57.014845 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282f62c-9dca-478b-a0f8-eb32b54102f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:57.016245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282f62c-9dca-478b-a0f8-eb32b54102f5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:57.024818 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 264/511] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:11:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:57.025686 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282f62c-9dca-478b-a0f8-eb32b54102f5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:57.057798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d33aa-d27c-4756-9743-47af614b1c1e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:57.097045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41e06a-17ba-4518-97d3-72cd86a8203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:57.097976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41e06a-17ba-4518-97d3-72cd86a8203a None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:57.098085 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41e06a-17ba-4518-97d3-72cd86a8203a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:57.098288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41e06a-17ba-4518-97d3-72cd86a8203a None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:57.099003 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41e06a-17ba-4518-97d3-72cd86a8203a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:57.100231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:57.100485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41e06a-17ba-4518-97d3-72cd86a8203a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:57.122584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 248/512] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:11:56 2022] POST /identity/v3/users => generated 247 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:11:57.123444 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41e06a-17ba-4518-97d3-72cd86a8203a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:57.167472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282f62c-9dca-478b-a0f8-eb32b54102f5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:57.185345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:57.222000 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ecdda-2b19-444f-8a94-f21e2791a7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:57.222952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ecdda-2b19-444f-8a94-f21e2791a7cb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:57.223239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ecdda-2b19-444f-8a94-f21e2791a7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:57.223515 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ecdda-2b19-444f-8a94-f21e2791a7cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:57.234075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ecdda-2b19-444f-8a94-f21e2791a7cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:57.235639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ecdda-2b19-444f-8a94-f21e2791a7cb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-381ecdda-2b19-444f-8a94-f21e2791a7cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:11:57.253450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:57.254753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:57.255817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:11:57.255817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:11:57.255817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:11:57.255817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:11:57.255817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:11:57.255817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:11:57.255817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:11:57.255817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:57.255817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 265/513] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:57.256484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ecdda-2b19-444f-8a94-f21e2791a7cb None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:57.286873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41e06a-17ba-4518-97d3-72cd86a8203a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:57.339697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583c46-3931-410a-85b4-5c871c3f3959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:57.340376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583c46-3931-410a-85b4-5c871c3f3959 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:57.340667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583c46-3931-410a-85b4-5c871c3f3959 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:57.340949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583c46-3931-410a-85b4-5c871c3f3959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:57.390887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ecdda-2b19-444f-8a94-f21e2791a7cb None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:57.412869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:57.440595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4583c46-3931-410a-85b4-5c871c3f3959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:57.442042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4583c46-3931-410a-85b4-5c871c3f3959 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:57.446898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8b876-1396-49b3-8b5e-95c379c42ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:57.447727 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8b876-1396-49b3-8b5e-95c379c42ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:57.448018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8b876-1396-49b3-8b5e-95c379c42ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:57.448301 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8b876-1396-49b3-8b5e-95c379c42ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:57.466022 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8b876-1396-49b3-8b5e-95c379c42ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:57.467545 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8b876-1396-49b3-8b5e-95c379c42ca1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:57.495997 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-42d8b876-1396-49b3-8b5e-95c379c42ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:11:57.497199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:57.498278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:57.499522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:11:57.499522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:11:57.499522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:57.499522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:57.501232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 266/514] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:57.503099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8b876-1396-49b3-8b5e-95c379c42ca1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:57.582981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 249/515] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:57.584285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583c46-3931-410a-85b4-5c871c3f3959 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:57.657461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8b876-1396-49b3-8b5e-95c379c42ca1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:57.711551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fdbe7-83e7-4784-ac20-f3607801e5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:57.712951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fdbe7-83e7-4784-ac20-f3607801e5ec None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:57.713530 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fdbe7-83e7-4784-ac20-f3607801e5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:57.713973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fdbe7-83e7-4784-ac20-f3607801e5ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:57.729024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fdbe7-83e7-4784-ac20-f3607801e5ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:57.730570 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fdbe7-83e7-4784-ac20-f3607801e5ec None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:57.736025 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583c46-3931-410a-85b4-5c871c3f3959 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-9e2fdbe7-83e7-4784-ac20-f3607801e5ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:11:57.755241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:57.756322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:57.757337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:11:57.757337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:11:57.757337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:57.757337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:57.757337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 267/516] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:57.757337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fdbe7-83e7-4784-ac20-f3607801e5ec None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:57.784434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:57.787473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7402b-2f3f-4c38-96fb-3146211d2f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:57.788204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7402b-2f3f-4c38-96fb-3146211d2f97 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:57.788423 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7402b-2f3f-4c38-96fb-3146211d2f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:57.788701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7402b-2f3f-4c38-96fb-3146211d2f97 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:57.789542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7402b-2f3f-4c38-96fb-3146211d2f97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:57.789858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7402b-2f3f-4c38-96fb-3146211d2f97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:57.793407 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7402b-2f3f-4c38-96fb-3146211d2f97 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:57.806803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:57.817551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 250/517] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:11:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:57.818771 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7402b-2f3f-4c38-96fb-3146211d2f97 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:57.890043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fdbe7-83e7-4784-ac20-f3607801e5ec None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:57.929707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5b6c9-dfdf-41d1-99b2-93c10421d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:57.930361 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5b6c9-dfdf-41d1-99b2-93c10421d687 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:57.930644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5b6c9-dfdf-41d1-99b2-93c10421d687 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:57.930926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5b6c9-dfdf-41d1-99b2-93c10421d687 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:57.931681 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5b6c9-dfdf-41d1-99b2-93c10421d687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:57.931988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5b6c9-dfdf-41d1-99b2-93c10421d687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:57.933556 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5b6c9-dfdf-41d1-99b2-93c10421d687 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:57.952602 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 268/518] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:57.952602 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5b6c9-dfdf-41d1-99b2-93c10421d687 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:57.952992 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7402b-2f3f-4c38-96fb-3146211d2f97 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:58.003756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a095c-9034-43ec-b7e7-daa34d1d7dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:58.004732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a095c-9034-43ec-b7e7-daa34d1d7dcb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:58.005015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a095c-9034-43ec-b7e7-daa34d1d7dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:58.005319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a095c-9034-43ec-b7e7-daa34d1d7dcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:58.018971 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a095c-9034-43ec-b7e7-daa34d1d7dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:58.022005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a095c-9034-43ec-b7e7-daa34d1d7dcb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c52a095c-9034-43ec-b7e7-daa34d1d7dcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:11:58.042329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:58.043872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:58.045859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:11:58.045859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:11:58.045859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:58.045859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:11:58.045859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 251/519] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:58.045859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a095c-9034-43ec-b7e7-daa34d1d7dcb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:58.060413 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:58.091165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5b6c9-dfdf-41d1-99b2-93c10421d687 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:58.120018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:58.140357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6079d-888e-49aa-88b3-a5e0485387e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:58.141306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6079d-888e-49aa-88b3-a5e0485387e2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:58.141793 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6079d-888e-49aa-88b3-a5e0485387e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:58.142498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6079d-888e-49aa-88b3-a5e0485387e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:58.143297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6079d-888e-49aa-88b3-a5e0485387e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:58.143870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6079d-888e-49aa-88b3-a5e0485387e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:58.145535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6079d-888e-49aa-88b3-a5e0485387e2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:58.166541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 269/520] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:58.172210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6079d-888e-49aa-88b3-a5e0485387e2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:58.187295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a095c-9034-43ec-b7e7-daa34d1d7dcb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:58.235048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c12e6-c74b-41a0-ad6a-3ce1f69c281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:58.235844 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c12e6-c74b-41a0-ad6a-3ce1f69c281b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:58.236324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c12e6-c74b-41a0-ad6a-3ce1f69c281b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:58.237353 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c12e6-c74b-41a0-ad6a-3ce1f69c281b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:58.238739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c12e6-c74b-41a0-ad6a-3ce1f69c281b None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=a87a4ae82b1b4619b90f9ad0f3dea5c3) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:58.239058 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c12e6-c74b-41a0-ad6a-3ce1f69c281b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:58.240527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c12e6-c74b-41a0-ad6a-3ce1f69c281b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:58.257182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 252/521] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:58 2022] GET /identity/v3/role_assignments?user.id=a87a4ae82b1b4619b90f9ad0f3dea5c3&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:58.257182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c12e6-c74b-41a0-ad6a-3ce1f69c281b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:58.328981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6079d-888e-49aa-88b3-a5e0485387e2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:58.387522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52a33f-0f52-4127-8b64-481ddd42b716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:58.388846 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52a33f-0f52-4127-8b64-481ddd42b716 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:58.389265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52a33f-0f52-4127-8b64-481ddd42b716 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:58.389888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52a33f-0f52-4127-8b64-481ddd42b716 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:58.401240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52a33f-0f52-4127-8b64-481ddd42b716 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:58.402963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52a33f-0f52-4127-8b64-481ddd42b716 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:58.403131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c12e6-c74b-41a0-ad6a-3ce1f69c281b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:58.407723 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-5b52a33f-0f52-4127-8b64-481ddd42b716 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:11:58.428084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:58.429272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:58.430373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:58.430373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:58.430373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:11:58.430373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:11:58.430373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:11:58.430373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:11:58.430373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:11:58.430373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:11:58.430373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 15:11:58.430373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:58.430373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 270/522] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:11:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:58.430373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52a33f-0f52-4127-8b64-481ddd42b716 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:58.434276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:58.462466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec008bbf-72b4-4f19-b5b5-41f4a7c92772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:58.463160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec008bbf-72b4-4f19-b5b5-41f4a7c92772 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:58.463509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec008bbf-72b4-4f19-b5b5-41f4a7c92772 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:58.463798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec008bbf-72b4-4f19-b5b5-41f4a7c92772 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:58.464545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec008bbf-72b4-4f19-b5b5-41f4a7c92772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:58.464857 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec008bbf-72b4-4f19-b5b5-41f4a7c92772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:58.466317 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec008bbf-72b4-4f19-b5b5-41f4a7c92772 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:58.486443 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 253/523] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:58.488875 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec008bbf-72b4-4f19-b5b5-41f4a7c92772 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:58.581157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52a33f-0f52-4127-8b64-481ddd42b716 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:58.637682 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cd727-2bc9-4b7b-94f5-cb0886dde885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:58.639554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cd727-2bc9-4b7b-94f5-cb0886dde885 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:58.640049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cd727-2bc9-4b7b-94f5-cb0886dde885 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:58.640512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cd727-2bc9-4b7b-94f5-cb0886dde885 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:58.642405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec008bbf-72b4-4f19-b5b5-41f4a7c92772 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:58.650993 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cd727-2bc9-4b7b-94f5-cb0886dde885 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:58.652791 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cd727-2bc9-4b7b-94f5-cb0886dde885 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-580cd727-2bc9-4b7b-94f5-cb0886dde885 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:11:58.672289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:58.673333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:58.674807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:58.674807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:58.674807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:11:58.674807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:11:58.674807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:11:58.674807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:11:58.674807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:11:58.674807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:11:58.674807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:11:58.674807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:58.678013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 271/524] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:11:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:58.679170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cd727-2bc9-4b7b-94f5-cb0886dde885 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:58.699376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75751a3b-109b-47bb-bf3e-93e8e9bb1255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:58.700471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75751a3b-109b-47bb-bf3e-93e8e9bb1255 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:58.701017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75751a3b-109b-47bb-bf3e-93e8e9bb1255 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:58.701521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75751a3b-109b-47bb-bf3e-93e8e9bb1255 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:58.703149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75751a3b-109b-47bb-bf3e-93e8e9bb1255 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:58.703701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75751a3b-109b-47bb-bf3e-93e8e9bb1255 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:58.706314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75751a3b-109b-47bb-bf3e-93e8e9bb1255 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:58.730593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 254/525] 10.222.0.64 () {56 vars in 1139 bytes} [Fri Jul 15 15:11:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:58.732121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75751a3b-109b-47bb-bf3e-93e8e9bb1255 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:58.788454 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:58.793136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:58.844907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cd727-2bc9-4b7b-94f5-cb0886dde885 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:58.883019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75751a3b-109b-47bb-bf3e-93e8e9bb1255 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:58.898074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d550929-191e-49f4-b845-5438d5d6c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:58.899164 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d550929-191e-49f4-b845-5438d5d6c090 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:58.899459 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d550929-191e-49f4-b845-5438d5d6c090 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:58.899924 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d550929-191e-49f4-b845-5438d5d6c090 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:58.911505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d550929-191e-49f4-b845-5438d5d6c090 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:58.914636 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d550929-191e-49f4-b845-5438d5d6c090 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:58.926422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171cd3c-a14b-4d5b-92a1-b603041a8e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:58.927227 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171cd3c-a14b-4d5b-92a1-b603041a8e00 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:58.927584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171cd3c-a14b-4d5b-92a1-b603041a8e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:58.927934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171cd3c-a14b-4d5b-92a1-b603041a8e00 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:58.928867 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171cd3c-a14b-4d5b-92a1-b603041a8e00 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:58.929270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171cd3c-a14b-4d5b-92a1-b603041a8e00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:58.930836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171cd3c-a14b-4d5b-92a1-b603041a8e00 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-6d550929-191e-49f4-b845-5438d5d6c090 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:11:58.935598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:58.936536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:58.938080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:11:58.938080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:11:58.938080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:11:58.938080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:11:58.938080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:11:58.938080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:11:58.938080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:11:58.938080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:58.938080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 272/526] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:58.938813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d550929-191e-49f4-b845-5438d5d6c090 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:58.966286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 255/527] 10.222.0.64 () {56 vars in 1137 bytes} [Fri Jul 15 15:11:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:58.967324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171cd3c-a14b-4d5b-92a1-b603041a8e00 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:59.064638 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d550929-191e-49f4-b845-5438d5d6c090 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:59.088173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:59.089878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:59.106466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171cd3c-a14b-4d5b-92a1-b603041a8e00 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:59.119901 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c9b7e-8b59-4a35-85dd-0e25936186c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:59.123014 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c9b7e-8b59-4a35-85dd-0e25936186c6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:59.125334 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c9b7e-8b59-4a35-85dd-0e25936186c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:59.126393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c9b7e-8b59-4a35-85dd-0e25936186c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:59.162018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5b0da-d9d1-43d9-abaa-fb6122c3ae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:59.163524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5b0da-d9d1-43d9-abaa-fb6122c3ae75 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:59.163656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5b0da-d9d1-43d9-abaa-fb6122c3ae75 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:59.163986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5b0da-d9d1-43d9-abaa-fb6122c3ae75 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:59.165401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5b0da-d9d1-43d9-abaa-fb6122c3ae75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:59.166007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5b0da-d9d1-43d9-abaa-fb6122c3ae75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:59.168533 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5b0da-d9d1-43d9-abaa-fb6122c3ae75 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:59.197725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 256/528] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:59.199362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5b0da-d9d1-43d9-abaa-fb6122c3ae75 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:59.231321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c9b7e-8b59-4a35-85dd-0e25936186c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:59.233761 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c9b7e-8b59-4a35-85dd-0e25936186c6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:59.350914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5b0da-d9d1-43d9-abaa-fb6122c3ae75 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:59.398502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fea9ea-a013-456e-9a15-b9f7ff293991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:59.399077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea9ea-a013-456e-9a15-b9f7ff293991 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:59.399367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea9ea-a013-456e-9a15-b9f7ff293991 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:59.399651 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea9ea-a013-456e-9a15-b9f7ff293991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:59.403878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 273/529] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:59.405117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c9b7e-8b59-4a35-85dd-0e25936186c6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:59.430764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:59.434950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:59.509015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fea9ea-a013-456e-9a15-b9f7ff293991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:59.510548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fea9ea-a013-456e-9a15-b9f7ff293991 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:59.548395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c9b7e-8b59-4a35-85dd-0e25936186c6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:59.613789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6eeab6-61e1-4d03-af49-937410c3f0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:59.614472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eeab6-61e1-4d03-af49-937410c3f0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:59.614763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eeab6-61e1-4d03-af49-937410c3f0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:59.615047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eeab6-61e1-4d03-af49-937410c3f0a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:59.616510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6eeab6-61e1-4d03-af49-937410c3f0a5 None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=b022a37031b940c3bd67861373926e58) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:11:59.616837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6eeab6-61e1-4d03-af49-937410c3f0a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:59.618751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6eeab6-61e1-4d03-af49-937410c3f0a5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:59.636759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 274/530] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:11:59 2022] GET /identity/v3/role_assignments?user.id=b022a37031b940c3bd67861373926e58&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:11:59.636759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f398-8a80-4869-8bec-0135b96179f5 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:59.636759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f398-8a80-4869-8bec-0135b96179f5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:59.636759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f398-8a80-4869-8bec-0135b96179f5 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:59.636759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 275/531] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:11:59.636759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f398-8a80-4869-8bec-0135b96179f5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:59.668182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 257/532] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:11:59.670091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb50ab-c6d9-4398-bcd1-b515d222f167 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:59.670390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb50ab-c6d9-4398-bcd1-b515d222f167 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:59.670676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb50ab-c6d9-4398-bcd1-b515d222f167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:59.696711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-70eb50ab-c6d9-4398-bcd1-b515d222f167 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:11:59.698690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-70eb50ab-c6d9-4398-bcd1-b515d222f167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:11:59.777615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:59.780077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:11:59.817709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 258/533] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:11:59.818767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb50ab-c6d9-4398-bcd1-b515d222f167 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:59.820108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f398-8a80-4869-8bec-0135b96179f5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:11:59.867719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c778ce6-e661-4bed-b524-e5ddad6dfc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:11:59.869827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c778ce6-e661-4bed-b524-e5ddad6dfc1d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:11:59.870109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c778ce6-e661-4bed-b524-e5ddad6dfc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:11:59.870396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c778ce6-e661-4bed-b524-e5ddad6dfc1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:11:59.887387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c778ce6-e661-4bed-b524-e5ddad6dfc1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:11:59.890236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c778ce6-e661-4bed-b524-e5ddad6dfc1d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-0c778ce6-e661-4bed-b524-e5ddad6dfc1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:11:59.914318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:11:59.915768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:11:59.916783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:11:59.916783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:11:59.916783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:11:59.916783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:11:59.916783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 276/534] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:11:59.917106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c778ce6-e661-4bed-b524-e5ddad6dfc1d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:11:59.972769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb50ab-c6d9-4398-bcd1-b515d222f167 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:00.021222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe9955-72e8-493a-a40d-894e9a3a05e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:00.023064 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9955-72e8-493a-a40d-894e9a3a05e5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:00.023064 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9955-72e8-493a-a40d-894e9a3a05e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:00.023482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9955-72e8-493a-a40d-894e9a3a05e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:00.036053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe9955-72e8-493a-a40d-894e9a3a05e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:00.037997 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe9955-72e8-493a-a40d-894e9a3a05e5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b3fe9955-72e8-493a-a40d-894e9a3a05e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:00.060624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:00.061627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:00.062477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:00.062477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:00.062477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:00.062477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:00.062477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 259/535] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:00.063225 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe9955-72e8-493a-a40d-894e9a3a05e5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:00.065093 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c778ce6-e661-4bed-b524-e5ddad6dfc1d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:00.108031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:00.122444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527a1f4-6f84-408c-8d57-a159bb9c2e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:00.124173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527a1f4-6f84-408c-8d57-a159bb9c2e81 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:00.124676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527a1f4-6f84-408c-8d57-a159bb9c2e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:00.125220 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527a1f4-6f84-408c-8d57-a159bb9c2e81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:00.131546 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:00.149638 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527a1f4-6f84-408c-8d57-a159bb9c2e81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-4527a1f4-6f84-408c-8d57-a159bb9c2e81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:00.164321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:00.165858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:00.166676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:00.166676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:00.166676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:00.166676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:00.166676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:00.166676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:00.166676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:00.166676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:00.166676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:00.166676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:00.166676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:00.166676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:00.170446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 277/536] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:00.172427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527a1f4-6f84-408c-8d57-a159bb9c2e81 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:00.202107 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe9955-72e8-493a-a40d-894e9a3a05e5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:00.248186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1fb21-60f9-4c31-9e58-1270a3185108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:00.248463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1fb21-60f9-4c31-9e58-1270a3185108 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:00.248807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1fb21-60f9-4c31-9e58-1270a3185108 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:00.249258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1fb21-60f9-4c31-9e58-1270a3185108 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:00.250192 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1fb21-60f9-4c31-9e58-1270a3185108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:00.250619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1fb21-60f9-4c31-9e58-1270a3185108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:00.254977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1fb21-60f9-4c31-9e58-1270a3185108 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:00.282626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 260/537] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:00.284299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1fb21-60f9-4c31-9e58-1270a3185108 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:00.328036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527a1f4-6f84-408c-8d57-a159bb9c2e81 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:00.381117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb5714-4df6-4723-8ce8-e04331355651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:00.382502 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb5714-4df6-4723-8ce8-e04331355651 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:00.383242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb5714-4df6-4723-8ce8-e04331355651 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:00.383665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb5714-4df6-4723-8ce8-e04331355651 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:00.384802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb5714-4df6-4723-8ce8-e04331355651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:00.385299 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb5714-4df6-4723-8ce8-e04331355651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:00.387199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb5714-4df6-4723-8ce8-e04331355651 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:00.394887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:00.404667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1fb21-60f9-4c31-9e58-1270a3185108 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:00.406657 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 278/538] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:00.408758 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb5714-4df6-4723-8ce8-e04331355651 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:00.445712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344567a-a41d-40ca-8730-2fd8d313da17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:00.446664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344567a-a41d-40ca-8730-2fd8d313da17 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:00.447057 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344567a-a41d-40ca-8730-2fd8d313da17 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:00.447658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344567a-a41d-40ca-8730-2fd8d313da17 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:00.448469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344567a-a41d-40ca-8730-2fd8d313da17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:00.448888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344567a-a41d-40ca-8730-2fd8d313da17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:00.450483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344567a-a41d-40ca-8730-2fd8d313da17 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:00.461443 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 261/539] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:00.462700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344567a-a41d-40ca-8730-2fd8d313da17 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:00.480624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:00.547534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb5714-4df6-4723-8ce8-e04331355651 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:00.589473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344567a-a41d-40ca-8730-2fd8d313da17 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:00.602351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7f8ad-9a42-457c-9602-c695fa211086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:00.604190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7f8ad-9a42-457c-9602-c695fa211086 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:00.604916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7f8ad-9a42-457c-9602-c695fa211086 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:00.605664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7f8ad-9a42-457c-9602-c695fa211086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:00.618400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7f8ad-9a42-457c-9602-c695fa211086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:00.620785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7f8ad-9a42-457c-9602-c695fa211086 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:00.632819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb4116-849e-433a-bcd8-271afdb895b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:00.633653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb4116-849e-433a-bcd8-271afdb895b5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:00.633939 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb4116-849e-433a-bcd8-271afdb895b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:00.636846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb4116-849e-433a-bcd8-271afdb895b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-25e7f8ad-9a42-457c-9602-c695fa211086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:00.637239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:00.638292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:00.639161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:00.639161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:00.639161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:00.639161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:00.639161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:00.639161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:00.639161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:00.639161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:00.639161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 279/540] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:00.640425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7f8ad-9a42-457c-9602-c695fa211086 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:00.648095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb4116-849e-433a-bcd8-271afdb895b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:00.649629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb4116-849e-433a-bcd8-271afdb895b5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a5fb4116-849e-433a-bcd8-271afdb895b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:00.666346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:00.667340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:00.668164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:00.668164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:00.668164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:00.668164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:00.668164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:00.668164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:00.668164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:00.668164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:00.668164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 262/541] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:00.669126 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766581db-bfd2-4316-baf6-f5bdebe4a392 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:00.669126 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766581db-bfd2-4316-baf6-f5bdebe4a392 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:00.669295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766581db-bfd2-4316-baf6-f5bdebe4a392 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:00.670757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 263/542] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:00.672755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766581db-bfd2-4316-baf6-f5bdebe4a392 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:00.697184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:00.766512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7f8ad-9a42-457c-9602-c695fa211086 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:00.786613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:00.806852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766581db-bfd2-4316-baf6-f5bdebe4a392 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:00.807128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719025b-bfae-4821-8a52-b2d438bbabde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:00.807552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719025b-bfae-4821-8a52-b2d438bbabde None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:00.807840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719025b-bfae-4821-8a52-b2d438bbabde None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:00.808126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719025b-bfae-4821-8a52-b2d438bbabde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:00.820595 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719025b-bfae-4821-8a52-b2d438bbabde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:00.822111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719025b-bfae-4821-8a52-b2d438bbabde None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-e719025b-bfae-4821-8a52-b2d438bbabde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:00.840772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:00.841800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:00.842652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:00.842652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:00.842652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:00.842652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:00.842652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 280/543] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:00.842934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719025b-bfae-4821-8a52-b2d438bbabde None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:00.852952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c4d83-945a-48a8-9639-17d30414ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:00.853827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4d83-945a-48a8-9639-17d30414ee26 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:00.854118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4d83-945a-48a8-9639-17d30414ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:00.854400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4d83-945a-48a8-9639-17d30414ee26 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:00.855233 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c4d83-945a-48a8-9639-17d30414ee26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:00.855736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c4d83-945a-48a8-9639-17d30414ee26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:00.858187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c4d83-945a-48a8-9639-17d30414ee26 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:00.877813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 264/544] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:00.879530 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a03656-5a3f-4235-92b9-f8235bccc981 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:00.880033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a03656-5a3f-4235-92b9-f8235bccc981 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:00.880524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a03656-5a3f-4235-92b9-f8235bccc981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:00.900692 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e9a03656-5a3f-4235-92b9-f8235bccc981 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:00.902005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e9a03656-5a3f-4235-92b9-f8235bccc981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:00.964987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719025b-bfae-4821-8a52-b2d438bbabde None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:00.997452 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 265/545] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:00.998959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a03656-5a3f-4235-92b9-f8235bccc981 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:01.015022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:01.021098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9173-feeb-4ae7-83da-0018ec8fb057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:01.021825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9173-feeb-4ae7-83da-0018ec8fb057 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:01.022084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9173-feeb-4ae7-83da-0018ec8fb057 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:01.022389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9173-feeb-4ae7-83da-0018ec8fb057 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:01.023206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb9173-feeb-4ae7-83da-0018ec8fb057 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:01.023566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb9173-feeb-4ae7-83da-0018ec8fb057 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:01.025002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb9173-feeb-4ae7-83da-0018ec8fb057 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:01.045293 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 281/546] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:01.046168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9173-feeb-4ae7-83da-0018ec8fb057 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:01.094506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:01.171424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a03656-5a3f-4235-92b9-f8235bccc981 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:01.203732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9173-feeb-4ae7-83da-0018ec8fb057 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:01.213827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e22314-6b43-4e30-aa89-46e1100f8beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:01.214828 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e22314-6b43-4e30-aa89-46e1100f8beb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:01.214828 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e22314-6b43-4e30-aa89-46e1100f8beb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:01.215177 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e22314-6b43-4e30-aa89-46e1100f8beb None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:01.215860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e22314-6b43-4e30-aa89-46e1100f8beb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:01.216174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e22314-6b43-4e30-aa89-46e1100f8beb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:01.217630 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e22314-6b43-4e30-aa89-46e1100f8beb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:01.234866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 266/547] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:01.234866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e22314-6b43-4e30-aa89-46e1100f8beb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:01.249642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07330aa-8cac-48a5-b068-b7d64d4544a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:01.250715 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07330aa-8cac-48a5-b068-b7d64d4544a1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:01.251035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07330aa-8cac-48a5-b068-b7d64d4544a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:01.251276 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07330aa-8cac-48a5-b068-b7d64d4544a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:01.252134 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07330aa-8cac-48a5-b068-b7d64d4544a1 None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=88518fe83a7c4fbdb3088bb2daf04239) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:01.252984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07330aa-8cac-48a5-b068-b7d64d4544a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:01.254760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07330aa-8cac-48a5-b068-b7d64d4544a1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:01.260672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 282/548] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:01 2022] GET /identity/v3/role_assignments?user.id=88518fe83a7c4fbdb3088bb2daf04239&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:01.260672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07330aa-8cac-48a5-b068-b7d64d4544a1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:01.345708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:01.384805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:01.400205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07330aa-8cac-48a5-b068-b7d64d4544a1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:01.406526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e22314-6b43-4e30-aa89-46e1100f8beb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:01.448699 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c53bea-deea-4938-ab3d-8825ec87e483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:01.449739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c53bea-deea-4938-ab3d-8825ec87e483 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:01.450096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c53bea-deea-4938-ab3d-8825ec87e483 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:01.450455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c53bea-deea-4938-ab3d-8825ec87e483 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:01.451141 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb1d72-d2a7-4f63-b241-ebae8e4b24a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:01.452047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb1d72-d2a7-4f63-b241-ebae8e4b24a5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:01.452505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb1d72-d2a7-4f63-b241-ebae8e4b24a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:01.453032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb1d72-d2a7-4f63-b241-ebae8e4b24a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:01.453951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb1d72-d2a7-4f63-b241-ebae8e4b24a5 None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=43cfdc27dbdb45c49f50e7bb3f93c260) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:01.454272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb1d72-d2a7-4f63-b241-ebae8e4b24a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:01.456900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb1d72-d2a7-4f63-b241-ebae8e4b24a5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:01.464118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 283/549] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:01 2022] GET /identity/v3/role_assignments?user.id=43cfdc27dbdb45c49f50e7bb3f93c260&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:01.464819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb1d72-d2a7-4f63-b241-ebae8e4b24a5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:01.474541 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c53bea-deea-4938-ab3d-8825ec87e483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d2c53bea-deea-4938-ab3d-8825ec87e483 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:01.488069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:01.489684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:01.490565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:01.490565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:01.490565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:01.490565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:01.490565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:01.490565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:01.490565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:01.490565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:01.490565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:01.490565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:01.490565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:01.490565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:01.493508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 267/550] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:01.495867 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c53bea-deea-4938-ab3d-8825ec87e483 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:01.618716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb1d72-d2a7-4f63-b241-ebae8e4b24a5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:01.703488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea171e-cefa-440e-8b19-874d6e6a676d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:01.704411 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea171e-cefa-440e-8b19-874d6e6a676d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:01.704782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea171e-cefa-440e-8b19-874d6e6a676d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:01.705102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea171e-cefa-440e-8b19-874d6e6a676d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:01.716350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea171e-cefa-440e-8b19-874d6e6a676d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:01.717944 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea171e-cefa-440e-8b19-874d6e6a676d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:01.728910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c53bea-deea-4938-ab3d-8825ec87e483 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-85ea171e-cefa-440e-8b19-874d6e6a676d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:01.734215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:01.735140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:01.736240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:01.736240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:01.736240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:01.736240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:01.736240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:01.736240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:01.736240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:01.736240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:01.736240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 15:12:01.736240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:01.740787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 284/551] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:12:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:01.742175 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea171e-cefa-440e-8b19-874d6e6a676d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:01.771472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:01.784124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857e24e-db4b-48b5-bd60-74356d99f6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:01.785200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857e24e-db4b-48b5-bd60-74356d99f6ab None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:01.785703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857e24e-db4b-48b5-bd60-74356d99f6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:01.786476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857e24e-db4b-48b5-bd60-74356d99f6ab None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:01.787460 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857e24e-db4b-48b5-bd60-74356d99f6ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:01.787969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857e24e-db4b-48b5-bd60-74356d99f6ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:01.789608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857e24e-db4b-48b5-bd60-74356d99f6ab None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:01.791205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:01.803885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 268/552] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:01.805897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd58693-7992-4556-a4e2-90c6938ff14c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:01.806818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd58693-7992-4556-a4e2-90c6938ff14c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:01.808174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd58693-7992-4556-a4e2-90c6938ff14c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:01.812174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 269/553] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:01.813312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd58693-7992-4556-a4e2-90c6938ff14c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:01.909636 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea171e-cefa-440e-8b19-874d6e6a676d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:01.948988 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd58693-7992-4556-a4e2-90c6938ff14c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:01.960833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbba3e-f4a0-4c3a-a511-b6483440d464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:01.962473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbba3e-f4a0-4c3a-a511-b6483440d464 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:01.962907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbba3e-f4a0-4c3a-a511-b6483440d464 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:01.963318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbba3e-f4a0-4c3a-a511-b6483440d464 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:01.964589 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbba3e-f4a0-4c3a-a511-b6483440d464 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:01.965392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbba3e-f4a0-4c3a-a511-b6483440d464 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:01.966786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbba3e-f4a0-4c3a-a511-b6483440d464 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:01.989813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 285/554] 10.222.0.64 () {56 vars in 1135 bytes} [Fri Jul 15 15:12:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:01.991218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af79df-9a93-4547-b5b9-78003e33fe60 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:01.991507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af79df-9a93-4547-b5b9-78003e33fe60 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:01.991792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af79df-9a93-4547-b5b9-78003e33fe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:01.995251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a733ac4-1d92-4d85-a3c5-9316d59342a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:01.996448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a733ac4-1d92-4d85-a3c5-9316d59342a2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:01.996943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a733ac4-1d92-4d85-a3c5-9316d59342a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:01.997810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a733ac4-1d92-4d85-a3c5-9316d59342a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:02.010812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b6af79df-9a93-4547-b5b9-78003e33fe60 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:02.012016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b6af79df-9a93-4547-b5b9-78003e33fe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:02.014960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a733ac4-1d92-4d85-a3c5-9316d59342a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:02.018985 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a733ac4-1d92-4d85-a3c5-9316d59342a2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-7a733ac4-1d92-4d85-a3c5-9316d59342a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:02.046669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:02.047598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:02.048474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:02.048474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:02.048474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:02.048474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:02.048474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 270/555] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:02.049906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a733ac4-1d92-4d85-a3c5-9316d59342a2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:02.099977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:02.111031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 286/556] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:02.112853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af79df-9a93-4547-b5b9-78003e33fe60 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:02.117774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:02.203860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a733ac4-1d92-4d85-a3c5-9316d59342a2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:02.248264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0616d7-b033-4fe1-9e0a-b10b37e5b9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:02.249382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0616d7-b033-4fe1-9e0a-b10b37e5b9fc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:02.250104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0616d7-b033-4fe1-9e0a-b10b37e5b9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:02.250784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0616d7-b033-4fe1-9e0a-b10b37e5b9fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:02.265156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af79df-9a93-4547-b5b9-78003e33fe60 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:02.305596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02880f-a6de-4830-83f3-f12df7abc1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:02.306668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02880f-a6de-4830-83f3-f12df7abc1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:02.307293 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02880f-a6de-4830-83f3-f12df7abc1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:02.307733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02880f-a6de-4830-83f3-f12df7abc1c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:02.308598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02880f-a6de-4830-83f3-f12df7abc1c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:02.309010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02880f-a6de-4830-83f3-f12df7abc1c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:02.310681 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02880f-a6de-4830-83f3-f12df7abc1c7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:02.326237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 287/557] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:02.327248 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02880f-a6de-4830-83f3-f12df7abc1c7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:02.352032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0616d7-b033-4fe1-9e0a-b10b37e5b9fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:02.353911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0616d7-b033-4fe1-9e0a-b10b37e5b9fc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:02.410671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:02.418492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:02.464660 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02880f-a6de-4830-83f3-f12df7abc1c7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:02.496571 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 271/558] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:12:02.497785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0616d7-b033-4fe1-9e0a-b10b37e5b9fc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:02.509620 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2ed58-1c32-472f-87c3-4cf2002c0433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:02.510448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2ed58-1c32-472f-87c3-4cf2002c0433 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:02.510738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2ed58-1c32-472f-87c3-4cf2002c0433 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:02.511024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2ed58-1c32-472f-87c3-4cf2002c0433 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:02.523665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2ed58-1c32-472f-87c3-4cf2002c0433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-3cf2ed58-1c32-472f-87c3-4cf2002c0433 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:02.531778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:02.533230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:02.534121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:02.534121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:02.534121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:02.534121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:02.534121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:02.534121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:02.534121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:02.534121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:02.534121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:02.534121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:02.534121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:02.534121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:02.538651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 288/559] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:02.539186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2ed58-1c32-472f-87c3-4cf2002c0433 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:02.627741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0616d7-b033-4fe1-9e0a-b10b37e5b9fc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:02.674950 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7357ae-d22c-48da-8264-ebb8111fb044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:02.675913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7357ae-d22c-48da-8264-ebb8111fb044 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:02.676428 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7357ae-d22c-48da-8264-ebb8111fb044 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:02.676669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7357ae-d22c-48da-8264-ebb8111fb044 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:02.680477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2ed58-1c32-472f-87c3-4cf2002c0433 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:02.685082 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7357ae-d22c-48da-8264-ebb8111fb044 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:02.686787 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7357ae-d22c-48da-8264-ebb8111fb044 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:02.690977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ca7357ae-d22c-48da-8264-ebb8111fb044 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:02.704584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:02.706653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:02.708362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:02.708362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:02.708362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:02.708362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:02.708362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:02.708362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:02.708362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:02.708362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:02.708362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 15:12:02.708362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:02.712535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 272/560] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:12:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:02.713999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7357ae-d22c-48da-8264-ebb8111fb044 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:02.730356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:02.758882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897553d-e01e-481b-ab5c-fc71f3fb18c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:02.760635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897553d-e01e-481b-ab5c-fc71f3fb18c4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:02.761526 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897553d-e01e-481b-ab5c-fc71f3fb18c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:02.762208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897553d-e01e-481b-ab5c-fc71f3fb18c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:02.786353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897553d-e01e-481b-ab5c-fc71f3fb18c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:02.790351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897553d-e01e-481b-ab5c-fc71f3fb18c4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-4897553d-e01e-481b-ab5c-fc71f3fb18c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:02.815963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:02.817043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:02.818182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:02.818182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:02.818182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:02.818182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:02.820671 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 289/561] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:02.821723 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897553d-e01e-481b-ab5c-fc71f3fb18c4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:02.874967 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7357ae-d22c-48da-8264-ebb8111fb044 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:02.926733 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042f962-3230-4012-9f93-d272f773db37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:02.927611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042f962-3230-4012-9f93-d272f773db37 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:02.928000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042f962-3230-4012-9f93-d272f773db37 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:02.928348 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042f962-3230-4012-9f93-d272f773db37 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:02.929227 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042f962-3230-4012-9f93-d272f773db37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:02.929610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042f962-3230-4012-9f93-d272f773db37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:02.931135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042f962-3230-4012-9f93-d272f773db37 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:02.945959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 273/562] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:02.947128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042f962-3230-4012-9f93-d272f773db37 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:02.955518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897553d-e01e-481b-ab5c-fc71f3fb18c4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:02.999519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527d069-72bc-4c75-97d4-f51ea9ffbb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:03.000242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527d069-72bc-4c75-97d4-f51ea9ffbb91 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:03.000576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527d069-72bc-4c75-97d4-f51ea9ffbb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:03.000932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527d069-72bc-4c75-97d4-f51ea9ffbb91 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:03.001984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527d069-72bc-4c75-97d4-f51ea9ffbb91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:03.002396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527d069-72bc-4c75-97d4-f51ea9ffbb91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:03.004327 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527d069-72bc-4c75-97d4-f51ea9ffbb91 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:03.032412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 290/563] 10.222.0.64 () {56 vars in 1137 bytes} [Fri Jul 15 15:12:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:03.034023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527d069-72bc-4c75-97d4-f51ea9ffbb91 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:03.040315 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:03.075131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:03.107732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042f962-3230-4012-9f93-d272f773db37 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:03.153781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527d069-72bc-4c75-97d4-f51ea9ffbb91 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:03.159046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9b5fe-eac6-47a7-9d11-300647c6b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:03.160025 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9b5fe-eac6-47a7-9d11-300647c6b9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:03.160545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9b5fe-eac6-47a7-9d11-300647c6b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:03.161002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9b5fe-eac6-47a7-9d11-300647c6b9f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:03.161948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9b5fe-eac6-47a7-9d11-300647c6b9f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:03.162436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9b5fe-eac6-47a7-9d11-300647c6b9f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:03.164034 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9b5fe-eac6-47a7-9d11-300647c6b9f7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:03.182476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 274/564] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:03.183623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9b5fe-eac6-47a7-9d11-300647c6b9f7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:03.200053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc790f9-1f2e-4d1e-9888-1dd7a3a63ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:03.201896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc790f9-1f2e-4d1e-9888-1dd7a3a63ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:03.202396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc790f9-1f2e-4d1e-9888-1dd7a3a63ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:03.202954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc790f9-1f2e-4d1e-9888-1dd7a3a63ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:03.218470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc790f9-1f2e-4d1e-9888-1dd7a3a63ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:03.220060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc790f9-1f2e-4d1e-9888-1dd7a3a63ad0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2fc790f9-1f2e-4d1e-9888-1dd7a3a63ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:03.240315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:03.241962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:03.243169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:03.243169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:03.243169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:03.243169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:03.245339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 291/565] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:03.246318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc790f9-1f2e-4d1e-9888-1dd7a3a63ad0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:03.334218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9b5fe-eac6-47a7-9d11-300647c6b9f7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:03.368083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:03.369849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:03.391386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3044e0-b6e3-415b-b671-52dd816897fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:03.391386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3044e0-b6e3-415b-b671-52dd816897fd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:03.391386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3044e0-b6e3-415b-b671-52dd816897fd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:03.391386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3044e0-b6e3-415b-b671-52dd816897fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:03.395253 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc790f9-1f2e-4d1e-9888-1dd7a3a63ad0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:03.401380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3044e0-b6e3-415b-b671-52dd816897fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:03.402965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3044e0-b6e3-415b-b671-52dd816897fd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-7c3044e0-b6e3-415b-b671-52dd816897fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:03.427018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:03.428068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:03.428938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:03.428938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:03.428938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:03.428938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:03.430940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 275/566] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:03.432125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3044e0-b6e3-415b-b671-52dd816897fd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:03.447630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66292e84-dff6-4150-8825-b1fcf32f0b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:03.448466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66292e84-dff6-4150-8825-b1fcf32f0b79 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:03.448750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66292e84-dff6-4150-8825-b1fcf32f0b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:03.449213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66292e84-dff6-4150-8825-b1fcf32f0b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:03.458716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66292e84-dff6-4150-8825-b1fcf32f0b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:03.460722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66292e84-dff6-4150-8825-b1fcf32f0b79 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-66292e84-dff6-4150-8825-b1fcf32f0b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:03.477694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:03.478711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:03.479607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:03.479607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:03.479607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:03.479607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:03.479607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:03.479607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:03.479607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:03.479607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:03.479607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 292/567] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:03.480175 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66292e84-dff6-4150-8825-b1fcf32f0b79 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:03.552163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3044e0-b6e3-415b-b671-52dd816897fd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:03.593352 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c638244-91cd-4bf8-bc6b-88ecfabab21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:03.594030 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c638244-91cd-4bf8-bc6b-88ecfabab21e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:03.594291 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c638244-91cd-4bf8-bc6b-88ecfabab21e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:03.594569 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c638244-91cd-4bf8-bc6b-88ecfabab21e None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:03.594667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66292e84-dff6-4150-8825-b1fcf32f0b79 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:03.595345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c638244-91cd-4bf8-bc6b-88ecfabab21e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:03.595655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c638244-91cd-4bf8-bc6b-88ecfabab21e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:03.597672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c638244-91cd-4bf8-bc6b-88ecfabab21e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:03.617696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 276/568] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:03.617696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac4145-16c4-4208-b622-7566d4f97051 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:03.617696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac4145-16c4-4208-b622-7566d4f97051 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:03.617696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac4145-16c4-4208-b622-7566d4f97051 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:03.619973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 277/569] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:03.620767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac4145-16c4-4208-b622-7566d4f97051 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:03.653756 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fcd62-0277-4c29-b95f-675b50769ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:03.654719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fcd62-0277-4c29-b95f-675b50769ebe None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:03.655115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fcd62-0277-4c29-b95f-675b50769ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:03.655515 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fcd62-0277-4c29-b95f-675b50769ebe None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:03.656420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fcd62-0277-4c29-b95f-675b50769ebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:03.656763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fcd62-0277-4c29-b95f-675b50769ebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:03.658928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fcd62-0277-4c29-b95f-675b50769ebe None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:03.679661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 293/570] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:03.679884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:03.679982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fcd62-0277-4c29-b95f-675b50769ebe None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:03.693568 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:03.773744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac4145-16c4-4208-b622-7566d4f97051 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:03.808530 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca85d1-9d16-4767-96fc-fc262c535b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:03.809414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca85d1-9d16-4767-96fc-fc262c535b57 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:03.809714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca85d1-9d16-4767-96fc-fc262c535b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:03.810010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca85d1-9d16-4767-96fc-fc262c535b57 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:03.810783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca85d1-9d16-4767-96fc-fc262c535b57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:03.811262 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca85d1-9d16-4767-96fc-fc262c535b57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:03.812552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca85d1-9d16-4767-96fc-fc262c535b57 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:03.813640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fcd62-0277-4c29-b95f-675b50769ebe None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:03.824872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 278/571] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:03.826809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3338097-8fbb-439e-ad85-0a017afded50 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:03.826809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3338097-8fbb-439e-ad85-0a017afded50 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:03.827070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3338097-8fbb-439e-ad85-0a017afded50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:03.843496 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a3338097-8fbb-439e-ad85-0a017afded50 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:03.844639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a3338097-8fbb-439e-ad85-0a017afded50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:03.854489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c4aa7-0c58-441c-aaf7-6fb6e20626f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:03.855793 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c4aa7-0c58-441c-aaf7-6fb6e20626f7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:03.856275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c4aa7-0c58-441c-aaf7-6fb6e20626f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:03.856617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c4aa7-0c58-441c-aaf7-6fb6e20626f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:03.864834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c4aa7-0c58-441c-aaf7-6fb6e20626f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:03.866351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c4aa7-0c58-441c-aaf7-6fb6e20626f7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-cf0c4aa7-0c58-441c-aaf7-6fb6e20626f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:03.881643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:03.882843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:03.883792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:03.883792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:03.883792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:03.883792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:03.883792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:03.883792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:03.883792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:03.883792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:03.883792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:12:03.883792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:03.883792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 294/572] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Jul 15 15:12:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:03.883792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c4aa7-0c58-441c-aaf7-6fb6e20626f7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:03.914916 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 279/573] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:03.916264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9318a8-e52f-4b1a-b279-ddbf56266aa9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:03.916554 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9318a8-e52f-4b1a-b279-ddbf56266aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:03.916839 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9318a8-e52f-4b1a-b279-ddbf56266aa9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:03.918338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 280/574] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:03.918872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9318a8-e52f-4b1a-b279-ddbf56266aa9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:03.949363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:03.968061 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:04.009626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c4aa7-0c58-441c-aaf7-6fb6e20626f7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:04.027733 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9318a8-e52f-4b1a-b279-ddbf56266aa9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:04.047573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065a39a-04ae-45ca-b98f-4eb7c074487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:04.048383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065a39a-04ae-45ca-b98f-4eb7c074487d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:04.048670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065a39a-04ae-45ca-b98f-4eb7c074487d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:04.048993 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065a39a-04ae-45ca-b98f-4eb7c074487d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:04.056005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065a39a-04ae-45ca-b98f-4eb7c074487d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:04.057533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065a39a-04ae-45ca-b98f-4eb7c074487d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:04.064181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28978a1f-026d-4dd5-8373-6e095559834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:04.064956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28978a1f-026d-4dd5-8373-6e095559834d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:04.065285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28978a1f-026d-4dd5-8373-6e095559834d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:04.065570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28978a1f-026d-4dd5-8373-6e095559834d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:04.066416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28978a1f-026d-4dd5-8373-6e095559834d None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=04f3a308ee69455287ac460d9ab2aef0) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:04.066735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28978a1f-026d-4dd5-8373-6e095559834d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:04.068185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28978a1f-026d-4dd5-8373-6e095559834d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-0065a39a-04ae-45ca-b98f-4eb7c074487d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:04.071309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:04.072223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:04.073266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:04.073266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:04.073266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:04.073266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:04.073266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:04.073266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:04.073266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:04.073266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:04.073266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 295/575] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:04.074222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065a39a-04ae-45ca-b98f-4eb7c074487d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:04.089099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 281/576] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:03 2022] GET /identity/v3/role_assignments?user.id=04f3a308ee69455287ac460d9ab2aef0&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:04.089099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a632a0-11c5-4588-a65c-2ae2cadd277d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:04.089099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a632a0-11c5-4588-a65c-2ae2cadd277d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:04.089099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a632a0-11c5-4588-a65c-2ae2cadd277d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:04.095878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-14a632a0-11c5-4588-a65c-2ae2cadd277d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:04.097590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-14a632a0-11c5-4588-a65c-2ae2cadd277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:04.188157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 282/577] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:04.189041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a632a0-11c5-4588-a65c-2ae2cadd277d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:04.219259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:04.228749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065a39a-04ae-45ca-b98f-4eb7c074487d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:04.261394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:04.272535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f170535-406d-470b-a43f-eeb8faeeed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:04.273291 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f170535-406d-470b-a43f-eeb8faeeed30 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:04.273636 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f170535-406d-470b-a43f-eeb8faeeed30 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:04.273921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f170535-406d-470b-a43f-eeb8faeeed30 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:04.274788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f170535-406d-470b-a43f-eeb8faeeed30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:04.275128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f170535-406d-470b-a43f-eeb8faeeed30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:04.276611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f170535-406d-470b-a43f-eeb8faeeed30 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:04.297110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 296/578] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Jul 15 15:12:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:04.297990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f170535-406d-470b-a43f-eeb8faeeed30 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:04.327236 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a632a0-11c5-4588-a65c-2ae2cadd277d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:04.366381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190aba42-0f93-4ee4-b7a0-27f587065a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:04.367119 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190aba42-0f93-4ee4-b7a0-27f587065a52 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:04.367402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190aba42-0f93-4ee4-b7a0-27f587065a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:04.367678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190aba42-0f93-4ee4-b7a0-27f587065a52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:04.381120 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190aba42-0f93-4ee4-b7a0-27f587065a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-190aba42-0f93-4ee4-b7a0-27f587065a52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:04.389115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:04.390190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:04.391091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:04.391091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:04.391091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:04.391091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:04.391091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:04.391091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:04.391091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:04.391091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:04.391091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:04.391091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:04.391091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:04.391091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:04.395923 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 283/579] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:04.396830 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190aba42-0f93-4ee4-b7a0-27f587065a52 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:04.447399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f170535-406d-470b-a43f-eeb8faeeed30 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:04.487498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eae8bb-faa3-4d43-8b20-97c47825b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:04.488237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eae8bb-faa3-4d43-8b20-97c47825b885 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:04.488532 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eae8bb-faa3-4d43-8b20-97c47825b885 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:04.488812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eae8bb-faa3-4d43-8b20-97c47825b885 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:04.489655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eae8bb-faa3-4d43-8b20-97c47825b885 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:04.490470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eae8bb-faa3-4d43-8b20-97c47825b885 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:04.492392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eae8bb-faa3-4d43-8b20-97c47825b885 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:04.493498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:04.508043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 297/580] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:04.508854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eae8bb-faa3-4d43-8b20-97c47825b885 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:04.524251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190aba42-0f93-4ee4-b7a0-27f587065a52 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:04.563586 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d10b7e-3905-42e2-a64e-604992d47e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:04.564387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d10b7e-3905-42e2-a64e-604992d47e2a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:04.564697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d10b7e-3905-42e2-a64e-604992d47e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:04.564971 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d10b7e-3905-42e2-a64e-604992d47e2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:04.567133 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:04.576235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d10b7e-3905-42e2-a64e-604992d47e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-01d10b7e-3905-42e2-a64e-604992d47e2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:04.584055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:04.585270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:04.586241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 284/581] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:04.590364 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d10b7e-3905-42e2-a64e-604992d47e2a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:04.661415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eae8bb-faa3-4d43-8b20-97c47825b885 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:04.700328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9e857-ba83-4eb2-9c7e-a11264fec23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:04.701154 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9e857-ba83-4eb2-9c7e-a11264fec23f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:04.701557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9e857-ba83-4eb2-9c7e-a11264fec23f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:04.701836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9e857-ba83-4eb2-9c7e-a11264fec23f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:04.715262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9e857-ba83-4eb2-9c7e-a11264fec23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:04.717103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9e857-ba83-4eb2-9c7e-a11264fec23f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:04.723827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d10b7e-3905-42e2-a64e-604992d47e2a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ebd9e857-ba83-4eb2-9c7e-a11264fec23f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:04.737541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:04.739269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:04.741010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:04.741010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:04.741010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:04.741010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:04.741010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 298/582] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:04.741010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9e857-ba83-4eb2-9c7e-a11264fec23f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:04.772998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c3837-a54b-4d4b-8ae9-55dfa1c1d952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:04.773716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c3837-a54b-4d4b-8ae9-55dfa1c1d952 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:04.774007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c3837-a54b-4d4b-8ae9-55dfa1c1d952 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:04.774288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c3837-a54b-4d4b-8ae9-55dfa1c1d952 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:04.775069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c3837-a54b-4d4b-8ae9-55dfa1c1d952 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:04.775372 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c3837-a54b-4d4b-8ae9-55dfa1c1d952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:04.776796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c3837-a54b-4d4b-8ae9-55dfa1c1d952 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:04.783193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:04.791759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 285/583] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:04.791759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c3837-a54b-4d4b-8ae9-55dfa1c1d952 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:04.861651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:04.869697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9e857-ba83-4eb2-9c7e-a11264fec23f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:04.909038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e826c-87d6-42d9-b299-1be4a23e945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:04.909587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c3837-a54b-4d4b-8ae9-55dfa1c1d952 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:04.910085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e826c-87d6-42d9-b299-1be4a23e945f None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:04.910550 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e826c-87d6-42d9-b299-1be4a23e945f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:04.911036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e826c-87d6-42d9-b299-1be4a23e945f None admin] PATH_INFO: `/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/a87a4ae82b1b4619b90f9ad0f3dea5c3/roles/0ea33b1c5ba54280862c8470178e2732` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:04.931484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e826c-87d6-42d9-b299-1be4a23e945f None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0acc3e7b64dbab9113284b46f38ff, user_id=a87a4ae82b1b4619b90f9ad0f3dea5c3, role_id=0ea33b1c5ba54280862c8470178e2732)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:04.933767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e826c-87d6-42d9-b299-1be4a23e945f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:04.949593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c33142-8031-454f-8abb-37c98c885680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:04.950412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 299/584] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:12:04 2022] PUT /identity/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/a87a4ae82b1b4619b90f9ad0f3dea5c3/roles/0ea33b1c5ba54280862c8470178e2732 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:12:04.950528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c33142-8031-454f-8abb-37c98c885680 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:04.950528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c33142-8031-454f-8abb-37c98c885680 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:04.950865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c33142-8031-454f-8abb-37c98c885680 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:04.951775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c33142-8031-454f-8abb-37c98c885680 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:04.952095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c33142-8031-454f-8abb-37c98c885680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:04.953837 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c33142-8031-454f-8abb-37c98c885680 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:04.962606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e826c-87d6-42d9-b299-1be4a23e945f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:04.964239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 286/585] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:04.965013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c33142-8031-454f-8abb-37c98c885680 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:05.056461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:05.119750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c33142-8031-454f-8abb-37c98c885680 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:05.129982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e826c-87d6-42d9-b299-1be4a23e945f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:05.177974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6e753-c7ab-4cd2-913b-d64fee619e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:05.178906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6e753-c7ab-4cd2-913b-d64fee619e68 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:05.179196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6e753-c7ab-4cd2-913b-d64fee619e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:05.179476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6e753-c7ab-4cd2-913b-d64fee619e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:05.179752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0acd50-c64e-43be-9a04-255b6910db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:05.180825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0acd50-c64e-43be-9a04-255b6910db95 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:05.181340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0acd50-c64e-43be-9a04-255b6910db95 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:05.181956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0acd50-c64e-43be-9a04-255b6910db95 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:05.182859 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0acd50-c64e-43be-9a04-255b6910db95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:05.183435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0acd50-c64e-43be-9a04-255b6910db95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:05.184879 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0acd50-c64e-43be-9a04-255b6910db95 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:05.194639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6e753-c7ab-4cd2-913b-d64fee619e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:05.196735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6e753-c7ab-4cd2-913b-d64fee619e68 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:05.198279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 300/586] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:05.199259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0acd50-c64e-43be-9a04-255b6910db95 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:05.214138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-bda6e753-c7ab-4cd2-913b-d64fee619e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:05.223814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:05.224784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:05.225701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:05.225701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:05.225701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:05.225701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:05.233295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 287/587] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:05.233295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6e753-c7ab-4cd2-913b-d64fee619e68 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:05.346476 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0acd50-c64e-43be-9a04-255b6910db95 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:05.379549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6e753-c7ab-4cd2-913b-d64fee619e68 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:05.394540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d27e0-c60c-4e1f-8401-dcfcdb579c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:05.395362 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d27e0-c60c-4e1f-8401-dcfcdb579c01 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:05.395649 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d27e0-c60c-4e1f-8401-dcfcdb579c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:05.395932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d27e0-c60c-4e1f-8401-dcfcdb579c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:05.396566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:05.410855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d27e0-c60c-4e1f-8401-dcfcdb579c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:05.412688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d27e0-c60c-4e1f-8401-dcfcdb579c01 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:05.421354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09162c7-bac6-4c22-9d24-cabb3eae9c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:05.422501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09162c7-bac6-4c22-9d24-cabb3eae9c76 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:05.423100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09162c7-bac6-4c22-9d24-cabb3eae9c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:05.423575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09162c7-bac6-4c22-9d24-cabb3eae9c76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:05.431927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09162c7-bac6-4c22-9d24-cabb3eae9c76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-381d27e0-c60c-4e1f-8401-dcfcdb579c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:05.434290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:05.435426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:05.436749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:05.436749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:05.436749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:05.436749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:05.438311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09162c7-bac6-4c22-9d24-cabb3eae9c76 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:05.440322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 301/588] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:05.441380 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d27e0-c60c-4e1f-8401-dcfcdb579c01 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b09162c7-bac6-4c22-9d24-cabb3eae9c76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:05.459294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:05.460263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:05.461179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:05.461179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:05.461179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:05.461179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:05.461179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:05.461179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:05.461179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:05.461179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:05.463488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 288/589] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:05.465260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09162c7-bac6-4c22-9d24-cabb3eae9c76 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:05.518243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:05.567266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d27e0-c60c-4e1f-8401-dcfcdb579c01 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:05.576283 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09162c7-bac6-4c22-9d24-cabb3eae9c76 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:05.613479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036be5a-ece1-4f6f-8840-4a2f0c92ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:05.614102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036be5a-ece1-4f6f-8840-4a2f0c92ec7a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:05.614391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036be5a-ece1-4f6f-8840-4a2f0c92ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:05.614675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036be5a-ece1-4f6f-8840-4a2f0c92ec7a None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:05.615474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036be5a-ece1-4f6f-8840-4a2f0c92ec7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:05.615719 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036be5a-ece1-4f6f-8840-4a2f0c92ec7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:05.617149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036be5a-ece1-4f6f-8840-4a2f0c92ec7a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:05.621726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caab50a-d729-4269-857d-b508c0b79b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:05.623053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caab50a-d729-4269-857d-b508c0b79b62 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:05.623571 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caab50a-d729-4269-857d-b508c0b79b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:05.624049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caab50a-d729-4269-857d-b508c0b79b62 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:05.625133 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caab50a-d729-4269-857d-b508c0b79b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:05.625681 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caab50a-d729-4269-857d-b508c0b79b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:05.627475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caab50a-d729-4269-857d-b508c0b79b62 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:05.634876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 289/590] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:05.635829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036be5a-ece1-4f6f-8840-4a2f0c92ec7a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:05.648058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 302/591] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:05.650909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caab50a-d729-4269-857d-b508c0b79b62 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:05.673717 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:05.747956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036be5a-ece1-4f6f-8840-4a2f0c92ec7a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:05.786730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aad84-c7b0-46be-9bbf-0a23284dfbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:05.787418 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aad84-c7b0-46be-9bbf-0a23284dfbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:05.787713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aad84-c7b0-46be-9bbf-0a23284dfbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:05.787996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aad84-c7b0-46be-9bbf-0a23284dfbb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:05.788815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5aad84-c7b0-46be-9bbf-0a23284dfbb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:05.789162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5aad84-c7b0-46be-9bbf-0a23284dfbb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:05.790655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5aad84-c7b0-46be-9bbf-0a23284dfbb2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:05.803994 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caab50a-d729-4269-857d-b508c0b79b62 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:05.808938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 290/592] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:05.809993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aad84-c7b0-46be-9bbf-0a23284dfbb2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:05.826084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:05.847731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efc410-17ec-4dc9-b615-b499aa8c6429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:05.848957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efc410-17ec-4dc9-b615-b499aa8c6429 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:05.849511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efc410-17ec-4dc9-b615-b499aa8c6429 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:05.849985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efc410-17ec-4dc9-b615-b499aa8c6429 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:05.858557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efc410-17ec-4dc9-b615-b499aa8c6429 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:05.860540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efc410-17ec-4dc9-b615-b499aa8c6429 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-b0efc410-17ec-4dc9-b615-b499aa8c6429 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:05.878240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:05.879484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:05.880482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:05.880482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:05.880482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:05.880482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:05.880482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:05.880482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:05.880482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:05.880482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:05.880482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:12:05.880482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:05.883488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 303/593] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:12:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:05.884642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efc410-17ec-4dc9-b615-b499aa8c6429 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:05.915698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:05.923004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aad84-c7b0-46be-9bbf-0a23284dfbb2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:05.959368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e08ef-7edf-4a6e-a6e0-4a1642e3f17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:05.960220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e08ef-7edf-4a6e-a6e0-4a1642e3f17c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:05.960509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e08ef-7edf-4a6e-a6e0-4a1642e3f17c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:05.960791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e08ef-7edf-4a6e-a6e0-4a1642e3f17c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:05.968736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e08ef-7edf-4a6e-a6e0-4a1642e3f17c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:05.970549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e08ef-7edf-4a6e-a6e0-4a1642e3f17c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8f7e08ef-7edf-4a6e-a6e0-4a1642e3f17c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:05.986151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:05.987849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:05.989455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:05.989455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:05.989455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:05.989455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:05.989455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:05.989455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:05.989455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:05.989455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:05.989455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 15:12:05.989455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:05.992205 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 291/594] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:05.993152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e08ef-7edf-4a6e-a6e0-4a1642e3f17c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:06.077806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efc410-17ec-4dc9-b615-b499aa8c6429 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:06.108806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e08ef-7edf-4a6e-a6e0-4a1642e3f17c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:06.119892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38f63-d029-45ff-948c-9e1bcf9885aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:06.122131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38f63-d029-45ff-948c-9e1bcf9885aa None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:06.122898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38f63-d029-45ff-948c-9e1bcf9885aa None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:06.123779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38f63-d029-45ff-948c-9e1bcf9885aa None admin] PATH_INFO: `/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/b022a37031b940c3bd67861373926e58/roles/0ea33b1c5ba54280862c8470178e2732` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:06.143618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b38f63-d029-45ff-948c-9e1bcf9885aa None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0acc3e7b64dbab9113284b46f38ff, user_id=b022a37031b940c3bd67861373926e58, role_id=0ea33b1c5ba54280862c8470178e2732)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:06.146929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b38f63-d029-45ff-948c-9e1bcf9885aa None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:06.148210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20242e3f-5daa-472e-bb85-f6c0bfb811d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:06.149253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20242e3f-5daa-472e-bb85-f6c0bfb811d7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:06.149631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20242e3f-5daa-472e-bb85-f6c0bfb811d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:06.150058 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20242e3f-5daa-472e-bb85-f6c0bfb811d7 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:06.151124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20242e3f-5daa-472e-bb85-f6c0bfb811d7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:06.151557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20242e3f-5daa-472e-bb85-f6c0bfb811d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:06.153243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20242e3f-5daa-472e-bb85-f6c0bfb811d7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:06.177177 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 304/595] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:12:05 2022] PUT /identity/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/b022a37031b940c3bd67861373926e58/roles/0ea33b1c5ba54280862c8470178e2732 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:12:06.178737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38f63-d029-45ff-948c-9e1bcf9885aa None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:06.183625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 292/596] 10.222.0.64 () {56 vars in 1137 bytes} [Fri Jul 15 15:12:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:06.189171 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20242e3f-5daa-472e-bb85-f6c0bfb811d7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:06.228039 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:06.256712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:06.380171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38f63-d029-45ff-948c-9e1bcf9885aa None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:06.385887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20242e3f-5daa-472e-bb85-f6c0bfb811d7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:06.429707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b1891-91db-434a-a601-708d87ae1e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:06.430792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b1891-91db-434a-a601-708d87ae1e05 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:06.431252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b1891-91db-434a-a601-708d87ae1e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:06.431662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b1891-91db-434a-a601-708d87ae1e05 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:06.433147 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b1891-91db-434a-a601-708d87ae1e05 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:06.433676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b1891-91db-434a-a601-708d87ae1e05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:06.434860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55143c1f-2c1d-4b94-a3ff-5d1cdcde39b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:06.435913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143c1f-2c1d-4b94-a3ff-5d1cdcde39b1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:06.436119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b1891-91db-434a-a601-708d87ae1e05 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:06.436598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143c1f-2c1d-4b94-a3ff-5d1cdcde39b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:06.437098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143c1f-2c1d-4b94-a3ff-5d1cdcde39b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:06.450176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55143c1f-2c1d-4b94-a3ff-5d1cdcde39b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:06.452858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55143c1f-2c1d-4b94-a3ff-5d1cdcde39b1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:06.461105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 305/597] 10.222.0.64 () {56 vars in 1139 bytes} [Fri Jul 15 15:12:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:06.463658 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b5ccf-2e07-4c48-a72c-95caff44e90c None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:06.463849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b5ccf-2e07-4c48-a72c-95caff44e90c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:06.464149 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b5ccf-2e07-4c48-a72c-95caff44e90c None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:06.465783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 306/598] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:06.470989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b5ccf-2e07-4c48-a72c-95caff44e90c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-55143c1f-2c1d-4b94-a3ff-5d1cdcde39b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:06.475375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:06.476390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:06.477774 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:06.477774 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:06.477774 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:06.477774 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:06.479933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 293/599] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:06.481504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e0579-4950-4a74-955d-008d5f451ee2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:06.482025 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e0579-4950-4a74-955d-008d5f451ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:06.482508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e0579-4950-4a74-955d-008d5f451ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:06.504958 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-738e0579-4950-4a74-955d-008d5f451ee2 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:06.506729 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-738e0579-4950-4a74-955d-008d5f451ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:06.578878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:06.585616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:06.588770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 294/600] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:06.593844 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e0579-4950-4a74-955d-008d5f451ee2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:06.623045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b5ccf-2e07-4c48-a72c-95caff44e90c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:06.668350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25e57-7760-41de-bb73-731b9c356bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:06.670166 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25e57-7760-41de-bb73-731b9c356bcc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:06.670878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25e57-7760-41de-bb73-731b9c356bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:06.671380 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25e57-7760-41de-bb73-731b9c356bcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:06.687039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a25e57-7760-41de-bb73-731b9c356bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:06.688886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a25e57-7760-41de-bb73-731b9c356bcc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-24a25e57-7760-41de-bb73-731b9c356bcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:06.716125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:06.717120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:06.718119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:06.718119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:06.718119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:06.718119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:06.721527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 307/601] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:06.722325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e0579-4950-4a74-955d-008d5f451ee2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:06.722875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25e57-7760-41de-bb73-731b9c356bcc None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:06.765299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99246d-2e9f-4dd3-baca-117d28a49b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:06.766258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99246d-2e9f-4dd3-baca-117d28a49b4a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:06.766652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99246d-2e9f-4dd3-baca-117d28a49b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:06.767021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99246d-2e9f-4dd3-baca-117d28a49b4a None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:06.768252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99246d-2e9f-4dd3-baca-117d28a49b4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:06.768712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99246d-2e9f-4dd3-baca-117d28a49b4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:06.770999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99246d-2e9f-4dd3-baca-117d28a49b4a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:06.785963 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 295/602] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:06.786857 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99246d-2e9f-4dd3-baca-117d28a49b4a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:06.851116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:06.875714 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25e57-7760-41de-bb73-731b9c356bcc None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:06.909732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99246d-2e9f-4dd3-baca-117d28a49b4a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:06.921716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94096e1-ec8d-4766-b1e6-247a33f3f271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:06.922866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94096e1-ec8d-4766-b1e6-247a33f3f271 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:06.923377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94096e1-ec8d-4766-b1e6-247a33f3f271 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:06.923926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94096e1-ec8d-4766-b1e6-247a33f3f271 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:06.933572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:06.941319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94096e1-ec8d-4766-b1e6-247a33f3f271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:06.947495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d067b6d-3a47-4dc1-8ecd-7e12001f169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:06.948287 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d067b6d-3a47-4dc1-8ecd-7e12001f169b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:06.948706 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d067b6d-3a47-4dc1-8ecd-7e12001f169b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:06.948998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d067b6d-3a47-4dc1-8ecd-7e12001f169b None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:06.949785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d067b6d-3a47-4dc1-8ecd-7e12001f169b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:06.950110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d067b6d-3a47-4dc1-8ecd-7e12001f169b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:06.951764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d067b6d-3a47-4dc1-8ecd-7e12001f169b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-a94096e1-ec8d-4766-b1e6-247a33f3f271 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:06.952468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:06.953606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:06.954440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:06.954440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:06.954440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:06.954440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:06.954440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:06.954440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:06.954440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:06.954440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:06.954440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:06.954440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:06.954440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:06.954440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:06.957355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 308/603] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:06.958551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94096e1-ec8d-4766-b1e6-247a33f3f271 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:06.970761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 296/604] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:06.970761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d067b6d-3a47-4dc1-8ecd-7e12001f169b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:07.121551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94096e1-ec8d-4766-b1e6-247a33f3f271 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:07.133575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d067b6d-3a47-4dc1-8ecd-7e12001f169b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:07.161948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:07.164581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1520c-4cdb-4857-922c-68e7fcd51ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:07.165437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1520c-4cdb-4857-922c-68e7fcd51ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:07.165732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1520c-4cdb-4857-922c-68e7fcd51ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:07.166345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1520c-4cdb-4857-922c-68e7fcd51ef1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:07.173927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1520c-4cdb-4857-922c-68e7fcd51ef1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:07.175316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1520c-4cdb-4857-922c-68e7fcd51ef1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:07.190380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd7484-14b2-4f68-8543-ac3a52b60632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c7c1520c-4cdb-4857-922c-68e7fcd51ef1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:07.190872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:07.191726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:07.192615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:07.192615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:07.192615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:07.192615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:07.192615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:07.192615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:07.192615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:07.192615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:07.193040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd7484-14b2-4f68-8543-ac3a52b60632 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:07.193040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd7484-14b2-4f68-8543-ac3a52b60632 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:07.193040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd7484-14b2-4f68-8543-ac3a52b60632 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:07.193260 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 309/605] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:07.193789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1520c-4cdb-4857-922c-68e7fcd51ef1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:07.196942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd7484-14b2-4f68-8543-ac3a52b60632 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:07.197359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd7484-14b2-4f68-8543-ac3a52b60632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:07.198812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd7484-14b2-4f68-8543-ac3a52b60632 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:07.213698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 297/606] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:07.213698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cfd96-bb4d-426c-8c01-e6dd3f7af3d3 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:07.213698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cfd96-bb4d-426c-8c01-e6dd3f7af3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:07.213698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cfd96-bb4d-426c-8c01-e6dd3f7af3d3 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:07.213698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 298/607] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:07.213698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cfd96-bb4d-426c-8c01-e6dd3f7af3d3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:07.276889 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:07.327763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1520c-4cdb-4857-922c-68e7fcd51ef1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:07.340270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cfd96-bb4d-426c-8c01-e6dd3f7af3d3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:07.371400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3032ea-b2d5-4287-a10d-3823f34266f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:07.372205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3032ea-b2d5-4287-a10d-3823f34266f0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:07.372492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3032ea-b2d5-4287-a10d-3823f34266f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:07.372831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3032ea-b2d5-4287-a10d-3823f34266f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:07.380836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3032ea-b2d5-4287-a10d-3823f34266f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:07.382380 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3032ea-b2d5-4287-a10d-3823f34266f0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:07.395540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cd56e-a49a-4c91-b2a9-5cdc04629a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:07.396307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cd56e-a49a-4c91-b2a9-5cdc04629a68 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:07.396559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cd56e-a49a-4c91-b2a9-5cdc04629a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:07.396851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cd56e-a49a-4c91-b2a9-5cdc04629a68 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-da3032ea-b2d5-4287-a10d-3823f34266f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:07.397355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:07.398384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:07.399467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:07.399467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:07.399467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:07.399467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:07.399467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:07.399467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:07.399467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:07.399467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:07.401230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cd56e-a49a-4c91-b2a9-5cdc04629a68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:07.401230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cd56e-a49a-4c91-b2a9-5cdc04629a68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:07.401230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cd56e-a49a-4c91-b2a9-5cdc04629a68 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:07.403406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 310/608] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:07.404139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3032ea-b2d5-4287-a10d-3823f34266f0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:07.423257 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 299/609] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:07.424755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849a8f8-92f3-40f7-9691-8fb6dce325bc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:07.424998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849a8f8-92f3-40f7-9691-8fb6dce325bc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:07.425379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849a8f8-92f3-40f7-9691-8fb6dce325bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:07.450841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f849a8f8-92f3-40f7-9691-8fb6dce325bc None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:07.453042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f849a8f8-92f3-40f7-9691-8fb6dce325bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:07.495951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:07.538510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3032ea-b2d5-4287-a10d-3823f34266f0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:07.547355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 300/610] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:07.548137 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849a8f8-92f3-40f7-9691-8fb6dce325bc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:07.568018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:07.595205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ecd59-06a5-4301-9aca-63b6361c9642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:07.596560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ecd59-06a5-4301-9aca-63b6361c9642 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:07.596848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ecd59-06a5-4301-9aca-63b6361c9642 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:07.597156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ecd59-06a5-4301-9aca-63b6361c9642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:07.613082 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ecd59-06a5-4301-9aca-63b6361c9642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:07.615470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ecd59-06a5-4301-9aca-63b6361c9642 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-d76ecd59-06a5-4301-9aca-63b6361c9642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:07.643626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:07.644787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:07.645755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:07.645755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:07.645755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:07.645755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:07.645755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 311/611] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:07.645755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ecd59-06a5-4301-9aca-63b6361c9642 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:07.711838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849a8f8-92f3-40f7-9691-8fb6dce325bc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:07.762700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b86a12-952e-4eed-9cca-1da3cfe66b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:07.763511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b86a12-952e-4eed-9cca-1da3cfe66b30 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:07.763796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b86a12-952e-4eed-9cca-1da3cfe66b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:07.764076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b86a12-952e-4eed-9cca-1da3cfe66b30 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:07.764897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b86a12-952e-4eed-9cca-1da3cfe66b30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:07.765257 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b86a12-952e-4eed-9cca-1da3cfe66b30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:07.766755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b86a12-952e-4eed-9cca-1da3cfe66b30 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:07.789098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 301/612] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:07.789098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b86a12-952e-4eed-9cca-1da3cfe66b30 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:07.803191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ecd59-06a5-4301-9aca-63b6361c9642 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:07.828196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:07.861265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2dfc5-7371-4b28-8d4f-112d367a9360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:07.862355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2dfc5-7371-4b28-8d4f-112d367a9360 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:07.862761 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2dfc5-7371-4b28-8d4f-112d367a9360 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:07.863121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2dfc5-7371-4b28-8d4f-112d367a9360 None admin] PATH_INFO: `/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/43cfdc27dbdb45c49f50e7bb3f93c260/roles/0ea33b1c5ba54280862c8470178e2732` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:07.881650 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2dfc5-7371-4b28-8d4f-112d367a9360 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0acc3e7b64dbab9113284b46f38ff, user_id=43cfdc27dbdb45c49f50e7bb3f93c260, role_id=0ea33b1c5ba54280862c8470178e2732)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:07.883251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2dfc5-7371-4b28-8d4f-112d367a9360 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:07.910758 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 312/613] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:12:07 2022] PUT /identity/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/43cfdc27dbdb45c49f50e7bb3f93c260/roles/0ea33b1c5ba54280862c8470178e2732 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:12:07.922381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2dfc5-7371-4b28-8d4f-112d367a9360 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:07.935014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b86a12-952e-4eed-9cca-1da3cfe66b30 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:07.965869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:07.980046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e271b5-f112-42c4-8cc7-6b7dc7612048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:07.980960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e271b5-f112-42c4-8cc7-6b7dc7612048 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:07.981286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e271b5-f112-42c4-8cc7-6b7dc7612048 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:07.981636 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e271b5-f112-42c4-8cc7-6b7dc7612048 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:07.995800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e271b5-f112-42c4-8cc7-6b7dc7612048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-59e271b5-f112-42c4-8cc7-6b7dc7612048 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:08.005943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:08.007682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:08.009442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:08.009442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:08.009442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:08.009442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:08.009442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:08.009442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:08.009442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:08.009442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:08.009442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:08.009442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:08.009442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:08.009442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:08.013318 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 302/614] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:08.014051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e271b5-f112-42c4-8cc7-6b7dc7612048 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:08.085907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2dfc5-7371-4b28-8d4f-112d367a9360 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:08.141734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:08.150776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9701241-dc54-401f-afe4-83ca5da48cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:08.151487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9701241-dc54-401f-afe4-83ca5da48cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:08.151775 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9701241-dc54-401f-afe4-83ca5da48cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:08.152049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9701241-dc54-401f-afe4-83ca5da48cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:08.152804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9701241-dc54-401f-afe4-83ca5da48cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:08.154404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9701241-dc54-401f-afe4-83ca5da48cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:08.154706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9701241-dc54-401f-afe4-83ca5da48cd3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:08.171325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e271b5-f112-42c4-8cc7-6b7dc7612048 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:08.176040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 313/615] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:08.176942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9701241-dc54-401f-afe4-83ca5da48cd3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:08.241917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fe1c8-1974-4e0b-8ff1-f4ba9694becb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:08.242930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fe1c8-1974-4e0b-8ff1-f4ba9694becb None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:08.243588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fe1c8-1974-4e0b-8ff1-f4ba9694becb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:08.243872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fe1c8-1974-4e0b-8ff1-f4ba9694becb None admin] PATH_INFO: `/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/88518fe83a7c4fbdb3088bb2daf04239/roles/0ea33b1c5ba54280862c8470178e2732` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:08.270447 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fe1c8-1974-4e0b-8ff1-f4ba9694becb None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0acc3e7b64dbab9113284b46f38ff, user_id=88518fe83a7c4fbdb3088bb2daf04239, role_id=0ea33b1c5ba54280862c8470178e2732)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:08.271952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fe1c8-1974-4e0b-8ff1-f4ba9694becb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:08.295742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 303/616] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:12:08 2022] PUT /identity/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/88518fe83a7c4fbdb3088bb2daf04239/roles/0ea33b1c5ba54280862c8470178e2732 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:12:08.296709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fe1c8-1974-4e0b-8ff1-f4ba9694becb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:08.347232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:08.410322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9701241-dc54-401f-afe4-83ca5da48cd3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:08.509357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4ed70-8597-4d75-a315-6d27917883b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:08.510763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4ed70-8597-4d75-a315-6d27917883b8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:08.512398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4ed70-8597-4d75-a315-6d27917883b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:08.513123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4ed70-8597-4d75-a315-6d27917883b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:08.515927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4ed70-8597-4d75-a315-6d27917883b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:08.516698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4ed70-8597-4d75-a315-6d27917883b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:08.521788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4ed70-8597-4d75-a315-6d27917883b8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:08.544449 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 314/617] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:08.550339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fe1c8-1974-4e0b-8ff1-f4ba9694becb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:08.554357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4ed70-8597-4d75-a315-6d27917883b8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:08.694890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3115e-99c4-4612-a169-acebbb92572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:08.695313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3115e-99c4-4612-a169-acebbb92572d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:08.695603 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3115e-99c4-4612-a169-acebbb92572d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:08.695884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3115e-99c4-4612-a169-acebbb92572d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:08.707403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:08.718664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3115e-99c4-4612-a169-acebbb92572d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:08.720183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3115e-99c4-4612-a169-acebbb92572d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3ea3115e-99c4-4612-a169-acebbb92572d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:08.755160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:08.757261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:08.759433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:08.759433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:08.759433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:08.759433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:08.759433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:08.759433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:08.759433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:08.759433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:08.759433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 15:12:08.759433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:08.765737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 304/618] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:12:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 469 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:08.772421 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3115e-99c4-4612-a169-acebbb92572d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:08.787830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4ed70-8597-4d75-a315-6d27917883b8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:08.865559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90ded1-3027-401b-bf69-a79856f83309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:08.867283 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90ded1-3027-401b-bf69-a79856f83309 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:08.870921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90ded1-3027-401b-bf69-a79856f83309 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:08.873563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90ded1-3027-401b-bf69-a79856f83309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:08.910203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90ded1-3027-401b-bf69-a79856f83309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:08.911701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90ded1-3027-401b-bf69-a79856f83309 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:08.917662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-8d90ded1-3027-401b-bf69-a79856f83309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:08.949560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:08.951563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:08.957873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:08.957873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:08.957873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:08.957873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:08.957873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 315/619] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:08.978692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90ded1-3027-401b-bf69-a79856f83309 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:09.044733 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3115e-99c4-4612-a169-acebbb92572d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:09.117604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee01f8-73c3-4b89-9f6b-560b5cd775b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:09.118519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee01f8-73c3-4b89-9f6b-560b5cd775b5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:09.118872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee01f8-73c3-4b89-9f6b-560b5cd775b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:09.119279 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee01f8-73c3-4b89-9f6b-560b5cd775b5 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:09.120154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee01f8-73c3-4b89-9f6b-560b5cd775b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:09.121429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee01f8-73c3-4b89-9f6b-560b5cd775b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:09.123129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee01f8-73c3-4b89-9f6b-560b5cd775b5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:09.158708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 305/620] 10.222.0.64 () {56 vars in 1135 bytes} [Fri Jul 15 15:12:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:09.161490 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a6e6d-17b5-4019-9527-b5df412e8fff None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:09.162060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a6e6d-17b5-4019-9527-b5df412e8fff None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:09.162707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a6e6d-17b5-4019-9527-b5df412e8fff None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:09.163698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90ded1-3027-401b-bf69-a79856f83309 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:09.165755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 306/621] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:09.167556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a6e6d-17b5-4019-9527-b5df412e8fff None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:09.218177 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3735de-0804-4cfa-b23a-0e6211fa2640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:09.219733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3735de-0804-4cfa-b23a-0e6211fa2640 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:09.220169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3735de-0804-4cfa-b23a-0e6211fa2640 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:09.220720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3735de-0804-4cfa-b23a-0e6211fa2640 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:09.221670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3735de-0804-4cfa-b23a-0e6211fa2640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:09.222138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3735de-0804-4cfa-b23a-0e6211fa2640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:09.225029 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3735de-0804-4cfa-b23a-0e6211fa2640 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:09.253027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 316/622] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:09.253027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a9023-a005-4176-9dd5-92872678007e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:09.253027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a9023-a005-4176-9dd5-92872678007e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:09.253027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a9023-a005-4176-9dd5-92872678007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:09.270493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:09.279960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0c0a9023-a005-4176-9dd5-92872678007e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:09.281848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0c0a9023-a005-4176-9dd5-92872678007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:09.337705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a6e6d-17b5-4019-9527-b5df412e8fff None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:09.362266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:09.391277 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 317/623] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:09.393232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a9023-a005-4176-9dd5-92872678007e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:09.402052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c18c74-4b0d-46b7-ac7f-7321e0e135ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:09.402890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c18c74-4b0d-46b7-ac7f-7321e0e135ab None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:09.403182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c18c74-4b0d-46b7-ac7f-7321e0e135ab None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:09.403468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c18c74-4b0d-46b7-ac7f-7321e0e135ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:09.425969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c18c74-4b0d-46b7-ac7f-7321e0e135ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:09.427619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c18c74-4b0d-46b7-ac7f-7321e0e135ab None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c9c18c74-4b0d-46b7-ac7f-7321e0e135ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:09.454440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:09.455991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:09.457055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:09.457055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:09.457055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:09.457055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:09.457055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 307/624] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:09.461884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c18c74-4b0d-46b7-ac7f-7321e0e135ab None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:09.560582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a9023-a005-4176-9dd5-92872678007e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:09.622632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c18c74-4b0d-46b7-ac7f-7321e0e135ab None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:09.624882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909eb54-18eb-457c-a224-92033499f0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:09.626073 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909eb54-18eb-457c-a224-92033499f0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:09.626734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909eb54-18eb-457c-a224-92033499f0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:09.627265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909eb54-18eb-457c-a224-92033499f0f4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:09.635736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:09.638958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909eb54-18eb-457c-a224-92033499f0f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:09.640713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909eb54-18eb-457c-a224-92033499f0f4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-8909eb54-18eb-457c-a224-92033499f0f4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:09.661843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:09.662939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:09.664610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:09.664610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:09.664610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:09.664610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:09.664610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:09.664610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:09.664610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:09.664610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:09.664610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 15:12:09.664610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:09.669050 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 318/625] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:12:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:09.671066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909eb54-18eb-457c-a224-92033499f0f4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:09.672354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e7f84-36a0-48bf-be31-7f58775f584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:09.673777 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e7f84-36a0-48bf-be31-7f58775f584c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:09.674230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e7f84-36a0-48bf-be31-7f58775f584c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:09.674685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e7f84-36a0-48bf-be31-7f58775f584c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:09.696538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e7f84-36a0-48bf-be31-7f58775f584c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ab6e7f84-36a0-48bf-be31-7f58775f584c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:09.708381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:09.709464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:09.710746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:09.710746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:09.710746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:09.710746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:09.710746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:09.710746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:09.710746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:09.710746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:09.710746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:09.710746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:09.710746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:09.710746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:09.714705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 308/626] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:09.715677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e7f84-36a0-48bf-be31-7f58775f584c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:09.742789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:09.813835 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909eb54-18eb-457c-a224-92033499f0f4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:09.863556 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837ad8d-689c-4018-8109-8ab0c9434b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:09.865181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837ad8d-689c-4018-8109-8ab0c9434b88 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:09.865915 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837ad8d-689c-4018-8109-8ab0c9434b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:09.866653 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837ad8d-689c-4018-8109-8ab0c9434b88 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:09.868253 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837ad8d-689c-4018-8109-8ab0c9434b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:09.869094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837ad8d-689c-4018-8109-8ab0c9434b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:09.869380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e7f84-36a0-48bf-be31-7f58775f584c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:09.871624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837ad8d-689c-4018-8109-8ab0c9434b88 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:09.887639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 319/627] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:09.889517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837ad8d-689c-4018-8109-8ab0c9434b88 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:09.923616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8fac2-c39f-43b3-a6b9-9df7ece18837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:09.924726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8fac2-c39f-43b3-a6b9-9df7ece18837 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:09.925226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8fac2-c39f-43b3-a6b9-9df7ece18837 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:09.925686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8fac2-c39f-43b3-a6b9-9df7ece18837 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:09.927356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8fac2-c39f-43b3-a6b9-9df7ece18837 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:09.927881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8fac2-c39f-43b3-a6b9-9df7ece18837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:09.929869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8fac2-c39f-43b3-a6b9-9df7ece18837 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:09.957095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 309/628] 10.222.0.64 () {56 vars in 1137 bytes} [Fri Jul 15 15:12:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:09.957974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8fac2-c39f-43b3-a6b9-9df7ece18837 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:09.993729 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:10.038338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837ad8d-689c-4018-8109-8ab0c9434b88 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:10.041582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:10.085794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476822c-31d9-4a4a-bf9b-a05be8e8cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:10.087148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476822c-31d9-4a4a-bf9b-a05be8e8cb1e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:10.087724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476822c-31d9-4a4a-bf9b-a05be8e8cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:10.088314 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476822c-31d9-4a4a-bf9b-a05be8e8cb1e None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:10.089651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476822c-31d9-4a4a-bf9b-a05be8e8cb1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:10.090280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476822c-31d9-4a4a-bf9b-a05be8e8cb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:10.092715 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476822c-31d9-4a4a-bf9b-a05be8e8cb1e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:10.111973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 320/629] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:10.111973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476822c-31d9-4a4a-bf9b-a05be8e8cb1e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:10.121293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8fac2-c39f-43b3-a6b9-9df7ece18837 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:10.178545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15174-8640-4f4c-94a5-1e8c04557c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:10.179880 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15174-8640-4f4c-94a5-1e8c04557c44 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:10.180349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15174-8640-4f4c-94a5-1e8c04557c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:10.180801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15174-8640-4f4c-94a5-1e8c04557c44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:10.189382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e15174-8640-4f4c-94a5-1e8c04557c44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:10.191708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e15174-8640-4f4c-94a5-1e8c04557c44 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-50e15174-8640-4f4c-94a5-1e8c04557c44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:10.215823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:10.216778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:10.217908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:10.217908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:10.217908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:10.217908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:10.217908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:10.217908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:10.217908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:10.217908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:10.220615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 310/630] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:10.222347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15174-8640-4f4c-94a5-1e8c04557c44 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:10.242850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476822c-31d9-4a4a-bf9b-a05be8e8cb1e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:10.287063 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3a7ad-205f-4219-b15e-b64203dfeed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:10.287850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3a7ad-205f-4219-b15e-b64203dfeed1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:10.288209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3a7ad-205f-4219-b15e-b64203dfeed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:10.288563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3a7ad-205f-4219-b15e-b64203dfeed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:10.334730 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:10.356259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:10.380963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3a7ad-205f-4219-b15e-b64203dfeed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:10.382545 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3a7ad-205f-4219-b15e-b64203dfeed1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:10.388298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15174-8640-4f4c-94a5-1e8c04557c44 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:10.438807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76806959-f17d-4f16-a9ab-15bd40faadba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:10.441327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76806959-f17d-4f16-a9ab-15bd40faadba None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:10.442146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76806959-f17d-4f16-a9ab-15bd40faadba None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:10.442847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76806959-f17d-4f16-a9ab-15bd40faadba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:10.458720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76806959-f17d-4f16-a9ab-15bd40faadba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:10.461470 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76806959-f17d-4f16-a9ab-15bd40faadba None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-76806959-f17d-4f16-a9ab-15bd40faadba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:10.489410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:10.491150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:10.492764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:10.492764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:10.492764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:10.492764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:10.504309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 311/631] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:10.506464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76806959-f17d-4f16-a9ab-15bd40faadba None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:10.522749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 321/632] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:12:10.523887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3a7ad-205f-4219-b15e-b64203dfeed1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:10.608226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:10.656597 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3a7ad-205f-4219-b15e-b64203dfeed1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:10.673649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76806959-f17d-4f16-a9ab-15bd40faadba None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:10.720939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271621fc-6d5e-4768-b835-a924560be69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:10.727286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271621fc-6d5e-4768-b835-a924560be69e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:10.727286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271621fc-6d5e-4768-b835-a924560be69e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:10.727286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271621fc-6d5e-4768-b835-a924560be69e None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:10.727286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271621fc-6d5e-4768-b835-a924560be69e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:10.727286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271621fc-6d5e-4768-b835-a924560be69e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:10.727286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271621fc-6d5e-4768-b835-a924560be69e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:10.731235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51612a1-9926-473f-b339-dbd5ac8e8b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:10.732319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51612a1-9926-473f-b339-dbd5ac8e8b5b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:10.732781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51612a1-9926-473f-b339-dbd5ac8e8b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:10.733286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51612a1-9926-473f-b339-dbd5ac8e8b5b None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:10.734708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51612a1-9926-473f-b339-dbd5ac8e8b5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:10.735401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51612a1-9926-473f-b339-dbd5ac8e8b5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:10.738767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51612a1-9926-473f-b339-dbd5ac8e8b5b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:10.744177 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:10.746281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 322/633] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:10.747969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271621fc-6d5e-4768-b835-a924560be69e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:10.759059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 312/634] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:10.761705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1b043-91c6-4ce8-aca3-07f06ef435bf None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:10.762007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1b043-91c6-4ce8-aca3-07f06ef435bf None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:10.762310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1b043-91c6-4ce8-aca3-07f06ef435bf None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:10.764692 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 313/635] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:10.766030 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1b043-91c6-4ce8-aca3-07f06ef435bf None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:10.902342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271621fc-6d5e-4768-b835-a924560be69e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:10.927835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1b043-91c6-4ce8-aca3-07f06ef435bf None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:10.939969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:10.962745 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d26dad-7954-407a-bcd5-aa2080f31f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:10.966366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d26dad-7954-407a-bcd5-aa2080f31f6e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:10.966366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d26dad-7954-407a-bcd5-aa2080f31f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:10.966366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d26dad-7954-407a-bcd5-aa2080f31f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:10.972284 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478a2e7-7c76-403b-894b-2d3027b0add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:10.973469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478a2e7-7c76-403b-894b-2d3027b0add7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:10.973469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478a2e7-7c76-403b-894b-2d3027b0add7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:10.973708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478a2e7-7c76-403b-894b-2d3027b0add7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:10.976407 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d26dad-7954-407a-bcd5-aa2080f31f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:10.978810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d26dad-7954-407a-bcd5-aa2080f31f6e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:10.993866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478a2e7-7c76-403b-894b-2d3027b0add7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:10.995398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478a2e7-7c76-403b-894b-2d3027b0add7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-99d26dad-7954-407a-bcd5-aa2080f31f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:11.000397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:11.001499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:11.002995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:11.002995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:11.002995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:11.002995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:11.002995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 323/636] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:11.003282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d26dad-7954-407a-bcd5-aa2080f31f6e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c478a2e7-7c76-403b-894b-2d3027b0add7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:11.020303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:11.021459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:11.022449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:11.022449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:11.022449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:11.022449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:11.022449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:11.022449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:11.022449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:11.022449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:11.022449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:12:11.022449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:11.022449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 314/637] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Jul 15 15:12:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:11.024162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f9cfb-57e8-4741-be1d-57a666fbf446 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:11.024606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f9cfb-57e8-4741-be1d-57a666fbf446 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:11.025017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f9cfb-57e8-4741-be1d-57a666fbf446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:11.051872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c71f9cfb-57e8-4741-be1d-57a666fbf446 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:11.053134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c71f9cfb-57e8-4741-be1d-57a666fbf446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:11.127951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:11.140259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d26dad-7954-407a-bcd5-aa2080f31f6e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:11.151066 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 315/638] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:11.152456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bd598-55e9-40c4-ad8e-add90a3f1008 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:11.152749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bd598-55e9-40c4-ad8e-add90a3f1008 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:11.153038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bd598-55e9-40c4-ad8e-add90a3f1008 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:11.154387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 316/639] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:11.155094 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bd598-55e9-40c4-ad8e-add90a3f1008 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:11.195281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65d1a7-93f0-451a-a922-d4b2342addea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:11.196224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65d1a7-93f0-451a-a922-d4b2342addea None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:11.196422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65d1a7-93f0-451a-a922-d4b2342addea None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:11.196710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65d1a7-93f0-451a-a922-d4b2342addea None admin] PATH_INFO: `/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/04f3a308ee69455287ac460d9ab2aef0/roles/0ea33b1c5ba54280862c8470178e2732` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:11.215182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65d1a7-93f0-451a-a922-d4b2342addea None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0acc3e7b64dbab9113284b46f38ff, user_id=04f3a308ee69455287ac460d9ab2aef0, role_id=0ea33b1c5ba54280862c8470178e2732)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:11.217260 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65d1a7-93f0-451a-a922-d4b2342addea None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:11.233007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 324/640] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:12:11 2022] PUT /identity/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/04f3a308ee69455287ac460d9ab2aef0/roles/0ea33b1c5ba54280862c8470178e2732 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:12:11.233918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65d1a7-93f0-451a-a922-d4b2342addea None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:11.289098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:11.325620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bd598-55e9-40c4-ad8e-add90a3f1008 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:11.387259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb695d-05ca-4bb4-b294-c1f3730bf129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:11.388292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb695d-05ca-4bb4-b294-c1f3730bf129 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:11.388292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb695d-05ca-4bb4-b294-c1f3730bf129 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:11.388639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb695d-05ca-4bb4-b294-c1f3730bf129 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:11.389527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb695d-05ca-4bb4-b294-c1f3730bf129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:11.389873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb695d-05ca-4bb4-b294-c1f3730bf129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:11.391436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb695d-05ca-4bb4-b294-c1f3730bf129 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:11.406083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 317/641] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:11.407676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38506e-e272-410f-b885-ce9febbb0f47 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:11.411180 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38506e-e272-410f-b885-ce9febbb0f47 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:11.411180 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38506e-e272-410f-b885-ce9febbb0f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:11.416515 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65d1a7-93f0-451a-a922-d4b2342addea None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:11.433466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ac38506e-e272-410f-b885-ce9febbb0f47 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:11.434420 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ac38506e-e272-410f-b885-ce9febbb0f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:11.466284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a39d1-dab4-4f02-8510-b73028548528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:11.466908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a39d1-dab4-4f02-8510-b73028548528 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:11.467247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a39d1-dab4-4f02-8510-b73028548528 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:11.467533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a39d1-dab4-4f02-8510-b73028548528 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:11.468739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a39d1-dab4-4f02-8510-b73028548528 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:11.469315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a39d1-dab4-4f02-8510-b73028548528 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:11.470923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a39d1-dab4-4f02-8510-b73028548528 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:11.494849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 325/642] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Jul 15 15:12:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:11.495957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a39d1-dab4-4f02-8510-b73028548528 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:11.531286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:11.581132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 318/643] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:11.582243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38506e-e272-410f-b885-ce9febbb0f47 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:11.649980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:11.676854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a39d1-dab4-4f02-8510-b73028548528 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:11.728737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d939bdc-3a45-45e6-9b92-2a9942e052ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:11.729539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d939bdc-3a45-45e6-9b92-2a9942e052ad None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:11.729858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d939bdc-3a45-45e6-9b92-2a9942e052ad None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:11.730149 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d939bdc-3a45-45e6-9b92-2a9942e052ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:11.737756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38506e-e272-410f-b885-ce9febbb0f47 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:11.744855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d939bdc-3a45-45e6-9b92-2a9942e052ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-0d939bdc-3a45-45e6-9b92-2a9942e052ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:11.758655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:11.759829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:11.761227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 326/644] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:11.762579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d939bdc-3a45-45e6-9b92-2a9942e052ad None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:11.802700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dcbf8-6ad5-4c95-a835-1105aa8bde59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:11.803915 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dcbf8-6ad5-4c95-a835-1105aa8bde59 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:11.804351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dcbf8-6ad5-4c95-a835-1105aa8bde59 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:11.804791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dcbf8-6ad5-4c95-a835-1105aa8bde59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:11.813714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170dcbf8-6ad5-4c95-a835-1105aa8bde59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:11.815316 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170dcbf8-6ad5-4c95-a835-1105aa8bde59 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-170dcbf8-6ad5-4c95-a835-1105aa8bde59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:11.832712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:11.833852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:11.834993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:11.834993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:11.834993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:11.834993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:11.834993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:11.834993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:11.834993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:11.834993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:11.834993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 319/645] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:11.834993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dcbf8-6ad5-4c95-a835-1105aa8bde59 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:11.905570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:11.928365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d939bdc-3a45-45e6-9b92-2a9942e052ad None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:11.979940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c0206-2742-4ad5-8935-f9198287b39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:11.980539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c0206-2742-4ad5-8935-f9198287b39d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:11.980850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c0206-2742-4ad5-8935-f9198287b39d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:11.981162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c0206-2742-4ad5-8935-f9198287b39d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:12.006733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:12.009465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dcbf8-6ad5-4c95-a835-1105aa8bde59 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:12.062855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5336de-cfdb-4a72-afae-58ddb40d664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:12.063737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5336de-cfdb-4a72-afae-58ddb40d664f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:12.064022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5336de-cfdb-4a72-afae-58ddb40d664f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:12.064840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5336de-cfdb-4a72-afae-58ddb40d664f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:12.085858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5336de-cfdb-4a72-afae-58ddb40d664f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-0d5336de-cfdb-4a72-afae-58ddb40d664f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:12.093659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:12.094746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:12.095654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:12.095654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:12.095654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:12.095654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:12.095654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:12.095654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:12.095654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:12.095654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:12.095654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:12.095654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:12.095654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:12.095654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:12.096349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c0206-2742-4ad5-8935-f9198287b39d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:12.096349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c0206-2742-4ad5-8935-f9198287b39d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:12.101814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 320/646] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:12.102713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5336de-cfdb-4a72-afae-58ddb40d664f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:12.243927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:12.251240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5336de-cfdb-4a72-afae-58ddb40d664f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:12.256262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 327/647] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:12:12.257824 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c0206-2742-4ad5-8935-f9198287b39d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:12.323574 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:12.326601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d346127-8028-4b03-aef7-3184c4e88ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:12.327356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d346127-8028-4b03-aef7-3184c4e88ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:12.327649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d346127-8028-4b03-aef7-3184c4e88ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:12.327937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d346127-8028-4b03-aef7-3184c4e88ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:12.328975 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d346127-8028-4b03-aef7-3184c4e88ab3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:12.329346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d346127-8028-4b03-aef7-3184c4e88ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:12.330868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d346127-8028-4b03-aef7-3184c4e88ab3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:12.348387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 321/648] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:12.348387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d346127-8028-4b03-aef7-3184c4e88ab3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:12.428945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c0206-2742-4ad5-8935-f9198287b39d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:12.488236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c4203-9dec-47d7-a940-943c2dd3c6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:12.489338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c4203-9dec-47d7-a940-943c2dd3c6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:12.489622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c4203-9dec-47d7-a940-943c2dd3c6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:12.489952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c4203-9dec-47d7-a940-943c2dd3c6d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:12.490800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c4203-9dec-47d7-a940-943c2dd3c6d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:12.491134 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c4203-9dec-47d7-a940-943c2dd3c6d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:12.492658 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c4203-9dec-47d7-a940-943c2dd3c6d9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:12.508949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 328/649] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:12.509786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c4203-9dec-47d7-a940-943c2dd3c6d9 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:12.533265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d346127-8028-4b03-aef7-3184c4e88ab3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:12.594833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf7f5c-db66-4a32-9f0b-516fc0f12847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:12.596069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf7f5c-db66-4a32-9f0b-516fc0f12847 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:12.596359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf7f5c-db66-4a32-9f0b-516fc0f12847 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:12.596637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf7f5c-db66-4a32-9f0b-516fc0f12847 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:12.597494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf7f5c-db66-4a32-9f0b-516fc0f12847 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:12.597816 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf7f5c-db66-4a32-9f0b-516fc0f12847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:12.601132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf7f5c-db66-4a32-9f0b-516fc0f12847 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:12.612421 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 322/650] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:12.613744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf7f5c-db66-4a32-9f0b-516fc0f12847 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:12.659205 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:12.691530 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c4203-9dec-47d7-a940-943c2dd3c6d9 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:12.702858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:12.748078 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fd8a1-b82d-483c-a284-68736a4b5ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:12.749577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fd8a1-b82d-483c-a284-68736a4b5ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:12.749871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fd8a1-b82d-483c-a284-68736a4b5ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:12.750163 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fd8a1-b82d-483c-a284-68736a4b5ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:12.764699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fd8a1-b82d-483c-a284-68736a4b5ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:12.766221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fd8a1-b82d-483c-a284-68736a4b5ec0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:12.776518 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf7f5c-db66-4a32-9f0b-516fc0f12847 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ef8fd8a1-b82d-483c-a284-68736a4b5ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:12.787376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:12.788336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:12.789764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:12.789764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:12.789764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:12.789764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:12.789764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 329/651] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:12.790280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fd8a1-b82d-483c-a284-68736a4b5ec0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:12.834313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab0a75-abe5-4fd3-9f64-048054b89c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:12.835127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab0a75-abe5-4fd3-9f64-048054b89c18 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:12.835414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab0a75-abe5-4fd3-9f64-048054b89c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:12.835694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab0a75-abe5-4fd3-9f64-048054b89c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:12.853789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab0a75-abe5-4fd3-9f64-048054b89c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:12.855492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab0a75-abe5-4fd3-9f64-048054b89c18 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-beab0a75-abe5-4fd3-9f64-048054b89c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:12.886909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:12.888560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:12.889616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:12.889616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:12.889616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:12.889616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:12.893198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 323/652] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:12.894134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab0a75-abe5-4fd3-9f64-048054b89c18 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:12.948446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fd8a1-b82d-483c-a284-68736a4b5ec0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:12.992463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:12.994135 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27037e2b-18cd-4f06-8e14-5d42b8aac0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:12.995311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27037e2b-18cd-4f06-8e14-5d42b8aac0fc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:12.995970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27037e2b-18cd-4f06-8e14-5d42b8aac0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:12.996328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27037e2b-18cd-4f06-8e14-5d42b8aac0fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:12.997493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27037e2b-18cd-4f06-8e14-5d42b8aac0fc None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=a87a4ae82b1b4619b90f9ad0f3dea5c3) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:12.998051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27037e2b-18cd-4f06-8e14-5d42b8aac0fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:13.000748 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27037e2b-18cd-4f06-8e14-5d42b8aac0fc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:13.009147 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 330/653] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:12 2022] GET /identity/v3/role_assignments?user.id=a87a4ae82b1b4619b90f9ad0f3dea5c3&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:13.017948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27037e2b-18cd-4f06-8e14-5d42b8aac0fc None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:13.055412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab0a75-abe5-4fd3-9f64-048054b89c18 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:13.072964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:13.129716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdae14-b8bc-4185-ba49-0e8c3ae7c4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:13.130670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdae14-b8bc-4185-ba49-0e8c3ae7c4eb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:13.130964 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdae14-b8bc-4185-ba49-0e8c3ae7c4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:13.131238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdae14-b8bc-4185-ba49-0e8c3ae7c4eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:13.146394 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdae14-b8bc-4185-ba49-0e8c3ae7c4eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:13.148498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdae14-b8bc-4185-ba49-0e8c3ae7c4eb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1bcdae14-b8bc-4185-ba49-0e8c3ae7c4eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:13.171608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:13.174240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:13.176070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:13.176070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:13.176070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:13.176070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:13.177558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 324/654] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:13.178567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdae14-b8bc-4185-ba49-0e8c3ae7c4eb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:13.218220 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27037e2b-18cd-4f06-8e14-5d42b8aac0fc None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:13.278973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f809410-a4bb-4bca-baba-55c0821ec47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:13.279995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f809410-a4bb-4bca-baba-55c0821ec47f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:13.280420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f809410-a4bb-4bca-baba-55c0821ec47f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:13.280836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f809410-a4bb-4bca-baba-55c0821ec47f None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:13.281939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f809410-a4bb-4bca-baba-55c0821ec47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:13.283689 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f809410-a4bb-4bca-baba-55c0821ec47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:13.285097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f809410-a4bb-4bca-baba-55c0821ec47f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:13.307881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 331/655] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:13.309411 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f809410-a4bb-4bca-baba-55c0821ec47f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:13.352331 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdae14-b8bc-4185-ba49-0e8c3ae7c4eb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:13.393918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:13.409219 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343c07-dbdb-456a-aaf3-48b0fa916e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:13.410099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343c07-dbdb-456a-aaf3-48b0fa916e8a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:13.410470 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343c07-dbdb-456a-aaf3-48b0fa916e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:13.410759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343c07-dbdb-456a-aaf3-48b0fa916e8a None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:13.411581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c343c07-dbdb-456a-aaf3-48b0fa916e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:13.411900 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c343c07-dbdb-456a-aaf3-48b0fa916e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:13.414294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c343c07-dbdb-456a-aaf3-48b0fa916e8a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:13.442811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 325/656] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:13.444116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343c07-dbdb-456a-aaf3-48b0fa916e8a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:13.447939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:13.478969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f809410-a4bb-4bca-baba-55c0821ec47f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:13.533517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca9948-45a7-4372-9bce-ff28ba407268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:13.535310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca9948-45a7-4372-9bce-ff28ba407268 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:13.535951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca9948-45a7-4372-9bce-ff28ba407268 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:13.536439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca9948-45a7-4372-9bce-ff28ba407268 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:13.538091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca9948-45a7-4372-9bce-ff28ba407268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:13.538676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca9948-45a7-4372-9bce-ff28ba407268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:13.540332 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca9948-45a7-4372-9bce-ff28ba407268 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:13.558595 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 332/657] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:13.559591 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca9948-45a7-4372-9bce-ff28ba407268 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:13.624252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343c07-dbdb-456a-aaf3-48b0fa916e8a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:13.684802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad6a86-24e7-4b93-b8c1-d2ed9540aba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:13.685774 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad6a86-24e7-4b93-b8c1-d2ed9540aba0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:13.685999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad6a86-24e7-4b93-b8c1-d2ed9540aba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:13.686310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad6a86-24e7-4b93-b8c1-d2ed9540aba0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:13.702109 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad6a86-24e7-4b93-b8c1-d2ed9540aba0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:13.704025 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad6a86-24e7-4b93-b8c1-d2ed9540aba0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-84ad6a86-24e7-4b93-b8c1-d2ed9540aba0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:13.722293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:13.723271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:13.724220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:13.724220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:13.724220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:13.724220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:13.724220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:13.724220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:13.724220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:13.724220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:13.724824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 326/658] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:13.729264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad6a86-24e7-4b93-b8c1-d2ed9540aba0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:13.740340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca9948-45a7-4372-9bce-ff28ba407268 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:13.788403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c47a3-4115-4003-9119-e900ffa11dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:13.789304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c47a3-4115-4003-9119-e900ffa11dfd None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:13.789586 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c47a3-4115-4003-9119-e900ffa11dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:13.789923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c47a3-4115-4003-9119-e900ffa11dfd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:13.798907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c47a3-4115-4003-9119-e900ffa11dfd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:13.800399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c47a3-4115-4003-9119-e900ffa11dfd None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:13.809589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-808c47a3-4115-4003-9119-e900ffa11dfd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:13.818219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:13.819433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:13.820375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:13.820375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:13.820375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:13.820375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:13.820375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:13.820375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:13.820375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:13.820375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:13.820375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:12:13.820375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:13.824438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 333/659] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:12:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:13.826013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70558-6ed1-4d64-949c-d9d9e8db4e5e None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:13.826329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70558-6ed1-4d64-949c-d9d9e8db4e5e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:13.826575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70558-6ed1-4d64-949c-d9d9e8db4e5e None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:13.828200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 334/660] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:13.828781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a70558-6ed1-4d64-949c-d9d9e8db4e5e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:13.833733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:13.904687 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad6a86-24e7-4b93-b8c1-d2ed9540aba0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:13.958174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a0b6a-4719-4015-a22f-e38aa8face4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:13.959563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a0b6a-4719-4015-a22f-e38aa8face4d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:13.960063 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a0b6a-4719-4015-a22f-e38aa8face4d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:13.960549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a0b6a-4719-4015-a22f-e38aa8face4d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:13.975298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a0b6a-4719-4015-a22f-e38aa8face4d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:13.978092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a0b6a-4719-4015-a22f-e38aa8face4d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:14.006460 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a70558-6ed1-4d64-949c-d9d9e8db4e5e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-895a0b6a-4719-4015-a22f-e38aa8face4d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:14.009234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:14.010339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:14.011415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:14.011415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:14.011415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:14.011415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:14.011415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:14.011415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:14.011415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:14.011415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:14.011415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 15:12:14.011415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:14.011415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 327/661] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:14.012751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a0b6a-4719-4015-a22f-e38aa8face4d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:14.058672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9555d5-a1d7-4d28-af0e-db86dbb20798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:14.059847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9555d5-a1d7-4d28-af0e-db86dbb20798 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:14.060709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9555d5-a1d7-4d28-af0e-db86dbb20798 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:14.061486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9555d5-a1d7-4d28-af0e-db86dbb20798 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:14.062745 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9555d5-a1d7-4d28-af0e-db86dbb20798 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:14.063745 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9555d5-a1d7-4d28-af0e-db86dbb20798 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:14.065929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9555d5-a1d7-4d28-af0e-db86dbb20798 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:14.084849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 335/662] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:14.087015 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefcf4-7688-4f5a-8b82-e4e722506255 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:14.087506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefcf4-7688-4f5a-8b82-e4e722506255 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:14.087993 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefcf4-7688-4f5a-8b82-e4e722506255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:14.124701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3ffefcf4-7688-4f5a-8b82-e4e722506255 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:14.126321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3ffefcf4-7688-4f5a-8b82-e4e722506255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:14.164361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a0b6a-4719-4015-a22f-e38aa8face4d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:14.168782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:14.213125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:14.223773 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0d692-f52b-48a3-a0a2-e9287e4dbcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:14.224517 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0d692-f52b-48a3-a0a2-e9287e4dbcac None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:14.224759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0d692-f52b-48a3-a0a2-e9287e4dbcac None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:14.225039 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0d692-f52b-48a3-a0a2-e9287e4dbcac None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:14.225935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0d692-f52b-48a3-a0a2-e9287e4dbcac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:14.226246 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0d692-f52b-48a3-a0a2-e9287e4dbcac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:14.227711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0d692-f52b-48a3-a0a2-e9287e4dbcac None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:14.229873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 336/663] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:14.231615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffefcf4-7688-4f5a-8b82-e4e722506255 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:14.265158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 328/664] 10.222.0.64 () {56 vars in 1137 bytes} [Fri Jul 15 15:12:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:14.265158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0d692-f52b-48a3-a0a2-e9287e4dbcac None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:14.389711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffefcf4-7688-4f5a-8b82-e4e722506255 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:14.440926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da119909-4110-4d7b-8324-eff345b0dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:14.441700 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da119909-4110-4d7b-8324-eff345b0dad6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:14.442020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da119909-4110-4d7b-8324-eff345b0dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:14.442315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da119909-4110-4d7b-8324-eff345b0dad6 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:14.443107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da119909-4110-4d7b-8324-eff345b0dad6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:14.443417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da119909-4110-4d7b-8324-eff345b0dad6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:14.445038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da119909-4110-4d7b-8324-eff345b0dad6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:14.453132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0d692-f52b-48a3-a0a2-e9287e4dbcac None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:14.469123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 337/665] 10.222.0.64 () {56 vars in 1139 bytes} [Fri Jul 15 15:12:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:14.470172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da119909-4110-4d7b-8324-eff345b0dad6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:14.513247 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117944b4-700a-4456-b3bc-e688dbb19538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:14.513970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117944b4-700a-4456-b3bc-e688dbb19538 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:14.514259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117944b4-700a-4456-b3bc-e688dbb19538 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:14.514541 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117944b4-700a-4456-b3bc-e688dbb19538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:14.515405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117944b4-700a-4456-b3bc-e688dbb19538 None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=b022a37031b940c3bd67861373926e58) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:14.516127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117944b4-700a-4456-b3bc-e688dbb19538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:14.517827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117944b4-700a-4456-b3bc-e688dbb19538 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:14.542555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 329/666] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:14 2022] GET /identity/v3/role_assignments?user.id=b022a37031b940c3bd67861373926e58&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:14.542555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117944b4-700a-4456-b3bc-e688dbb19538 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:14.555734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:14.584500 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:14.677594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da119909-4110-4d7b-8324-eff345b0dad6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:14.716051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117944b4-700a-4456-b3bc-e688dbb19538 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:14.731343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e68f8-47c1-4faf-920b-5dc395665566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:14.731917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e68f8-47c1-4faf-920b-5dc395665566 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:14.732224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e68f8-47c1-4faf-920b-5dc395665566 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:14.732582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e68f8-47c1-4faf-920b-5dc395665566 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:14.749165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e68f8-47c1-4faf-920b-5dc395665566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-9a5e68f8-47c1-4faf-920b-5dc395665566 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:14.760519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:14.762444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 338/667] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:14.764137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e68f8-47c1-4faf-920b-5dc395665566 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:14.773723 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0faf2-9b46-4a55-b7f4-04e3def34fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:14.774628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0faf2-9b46-4a55-b7f4-04e3def34fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:14.775072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0faf2-9b46-4a55-b7f4-04e3def34fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:14.776271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0faf2-9b46-4a55-b7f4-04e3def34fd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:14.888378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0faf2-9b46-4a55-b7f4-04e3def34fd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:14.889510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0faf2-9b46-4a55-b7f4-04e3def34fd4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:14.931672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:14.964143 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e68f8-47c1-4faf-920b-5dc395665566 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:14.981938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:15.023500 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a47d30-f7a7-4c76-beb0-c6af6d9317e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:15.024493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a47d30-f7a7-4c76-beb0-c6af6d9317e4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:15.024790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a47d30-f7a7-4c76-beb0-c6af6d9317e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:15.025091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a47d30-f7a7-4c76-beb0-c6af6d9317e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:15.059384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 330/668] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:12:15.060556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0faf2-9b46-4a55-b7f4-04e3def34fd4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:15.135255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a47d30-f7a7-4c76-beb0-c6af6d9317e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:15.137659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a47d30-f7a7-4c76-beb0-c6af6d9317e4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:15.233335 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0faf2-9b46-4a55-b7f4-04e3def34fd4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:15.265137 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:15.276182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbacd6-0302-49a7-8324-8b0ead4b5736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:15.277001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbacd6-0302-49a7-8324-8b0ead4b5736 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:15.277417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbacd6-0302-49a7-8324-8b0ead4b5736 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:15.277833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbacd6-0302-49a7-8324-8b0ead4b5736 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:15.278954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbacd6-0302-49a7-8324-8b0ead4b5736 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:15.279486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbacd6-0302-49a7-8324-8b0ead4b5736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:15.281288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbacd6-0302-49a7-8324-8b0ead4b5736 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:15.289880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 339/669] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:12:15.290838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a47d30-f7a7-4c76-beb0-c6af6d9317e4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:15.291479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 331/670] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:15.297372 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbacd6-0302-49a7-8324-8b0ead4b5736 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:15.307215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:15.441081 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbacd6-0302-49a7-8324-8b0ead4b5736 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:15.450026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a47d30-f7a7-4c76-beb0-c6af6d9317e4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:15.480392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4755058-896c-4559-b5b3-8a24015499da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:15.481345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4755058-896c-4559-b5b3-8a24015499da None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:15.481697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4755058-896c-4559-b5b3-8a24015499da None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:15.482114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4755058-896c-4559-b5b3-8a24015499da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:15.495310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4755058-896c-4559-b5b3-8a24015499da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:15.496588 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61678e3-f0f8-47a8-a783-07813dcca2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:15.497442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61678e3-f0f8-47a8-a783-07813dcca2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:15.497601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4755058-896c-4559-b5b3-8a24015499da None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:15.497767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61678e3-f0f8-47a8-a783-07813dcca2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:15.498007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61678e3-f0f8-47a8-a783-07813dcca2a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:15.511070 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61678e3-f0f8-47a8-a783-07813dcca2a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:15.512618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61678e3-f0f8-47a8-a783-07813dcca2a9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a4755058-896c-4559-b5b3-8a24015499da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:15.522504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:15.523680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:15.524726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:15.524726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:15.524726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:15.524726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:15.526731 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 332/671] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:15.527993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4755058-896c-4559-b5b3-8a24015499da None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-a61678e3-f0f8-47a8-a783-07813dcca2a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:15.533617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:15.534984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:15.536136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:15.536136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:15.536136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:15.536136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:15.538939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 340/672] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:15.539934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61678e3-f0f8-47a8-a783-07813dcca2a9 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:15.588243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:15.621231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:15.679720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4755058-896c-4559-b5b3-8a24015499da None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:15.695461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61678e3-f0f8-47a8-a783-07813dcca2a9 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:15.727536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1cc01-acd1-453f-bc8b-0ecf512d9b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:15.728472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1cc01-acd1-453f-bc8b-0ecf512d9b3a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:15.728753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1cc01-acd1-453f-bc8b-0ecf512d9b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:15.729039 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1cc01-acd1-453f-bc8b-0ecf512d9b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:15.744083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b81673-70a0-4037-a138-4bf9a22c5585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:15.744776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b81673-70a0-4037-a138-4bf9a22c5585 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:15.745096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b81673-70a0-4037-a138-4bf9a22c5585 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:15.745443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b81673-70a0-4037-a138-4bf9a22c5585 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:15.746166 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b81673-70a0-4037-a138-4bf9a22c5585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:15.746483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b81673-70a0-4037-a138-4bf9a22c5585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:15.747959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b81673-70a0-4037-a138-4bf9a22c5585 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:15.757271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1cc01-acd1-453f-bc8b-0ecf512d9b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:15.759478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1cc01-acd1-453f-bc8b-0ecf512d9b3a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:15.770076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 341/673] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:15.770076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b81673-70a0-4037-a138-4bf9a22c5585 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-22a1cc01-acd1-453f-bc8b-0ecf512d9b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:15.784832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:15.786520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:15.788131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:15.788131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:15.788131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:15.788131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:15.793688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 333/674] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:15.793688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5b341-0530-4373-9a3d-4f51d1c41c6f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:15.793688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5b341-0530-4373-9a3d-4f51d1c41c6f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:15.794099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5b341-0530-4373-9a3d-4f51d1c41c6f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:15.799674 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 334/675] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:15.799674 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5b341-0530-4373-9a3d-4f51d1c41c6f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:15.906362 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b81673-70a0-4037-a138-4bf9a22c5585 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:15.936250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:15.939790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:15.951334 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5b341-0530-4373-9a3d-4f51d1c41c6f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:15.959115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fe99a-8adb-4679-a97d-b114864be639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:15.960292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fe99a-8adb-4679-a97d-b114864be639 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:15.960732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fe99a-8adb-4679-a97d-b114864be639 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:15.961232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fe99a-8adb-4679-a97d-b114864be639 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:15.962253 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fe99a-8adb-4679-a97d-b114864be639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:15.962796 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fe99a-8adb-4679-a97d-b114864be639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:15.964512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fe99a-8adb-4679-a97d-b114864be639 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:15.987656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 342/676] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:15.988943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fe99a-8adb-4679-a97d-b114864be639 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:16.012703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd1b86-db99-4636-86a5-c9dac33e783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:16.014473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd1b86-db99-4636-86a5-c9dac33e783c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:16.015264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd1b86-db99-4636-86a5-c9dac33e783c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:16.015786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd1b86-db99-4636-86a5-c9dac33e783c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:16.032185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd1b86-db99-4636-86a5-c9dac33e783c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:16.034570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd1b86-db99-4636-86a5-c9dac33e783c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f1bd1b86-db99-4636-86a5-c9dac33e783c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:16.052809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:16.053913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:16.054897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:16.054897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:16.054897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:16.054897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:16.054897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:16.054897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:16.054897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:16.054897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:16.054897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 15:12:16.054897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:16.056194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 335/677] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:12:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:16.057640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fac04-4437-460f-a9b2-0ab0b874190b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:16.057922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fac04-4437-460f-a9b2-0ab0b874190b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:16.058200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fac04-4437-460f-a9b2-0ab0b874190b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:16.080939 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ef2fac04-4437-460f-a9b2-0ab0b874190b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:16.082249 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ef2fac04-4437-460f-a9b2-0ab0b874190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:16.152690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fe99a-8adb-4679-a97d-b114864be639 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:16.178976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 336/678] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:16.188163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fac04-4437-460f-a9b2-0ab0b874190b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:16.215595 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcd54f-efa8-438f-9c3d-71e4793afdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:16.216499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcd54f-efa8-438f-9c3d-71e4793afdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:16.216794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcd54f-efa8-438f-9c3d-71e4793afdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:16.217091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcd54f-efa8-438f-9c3d-71e4793afdc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:16.217860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcd54f-efa8-438f-9c3d-71e4793afdc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:16.218243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcd54f-efa8-438f-9c3d-71e4793afdc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:16.227529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcd54f-efa8-438f-9c3d-71e4793afdc2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:16.243295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 343/679] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:16.244162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcd54f-efa8-438f-9c3d-71e4793afdc2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:16.318652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:16.319791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:16.350419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fac04-4437-460f-a9b2-0ab0b874190b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:16.400899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcd54f-efa8-438f-9c3d-71e4793afdc2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:16.405955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b405a-e2b9-4ba3-8f18-e8b78a1e19ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:16.406804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b405a-e2b9-4ba3-8f18-e8b78a1e19ad None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:16.407096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b405a-e2b9-4ba3-8f18-e8b78a1e19ad None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:16.407368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b405a-e2b9-4ba3-8f18-e8b78a1e19ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:16.416948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b405a-e2b9-4ba3-8f18-e8b78a1e19ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:16.418562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b405a-e2b9-4ba3-8f18-e8b78a1e19ad None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-288b405a-e2b9-4ba3-8f18-e8b78a1e19ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:16.438086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:16.439649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:16.440738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:16.440738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:16.440738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:16.440738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:16.440738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:16.440738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:16.440738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:16.440738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:16.440738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 337/680] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:16.442230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b405a-e2b9-4ba3-8f18-e8b78a1e19ad None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:16.467849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f220-6565-41d6-b18a-5b116d01de1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:16.468601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f220-6565-41d6-b18a-5b116d01de1f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:16.468902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f220-6565-41d6-b18a-5b116d01de1f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:16.469202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f220-6565-41d6-b18a-5b116d01de1f None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:16.470093 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f220-6565-41d6-b18a-5b116d01de1f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:16.470554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f220-6565-41d6-b18a-5b116d01de1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:16.472594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f220-6565-41d6-b18a-5b116d01de1f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:16.499104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 344/681] 10.222.0.64 () {56 vars in 1135 bytes} [Fri Jul 15 15:12:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:16.499104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f220-6565-41d6-b18a-5b116d01de1f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:16.587584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b405a-e2b9-4ba3-8f18-e8b78a1e19ad None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:16.646467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:16.649778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f220-6565-41d6-b18a-5b116d01de1f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:16.659912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4d9c4-1009-438f-a491-d2a9e486055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:16.662820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4d9c4-1009-438f-a491-d2a9e486055b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:16.663518 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4d9c4-1009-438f-a491-d2a9e486055b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:16.663988 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4d9c4-1009-438f-a491-d2a9e486055b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:16.679044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4d9c4-1009-438f-a491-d2a9e486055b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:16.680839 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4d9c4-1009-438f-a491-d2a9e486055b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:16.683485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:16.708830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fb8be-8d1b-4e9f-8e4b-7391d43e6423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:16.710167 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fb8be-8d1b-4e9f-8e4b-7391d43e6423 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e8b4d9c4-1009-438f-a491-d2a9e486055b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:16.710475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:16.711650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:16.718749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:16.718749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:16.718749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:16.718749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:16.719183 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fb8be-8d1b-4e9f-8e4b-7391d43e6423 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:16.719183 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fb8be-8d1b-4e9f-8e4b-7391d43e6423 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:16.719435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 338/682] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:16.719435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4d9c4-1009-438f-a491-d2a9e486055b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:16.719665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fb8be-8d1b-4e9f-8e4b-7391d43e6423 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:16.720967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fb8be-8d1b-4e9f-8e4b-7391d43e6423 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-0b6fb8be-8d1b-4e9f-8e4b-7391d43e6423 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:16.738688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:16.740370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:16.742678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:16.742678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:16.742678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:16.742678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:16.742678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:16.742678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:16.742678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:16.742678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:16.742678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 345/683] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:16.742678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fb8be-8d1b-4e9f-8e4b-7391d43e6423 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:16.873053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4d9c4-1009-438f-a491-d2a9e486055b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:16.889331 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fb8be-8d1b-4e9f-8e4b-7391d43e6423 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:16.927103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37177ba-e00b-42b3-800c-2d6c64b5353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:16.928839 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37177ba-e00b-42b3-800c-2d6c64b5353c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:16.929317 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37177ba-e00b-42b3-800c-2d6c64b5353c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:16.929768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37177ba-e00b-42b3-800c-2d6c64b5353c None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:16.931115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37177ba-e00b-42b3-800c-2d6c64b5353c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:16.931616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37177ba-e00b-42b3-800c-2d6c64b5353c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:16.934134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37177ba-e00b-42b3-800c-2d6c64b5353c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:16.953800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810840d-9b03-433f-bc5f-6e95dcce2b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:16.955060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810840d-9b03-433f-bc5f-6e95dcce2b6f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:16.955353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810840d-9b03-433f-bc5f-6e95dcce2b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:16.955633 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810840d-9b03-433f-bc5f-6e95dcce2b6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:16.967012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 339/684] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:16.967012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37177ba-e00b-42b3-800c-2d6c64b5353c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:16.998440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:17.046107 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:17.056703 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810840d-9b03-433f-bc5f-6e95dcce2b6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:17.058263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810840d-9b03-433f-bc5f-6e95dcce2b6f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:17.102002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37177ba-e00b-42b3-800c-2d6c64b5353c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:17.164323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf1665-5702-4bcc-a7d9-5deccc3dff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:17.164323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf1665-5702-4bcc-a7d9-5deccc3dff5c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:17.164323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf1665-5702-4bcc-a7d9-5deccc3dff5c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:17.164323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf1665-5702-4bcc-a7d9-5deccc3dff5c None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:17.165029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf1665-5702-4bcc-a7d9-5deccc3dff5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:17.165029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf1665-5702-4bcc-a7d9-5deccc3dff5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:17.165029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf1665-5702-4bcc-a7d9-5deccc3dff5c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:17.188118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 340/685] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:17.189017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf1665-5702-4bcc-a7d9-5deccc3dff5c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:17.220810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 346/686] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:12:17.221803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810840d-9b03-433f-bc5f-6e95dcce2b6f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:17.306463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:17.339169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf1665-5702-4bcc-a7d9-5deccc3dff5c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:17.357300 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:17.359644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810840d-9b03-433f-bc5f-6e95dcce2b6f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:17.384042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6aefda-c3fa-4766-a266-d4284c4a6a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:17.384894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6aefda-c3fa-4766-a266-d4284c4a6a8e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:17.385240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6aefda-c3fa-4766-a266-d4284c4a6a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:17.385519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6aefda-c3fa-4766-a266-d4284c4a6a8e None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:17.386324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6aefda-c3fa-4766-a266-d4284c4a6a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:17.386632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6aefda-c3fa-4766-a266-d4284c4a6a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:17.388118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6aefda-c3fa-4766-a266-d4284c4a6a8e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:17.404204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b076ec-a4d2-4459-a622-22e9397f3492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:17.404835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 341/687] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:17.404949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b076ec-a4d2-4459-a622-22e9397f3492 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:17.405171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b076ec-a4d2-4459-a622-22e9397f3492 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:17.405449 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b076ec-a4d2-4459-a622-22e9397f3492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:17.405982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e2a2d-be44-411d-8870-545c6fba6f62 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:17.406269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e2a2d-be44-411d-8870-545c6fba6f62 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:17.406366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b076ec-a4d2-4459-a622-22e9397f3492 None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=43cfdc27dbdb45c49f50e7bb3f93c260) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:17.406541 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e2a2d-be44-411d-8870-545c6fba6f62 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:17.406641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b076ec-a4d2-4459-a622-22e9397f3492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:17.408072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 342/688] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:17.408191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b076ec-a4d2-4459-a622-22e9397f3492 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:17.408596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e2a2d-be44-411d-8870-545c6fba6f62 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:17.418867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 347/689] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:17 2022] GET /identity/v3/role_assignments?user.id=43cfdc27dbdb45c49f50e7bb3f93c260&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:17.419631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b076ec-a4d2-4459-a622-22e9397f3492 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:17.601469 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b076ec-a4d2-4459-a622-22e9397f3492 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:17.605343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e2a2d-be44-411d-8870-545c6fba6f62 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:17.640482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:17.653187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d989ec-8f81-4d2a-8a40-65eb9c4b8a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:17.653886 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d989ec-8f81-4d2a-8a40-65eb9c4b8a23 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:17.654170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d989ec-8f81-4d2a-8a40-65eb9c4b8a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:17.654446 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d989ec-8f81-4d2a-8a40-65eb9c4b8a23 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:17.655162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d989ec-8f81-4d2a-8a40-65eb9c4b8a23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:17.656625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d989ec-8f81-4d2a-8a40-65eb9c4b8a23 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:17.658882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36e529-75f1-42ef-9f9a-c7c74f5a33db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:17.659755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36e529-75f1-42ef-9f9a-c7c74f5a33db None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:17.660181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36e529-75f1-42ef-9f9a-c7c74f5a33db None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:17.660623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36e529-75f1-42ef-9f9a-c7c74f5a33db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:17.676329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36e529-75f1-42ef-9f9a-c7c74f5a33db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:17.678533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36e529-75f1-42ef-9f9a-c7c74f5a33db None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:17.684032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 343/690] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:12:17 2022] POST /identity/v3/users => generated 254 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:12:17.689910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf04950-4a80-4314-a06a-097bfb410589 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:17.689910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf04950-4a80-4314-a06a-097bfb410589 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:17.689910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf04950-4a80-4314-a06a-097bfb410589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-9c36e529-75f1-42ef-9f9a-c7c74f5a33db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:17.717959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:17.719180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:17.720953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:17.720953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:17.720953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:17.720953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:17.720953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 348/691] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:17.721383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36e529-75f1-42ef-9f9a-c7c74f5a33db None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:17.722838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7cf04950-4a80-4314-a06a-097bfb410589 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:17.724895 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7cf04950-4a80-4314-a06a-097bfb410589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:17.769954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:17.853536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 344/692] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:17.855261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf04950-4a80-4314-a06a-097bfb410589 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:17.894325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36e529-75f1-42ef-9f9a-c7c74f5a33db None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:17.956639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2f0da-38ee-4b7d-936a-3b1e52c45166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:17.956639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2f0da-38ee-4b7d-936a-3b1e52c45166 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:17.956897 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2f0da-38ee-4b7d-936a-3b1e52c45166 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:17.957187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2f0da-38ee-4b7d-936a-3b1e52c45166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:17.957952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2f0da-38ee-4b7d-936a-3b1e52c45166 None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=88518fe83a7c4fbdb3088bb2daf04239) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:17.958965 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2f0da-38ee-4b7d-936a-3b1e52c45166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:17.960314 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2f0da-38ee-4b7d-936a-3b1e52c45166 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:17.970743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 349/693] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:17 2022] GET /identity/v3/role_assignments?user.id=88518fe83a7c4fbdb3088bb2daf04239&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:17.972053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2f0da-38ee-4b7d-936a-3b1e52c45166 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:18.045473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:18.081718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf04950-4a80-4314-a06a-097bfb410589 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:18.133801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdee95-6a55-4c18-b1d7-e59cd524a5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:18.134803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdee95-6a55-4c18-b1d7-e59cd524a5ab None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:18.135091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdee95-6a55-4c18-b1d7-e59cd524a5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:18.135368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdee95-6a55-4c18-b1d7-e59cd524a5ab None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:18.136124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdee95-6a55-4c18-b1d7-e59cd524a5ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:18.136432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdee95-6a55-4c18-b1d7-e59cd524a5ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:18.138470 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdee95-6a55-4c18-b1d7-e59cd524a5ab None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:18.171255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 345/694] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:18.178133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdee95-6a55-4c18-b1d7-e59cd524a5ab None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:18.191381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2f0da-38ee-4b7d-936a-3b1e52c45166 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:18.225207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:18.249437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad3c2-b77c-4872-969e-eb62bffaf907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:18.252545 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad3c2-b77c-4872-969e-eb62bffaf907 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:18.252912 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad3c2-b77c-4872-969e-eb62bffaf907 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:18.254625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad3c2-b77c-4872-969e-eb62bffaf907 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:18.278348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ad3c2-b77c-4872-969e-eb62bffaf907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ef1ad3c2-b77c-4872-969e-eb62bffaf907 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:18.293648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:18.294725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:18.295559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:18.295559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:18.295559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:18.295559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:18.295559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:18.295559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:18.295559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:18.295559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:18.295559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:18.295559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:18.295559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:12:18.295559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:18.296820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 350/695] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:12:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:18.306111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad3c2-b77c-4872-969e-eb62bffaf907 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:18.365758 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdee95-6a55-4c18-b1d7-e59cd524a5ab None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:18.421676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae30978-dd23-4947-876f-8e735993760a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:18.422986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae30978-dd23-4947-876f-8e735993760a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:18.423531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae30978-dd23-4947-876f-8e735993760a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:18.424178 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae30978-dd23-4947-876f-8e735993760a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:18.438723 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae30978-dd23-4947-876f-8e735993760a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:18.441261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae30978-dd23-4947-876f-8e735993760a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8ae30978-dd23-4947-876f-8e735993760a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:18.480079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:18.481033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:18.481941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:18.481941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:18.481941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:18.481941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:18.481941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:18.481941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:18.481941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:18.481941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:18.486275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 346/696] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:18.492831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae30978-dd23-4947-876f-8e735993760a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:18.550018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:18.555700 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad3c2-b77c-4872-969e-eb62bffaf907 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:18.670405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbcedb-7a79-45ce-b811-2c6ee0f5005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:18.671952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbcedb-7a79-45ce-b811-2c6ee0f5005c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:18.672342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbcedb-7a79-45ce-b811-2c6ee0f5005c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:18.672726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbcedb-7a79-45ce-b811-2c6ee0f5005c None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:18.674270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbcedb-7a79-45ce-b811-2c6ee0f5005c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:18.674688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbcedb-7a79-45ce-b811-2c6ee0f5005c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:18.676221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbcedb-7a79-45ce-b811-2c6ee0f5005c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:18.694881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae30978-dd23-4947-876f-8e735993760a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:18.708331 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 351/697] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:18.711659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:18.718166 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbcedb-7a79-45ce-b811-2c6ee0f5005c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:18.757475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd89fa-1734-40ee-902b-edd42fb3932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:18.758056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd89fa-1734-40ee-902b-edd42fb3932c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:18.758338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd89fa-1734-40ee-902b-edd42fb3932c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:18.758611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd89fa-1734-40ee-902b-edd42fb3932c None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:18.759411 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd89fa-1734-40ee-902b-edd42fb3932c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:18.759713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd89fa-1734-40ee-902b-edd42fb3932c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:18.761436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd89fa-1734-40ee-902b-edd42fb3932c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:18.776198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 347/698] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:18.790268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd89fa-1734-40ee-902b-edd42fb3932c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:18.897376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbcedb-7a79-45ce-b811-2c6ee0f5005c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:18.944937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53f6ea-265d-406e-b7d6-b9028ec2d9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:18.946201 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f6ea-265d-406e-b7d6-b9028ec2d9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:18.947321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f6ea-265d-406e-b7d6-b9028ec2d9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:18.947920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f6ea-265d-406e-b7d6-b9028ec2d9c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:18.967741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53f6ea-265d-406e-b7d6-b9028ec2d9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:18.970893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53f6ea-265d-406e-b7d6-b9028ec2d9c7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-fe53f6ea-265d-406e-b7d6-b9028ec2d9c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:18.992779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:18.993853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:18.994905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:18.994905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:18.994905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:18.994905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:18.997310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 352/699] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:19.005717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53f6ea-265d-406e-b7d6-b9028ec2d9c7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:19.037713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:19.054784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd89fa-1734-40ee-902b-edd42fb3932c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:19.157289 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d85e7a-10d4-4e70-8021-2fb0d49ba371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:19.158836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d85e7a-10d4-4e70-8021-2fb0d49ba371 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:19.158920 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d85e7a-10d4-4e70-8021-2fb0d49ba371 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:19.159152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d85e7a-10d4-4e70-8021-2fb0d49ba371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:19.160018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d85e7a-10d4-4e70-8021-2fb0d49ba371 None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=04f3a308ee69455287ac460d9ab2aef0) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:19.160328 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d85e7a-10d4-4e70-8021-2fb0d49ba371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:19.162534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d85e7a-10d4-4e70-8021-2fb0d49ba371 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:19.173266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 348/700] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:18 2022] GET /identity/v3/role_assignments?user.id=04f3a308ee69455287ac460d9ab2aef0&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 608 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:19.198067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53f6ea-265d-406e-b7d6-b9028ec2d9c7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:19.245117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1dc35-6bfd-41d4-9ab6-1fa5e7cb016d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:19.245826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1dc35-6bfd-41d4-9ab6-1fa5e7cb016d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:19.246115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1dc35-6bfd-41d4-9ab6-1fa5e7cb016d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:19.246394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1dc35-6bfd-41d4-9ab6-1fa5e7cb016d None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:19.247160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1dc35-6bfd-41d4-9ab6-1fa5e7cb016d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:19.247471 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1dc35-6bfd-41d4-9ab6-1fa5e7cb016d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:19.248907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1dc35-6bfd-41d4-9ab6-1fa5e7cb016d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:19.268312 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 353/701] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:19.276865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d85e7a-10d4-4e70-8021-2fb0d49ba371 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:19.284246 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:19.439965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d85e7a-10d4-4e70-8021-2fb0d49ba371 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:19.479326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2363b-997d-4470-ad7c-e1ba4bf1ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:19.480198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2363b-997d-4470-ad7c-e1ba4bf1ffb0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:19.480492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2363b-997d-4470-ad7c-e1ba4bf1ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:19.480774 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2363b-997d-4470-ad7c-e1ba4bf1ffb0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:19.489844 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2363b-997d-4470-ad7c-e1ba4bf1ffb0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:19.491322 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2363b-997d-4470-ad7c-e1ba4bf1ffb0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-82b2363b-997d-4470-ad7c-e1ba4bf1ffb0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:19.507648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:19.510937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:19.514333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:19.514333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:19.514333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:19.514333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:19.514333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:19.514333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:19.514333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:19.514333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:19.514333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:12:19.514333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:19.514333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 349/702] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Jul 15 15:12:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:19.516396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1dc35-6bfd-41d4-9ab6-1fa5e7cb016d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:19.630074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:19.653246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1dc35-6bfd-41d4-9ab6-1fa5e7cb016d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:19.709206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e985b0-7a7b-4163-bec0-709a2aa6778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:19.709965 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e985b0-7a7b-4163-bec0-709a2aa6778d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:19.710158 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e985b0-7a7b-4163-bec0-709a2aa6778d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:19.710420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e985b0-7a7b-4163-bec0-709a2aa6778d None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:19.711231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e985b0-7a7b-4163-bec0-709a2aa6778d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:19.711547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e985b0-7a7b-4163-bec0-709a2aa6778d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:19.713029 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e985b0-7a7b-4163-bec0-709a2aa6778d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:19.737856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 354/703] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Jul 15 15:12:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:19.743216 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2363b-997d-4470-ad7c-e1ba4bf1ffb0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:19.824705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:19.896072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2363b-997d-4470-ad7c-e1ba4bf1ffb0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:19.947673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3e8c2-c093-48ca-aee5-f26e36548c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:19.948403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3e8c2-c093-48ca-aee5-f26e36548c32 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:19.948699 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3e8c2-c093-48ca-aee5-f26e36548c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:19.948981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3e8c2-c093-48ca-aee5-f26e36548c32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:20.043000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3e8c2-c093-48ca-aee5-f26e36548c32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:20.044413 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3e8c2-c093-48ca-aee5-f26e36548c32 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:20.052283 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0020-6ef1-4068-9a1d-47055927b381 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:20.052681 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0020-6ef1-4068-9a1d-47055927b381 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:20.052942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0020-6ef1-4068-9a1d-47055927b381 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:20.055954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 355/704] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:20.060506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bba84-6b0c-4744-ad42-cb6499bcdd0f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:20.060798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bba84-6b0c-4744-ad42-cb6499bcdd0f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:20.061093 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bba84-6b0c-4744-ad42-cb6499bcdd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:20.110361 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a92bba84-6b0c-4744-ad42-cb6499bcdd0f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:20.112231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a92bba84-6b0c-4744-ad42-cb6499bcdd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:20.175397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:20.248117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 350/705] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:12:20.261094 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3e8c2-c093-48ca-aee5-f26e36548c32 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:20.292533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 356/706] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:12:20.334903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bba84-6b0c-4744-ad42-cb6499bcdd0f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:20.492238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3e8c2-c093-48ca-aee5-f26e36548c32 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:20.499387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:20.562061 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bba84-6b0c-4744-ad42-cb6499bcdd0f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:20.576506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e180b-0782-4be5-8a4a-2a5a6bb78923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:20.577505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e180b-0782-4be5-8a4a-2a5a6bb78923 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:20.577888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e180b-0782-4be5-8a4a-2a5a6bb78923 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:20.578166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e180b-0782-4be5-8a4a-2a5a6bb78923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:20.607108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e180b-0782-4be5-8a4a-2a5a6bb78923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:20.608524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e180b-0782-4be5-8a4a-2a5a6bb78923 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:20.623869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00686f24-3891-4f9f-bf66-cb231ec64763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:20.625252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00686f24-3891-4f9f-bf66-cb231ec64763 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:20.625771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00686f24-3891-4f9f-bf66-cb231ec64763 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:20.626340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00686f24-3891-4f9f-bf66-cb231ec64763 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:20.627259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00686f24-3891-4f9f-bf66-cb231ec64763 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:20.629215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00686f24-3891-4f9f-bf66-cb231ec64763 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-00686f24-3891-4f9f-bf66-cb231ec64763 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:20.648001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:20.649091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:12:20.649947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:20.660153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 357/707] 10.222.0.64 () {56 vars in 1129 bytes} [Fri Jul 15 15:12:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:20.662156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8231b-00ac-40a1-b384-1a5112884216 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:20.662703 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8231b-00ac-40a1-b384-1a5112884216 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:20.663219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8231b-00ac-40a1-b384-1a5112884216 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:20.665284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 358/708] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:20.666274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8231b-00ac-40a1-b384-1a5112884216 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-7e8e180b-0782-4be5-8a4a-2a5a6bb78923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:20.673851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:20.674807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:20.675690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:20.675690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:20.675690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:20.675690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:20.683090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 351/709] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:20.684407 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3779abc-8324-4205-9cf8-87fd20da0dc9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:20.684698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3779abc-8324-4205-9cf8-87fd20da0dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:20.684972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3779abc-8324-4205-9cf8-87fd20da0dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:20.720877 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a3779abc-8324-4205-9cf8-87fd20da0dc9 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:20.722210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a3779abc-8324-4205-9cf8-87fd20da0dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:20.754082 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:20.815512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8231b-00ac-40a1-b384-1a5112884216 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:20.854140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:20.872234 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa736a02-05ee-42b2-8cf5-50d8004f5509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:20.874182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa736a02-05ee-42b2-8cf5-50d8004f5509 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:20.874762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa736a02-05ee-42b2-8cf5-50d8004f5509 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:20.875394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa736a02-05ee-42b2-8cf5-50d8004f5509 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:20.876972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa736a02-05ee-42b2-8cf5-50d8004f5509 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:20.877716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa736a02-05ee-42b2-8cf5-50d8004f5509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:20.880258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa736a02-05ee-42b2-8cf5-50d8004f5509 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:20.892523 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 359/710] 10.222.0.64 () {56 vars in 1124 bytes} [Fri Jul 15 15:12:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:20.894045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa736a02-05ee-42b2-8cf5-50d8004f5509 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:20.937388 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 352/711] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:20.939058 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3779abc-8324-4205-9cf8-87fd20da0dc9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:21.069702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa736a02-05ee-42b2-8cf5-50d8004f5509 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:21.102481 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3779abc-8324-4205-9cf8-87fd20da0dc9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:21.117428 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a43e46-60e9-40be-8330-c3552aea50e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:21.118525 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a43e46-60e9-40be-8330-c3552aea50e2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:21.118822 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a43e46-60e9-40be-8330-c3552aea50e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:21.119108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a43e46-60e9-40be-8330-c3552aea50e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:21.120200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a43e46-60e9-40be-8330-c3552aea50e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:21.120698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a43e46-60e9-40be-8330-c3552aea50e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:21.122148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a43e46-60e9-40be-8330-c3552aea50e2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:21.139393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 360/712] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:21.142661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50ec2-38f1-48d8-96d3-c7bc2b3bc9a3 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:21.143227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50ec2-38f1-48d8-96d3-c7bc2b3bc9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:21.143725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50ec2-38f1-48d8-96d3-c7bc2b3bc9a3 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:21.146070 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 361/713] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:21.147156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc50ec2-38f1-48d8-96d3-c7bc2b3bc9a3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:21.166097 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035ccea-d1da-46ee-9558-955a798c84d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:21.166804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035ccea-d1da-46ee-9558-955a798c84d2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:21.167093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035ccea-d1da-46ee-9558-955a798c84d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:21.167375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035ccea-d1da-46ee-9558-955a798c84d2 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:21.168107 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035ccea-d1da-46ee-9558-955a798c84d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:21.168420 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035ccea-d1da-46ee-9558-955a798c84d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:21.169882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035ccea-d1da-46ee-9558-955a798c84d2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:21.177829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 353/714] 10.222.0.64 () {56 vars in 1124 bytes} [Fri Jul 15 15:12:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:21.177829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035ccea-d1da-46ee-9558-955a798c84d2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:21.208140 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:21.241931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:21.339728 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc50ec2-38f1-48d8-96d3-c7bc2b3bc9a3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:21.361952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035ccea-d1da-46ee-9558-955a798c84d2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:21.396198 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d74529-4cba-4cd4-83e1-716add704168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:21.397314 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74529-4cba-4cd4-83e1-716add704168 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:21.397495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74529-4cba-4cd4-83e1-716add704168 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:21.398499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74529-4cba-4cd4-83e1-716add704168 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:21.412206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f5f5e-cb6e-4031-9f80-3d1ffba2bcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:21.413424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f5f5e-cb6e-4031-9f80-3d1ffba2bcef None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:21.413896 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f5f5e-cb6e-4031-9f80-3d1ffba2bcef None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:21.414360 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f5f5e-cb6e-4031-9f80-3d1ffba2bcef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:21.419267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d74529-4cba-4cd4-83e1-716add704168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:21.424138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f5f5e-cb6e-4031-9f80-3d1ffba2bcef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:21.426075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f5f5e-cb6e-4031-9f80-3d1ffba2bcef None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-99d74529-4cba-4cd4-83e1-716add704168 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:21.436127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:21.437136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:21.438215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 362/715] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:21.441350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd62ca-211c-4f16-b968-ff2dff1eb9c2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:21.441925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd62ca-211c-4f16-b968-ff2dff1eb9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:21.442478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd62ca-211c-4f16-b968-ff2dff1eb9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-208f5f5e-cb6e-4031-9f80-3d1ffba2bcef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:21.452356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:21.454001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:21.455741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:21.455741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:21.455741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:21.455741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:21.455741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:21.455741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:21.455741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:21.455741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:21.459041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 354/716] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:21.460171 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f5f5e-cb6e-4031-9f80-3d1ffba2bcef None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:21.473737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-bebd62ca-211c-4f16-b968-ff2dff1eb9c2 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:21.474957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bebd62ca-211c-4f16-b968-ff2dff1eb9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:21.549370 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:21.554800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 363/717] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:21.555863 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd62ca-211c-4f16-b968-ff2dff1eb9c2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:21.593549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f5f5e-cb6e-4031-9f80-3d1ffba2bcef None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:21.614479 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:21.650426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea16000-1f5f-4ca9-bc9c-1d3f167ce91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:21.651327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea16000-1f5f-4ca9-bc9c-1d3f167ce91c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:21.651903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea16000-1f5f-4ca9-bc9c-1d3f167ce91c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:21.652455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea16000-1f5f-4ca9-bc9c-1d3f167ce91c None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:21.654468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea16000-1f5f-4ca9-bc9c-1d3f167ce91c None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:21.654636 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea16000-1f5f-4ca9-bc9c-1d3f167ce91c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:21.657143 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea16000-1f5f-4ca9-bc9c-1d3f167ce91c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:21.668873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 355/718] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:21.670696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea16000-1f5f-4ca9-bc9c-1d3f167ce91c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:21.685231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd62ca-211c-4f16-b968-ff2dff1eb9c2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:21.728242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a67bff-51dd-4116-b1da-c292fab1302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:21.729270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67bff-51dd-4116-b1da-c292fab1302e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:21.729735 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67bff-51dd-4116-b1da-c292fab1302e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:21.730218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67bff-51dd-4116-b1da-c292fab1302e None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:21.731289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67bff-51dd-4116-b1da-c292fab1302e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:21.731818 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67bff-51dd-4116-b1da-c292fab1302e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:21.734608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67bff-51dd-4116-b1da-c292fab1302e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:21.756329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 364/719] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:21.757738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a67bff-51dd-4116-b1da-c292fab1302e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:21.799500 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea16000-1f5f-4ca9-bc9c-1d3f167ce91c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:21.836087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:21.845553 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2388d-1390-4258-919a-35df74e68f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:21.846435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2388d-1390-4258-919a-35df74e68f9e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:21.846724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2388d-1390-4258-919a-35df74e68f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:21.847007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2388d-1390-4258-919a-35df74e68f9e None admin] PATH_INFO: `/v3/services/network` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:21.847699 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2388d-1390-4258-919a-35df74e68f9e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:21.849175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2388d-1390-4258-919a-35df74e68f9e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-66b2388d-1390-4258-919a-35df74e68f9e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:21.864814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:21.865935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:21.866751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 356/720] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:21 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:21.867572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2388d-1390-4258-919a-35df74e68f9e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:21.881988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:21.887538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a67bff-51dd-4116-b1da-c292fab1302e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:21.944025 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a1f3f-6e12-4b85-9071-0613002e91ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:21.945643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a1f3f-6e12-4b85-9071-0613002e91ef None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:21.946313 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a1f3f-6e12-4b85-9071-0613002e91ef None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:21.946970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a1f3f-6e12-4b85-9071-0613002e91ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:21.961000 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a1f3f-6e12-4b85-9071-0613002e91ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:21.962902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a1f3f-6e12-4b85-9071-0613002e91ef None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-e72a1f3f-6e12-4b85-9071-0613002e91ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:21.984692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:21.986322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:21.987952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:21.987952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:21.987952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:21.987952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:21.990133 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 365/721] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:21.991256 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a1f3f-6e12-4b85-9071-0613002e91ef None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:22.002710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2388d-1390-4258-919a-35df74e68f9e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:22.051066 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec2c52-18e9-403c-ae2f-1e4f5f211268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:22.052202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec2c52-18e9-403c-ae2f-1e4f5f211268 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:22.052801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec2c52-18e9-403c-ae2f-1e4f5f211268 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:22.053424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec2c52-18e9-403c-ae2f-1e4f5f211268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:22.054585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec2c52-18e9-403c-ae2f-1e4f5f211268 None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=b022a37031b940c3bd67861373926e58) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:22.055012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec2c52-18e9-403c-ae2f-1e4f5f211268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:22.056801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec2c52-18e9-403c-ae2f-1e4f5f211268 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:22.069425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 357/722] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:21 2022] GET /identity/v3/role_assignments?user.id=b022a37031b940c3bd67861373926e58&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=87593f63c4744eac870c07b006022e77 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:22.070558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec2c52-18e9-403c-ae2f-1e4f5f211268 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:22.118118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a1f3f-6e12-4b85-9071-0613002e91ef None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:22.173344 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e98a56-ea47-4f44-902c-41069d623ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:22.175402 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e98a56-ea47-4f44-902c-41069d623ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:22.177156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e98a56-ea47-4f44-902c-41069d623ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:22.177800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e98a56-ea47-4f44-902c-41069d623ec6 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:22.179899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e98a56-ea47-4f44-902c-41069d623ec6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:22.180406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e98a56-ea47-4f44-902c-41069d623ec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:22.185337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e98a56-ea47-4f44-902c-41069d623ec6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:22.195599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 366/723] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:12:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:22.201733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e98a56-ea47-4f44-902c-41069d623ec6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:22.228305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:22.251071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:22.301604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec2c52-18e9-403c-ae2f-1e4f5f211268 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:22.348879 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e98a56-ea47-4f44-902c-41069d623ec6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:22.351090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8e6db-3f77-4cc4-9fb6-5d1a7cbf12c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:22.352622 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8e6db-3f77-4cc4-9fb6-5d1a7cbf12c2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:22.353310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8e6db-3f77-4cc4-9fb6-5d1a7cbf12c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:22.353920 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8e6db-3f77-4cc4-9fb6-5d1a7cbf12c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:22.355275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8e6db-3f77-4cc4-9fb6-5d1a7cbf12c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:22.356123 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8e6db-3f77-4cc4-9fb6-5d1a7cbf12c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:22.359777 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8e6db-3f77-4cc4-9fb6-5d1a7cbf12c2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:22.378003 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 358/724] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:22.380137 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ae0e1-297d-4caa-a635-5d12e03ab0bf None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:22.380574 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ae0e1-297d-4caa-a635-5d12e03ab0bf None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:22.381114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ae0e1-297d-4caa-a635-5d12e03ab0bf None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:22.384124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 359/725] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:22.385776 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ae0e1-297d-4caa-a635-5d12e03ab0bf None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:22.391605 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832bef5-06aa-48d2-89bb-32e7bf3362d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:22.392033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832bef5-06aa-48d2-89bb-32e7bf3362d1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:22.392324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832bef5-06aa-48d2-89bb-32e7bf3362d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:22.392603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832bef5-06aa-48d2-89bb-32e7bf3362d1 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:22.393373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832bef5-06aa-48d2-89bb-32e7bf3362d1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:22.393689 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832bef5-06aa-48d2-89bb-32e7bf3362d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:22.395109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832bef5-06aa-48d2-89bb-32e7bf3362d1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:22.409238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 367/726] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:12:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:22.411289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fba65-8e94-423d-8bdb-b3219bb6b058 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:22.411289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fba65-8e94-423d-8bdb-b3219bb6b058 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:22.411661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fba65-8e94-423d-8bdb-b3219bb6b058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:22.446411 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-471fba65-8e94-423d-8bdb-b3219bb6b058 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:22.452919 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-471fba65-8e94-423d-8bdb-b3219bb6b058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:22.552440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ae0e1-297d-4caa-a635-5d12e03ab0bf None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:22.585803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:22.593248 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 368/727] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:22.609467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb144567-21cc-4af0-9e6b-f77c79f9354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:22.612703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb144567-21cc-4af0-9e6b-f77c79f9354f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:22.614247 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb144567-21cc-4af0-9e6b-f77c79f9354f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:22.615341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb144567-21cc-4af0-9e6b-f77c79f9354f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:22.625104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fba65-8e94-423d-8bdb-b3219bb6b058 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:22.639142 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:22.644389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb144567-21cc-4af0-9e6b-f77c79f9354f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:22.645973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb144567-21cc-4af0-9e6b-f77c79f9354f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-eb144567-21cc-4af0-9e6b-f77c79f9354f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:22.679220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:22.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:22.682111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:22.682111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:22.682111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:22.682111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:22.682111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:22.682111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:22.682111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:22.682111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:22.682111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 15:12:22.682111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:22.696817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 360/728] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Jul 15 15:12:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:22.697776 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb144567-21cc-4af0-9e6b-f77c79f9354f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:22.826063 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fba65-8e94-423d-8bdb-b3219bb6b058 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:22.899936 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb144567-21cc-4af0-9e6b-f77c79f9354f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:22.911925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2793a-93b1-4e97-9746-febd8e8d31fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:22.912743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2793a-93b1-4e97-9746-febd8e8d31fd None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:22.913034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2793a-93b1-4e97-9746-febd8e8d31fd None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:22.913339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2793a-93b1-4e97-9746-febd8e8d31fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:22.935940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2793a-93b1-4e97-9746-febd8e8d31fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-27d2793a-93b1-4e97-9746-febd8e8d31fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:22.953442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:22.955629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:22.957120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:22.957120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:22.957120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:22.957120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:22.957120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:22.957120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:22.957120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:22.957120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:22.957120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:22.957120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:22.957120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:12:22.957120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:22.960306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 369/729] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:22.967173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2793a-93b1-4e97-9746-febd8e8d31fd None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:22.987300 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9784ccd-98c0-4c70-a2b5-2d3479cf9d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:22.988002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9784ccd-98c0-4c70-a2b5-2d3479cf9d98 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:22.988291 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9784ccd-98c0-4c70-a2b5-2d3479cf9d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:22.988574 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9784ccd-98c0-4c70-a2b5-2d3479cf9d98 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:22.989482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9784ccd-98c0-4c70-a2b5-2d3479cf9d98 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:22.989806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9784ccd-98c0-4c70-a2b5-2d3479cf9d98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:22.991315 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9784ccd-98c0-4c70-a2b5-2d3479cf9d98 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:23.038277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 361/730] 10.222.0.64 () {56 vars in 1149 bytes} [Fri Jul 15 15:12:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:23.044757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9784ccd-98c0-4c70-a2b5-2d3479cf9d98 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:23.114247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:23.142613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2793a-93b1-4e97-9746-febd8e8d31fd None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:23.164257 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:23.187596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd960e3-1815-4e61-b00b-6d067cdfe0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:23.189193 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd960e3-1815-4e61-b00b-6d067cdfe0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:23.189639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd960e3-1815-4e61-b00b-6d067cdfe0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:23.190097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd960e3-1815-4e61-b00b-6d067cdfe0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:23.191318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd960e3-1815-4e61-b00b-6d067cdfe0e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:23.191797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd960e3-1815-4e61-b00b-6d067cdfe0e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:23.193281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd960e3-1815-4e61-b00b-6d067cdfe0e3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:23.206248 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 370/731] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:23.212329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd960e3-1815-4e61-b00b-6d067cdfe0e3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:23.347560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd960e3-1815-4e61-b00b-6d067cdfe0e3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:23.396278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:23.397256 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96756c43-66a8-42b8-9a6d-446752f18aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:23.398242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96756c43-66a8-42b8-9a6d-446752f18aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:23.398739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96756c43-66a8-42b8-9a6d-446752f18aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:23.399049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96756c43-66a8-42b8-9a6d-446752f18aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:23.412216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96756c43-66a8-42b8-9a6d-446752f18aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:23.414137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96756c43-66a8-42b8-9a6d-446752f18aa7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-96756c43-66a8-42b8-9a6d-446752f18aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:23.443893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:23.444887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:23.445822 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:23.445822 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:23.445822 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:23.445822 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:23.446889 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 371/732] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:23.451150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9784ccd-98c0-4c70-a2b5-2d3479cf9d98 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:23.454703 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96756c43-66a8-42b8-9a6d-446752f18aa7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:23.548828 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c81c31-b07b-44fc-9f3d-aa6fb9b6126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:23.549757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c81c31-b07b-44fc-9f3d-aa6fb9b6126f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:23.550210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c81c31-b07b-44fc-9f3d-aa6fb9b6126f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:23.550636 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c81c31-b07b-44fc-9f3d-aa6fb9b6126f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:23.684577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96756c43-66a8-42b8-9a6d-446752f18aa7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:23.711002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c81c31-b07b-44fc-9f3d-aa6fb9b6126f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:23.712599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c81c31-b07b-44fc-9f3d-aa6fb9b6126f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:23.729551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c56538-c57d-423e-9cfc-2a561aa60780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:23.730236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c56538-c57d-423e-9cfc-2a561aa60780 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:23.730518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c56538-c57d-423e-9cfc-2a561aa60780 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:23.730796 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c56538-c57d-423e-9cfc-2a561aa60780 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:23.731528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c56538-c57d-423e-9cfc-2a561aa60780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:23.731843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c56538-c57d-423e-9cfc-2a561aa60780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:23.733326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c56538-c57d-423e-9cfc-2a561aa60780 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:23.747734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 372/733] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:23.749265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da66b4a-35e3-4d20-b841-2015bfdeca7d None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:23.749560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da66b4a-35e3-4d20-b841-2015bfdeca7d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:23.749839 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da66b4a-35e3-4d20-b841-2015bfdeca7d None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:23.756980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 373/734] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:23.758753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7901007-6caa-4d97-be08-a2dad73f62ed None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:23.759114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7901007-6caa-4d97-be08-a2dad73f62ed None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:23.759462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7901007-6caa-4d97-be08-a2dad73f62ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:23.777241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:23.778257 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b7901007-6caa-4d97-be08-a2dad73f62ed None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:23.779863 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b7901007-6caa-4d97-be08-a2dad73f62ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:23.840463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:23.863250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 362/735] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 819 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:12:23.864435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c81c31-b07b-44fc-9f3d-aa6fb9b6126f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:23.893503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 374/736] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:23.895152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7901007-6caa-4d97-be08-a2dad73f62ed None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:24.015006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c81c31-b07b-44fc-9f3d-aa6fb9b6126f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:24.043814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7901007-6caa-4d97-be08-a2dad73f62ed None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:24.063223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a272c-3fdc-45d5-832c-1aefbd41ca71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:24.064075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a272c-3fdc-45d5-832c-1aefbd41ca71 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:24.064359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a272c-3fdc-45d5-832c-1aefbd41ca71 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:24.064796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a272c-3fdc-45d5-832c-1aefbd41ca71 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:24.073544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a272c-3fdc-45d5-832c-1aefbd41ca71 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:24.075131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a272c-3fdc-45d5-832c-1aefbd41ca71 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:24.077363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:24.093982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8d222-43a8-4d30-b31f-ce9f698e79ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:24.095609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8d222-43a8-4d30-b31f-ce9f698e79ac None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:24.096073 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8d222-43a8-4d30-b31f-ce9f698e79ac None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:24.096505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8d222-43a8-4d30-b31f-ce9f698e79ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4f1a272c-3fdc-45d5-832c-1aefbd41ca71 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:24.102626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:24.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:24.104821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:24.104821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:24.104821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:24.104821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:24.104821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:24.104821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:24.104821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:24.104821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:24.104821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 15:12:24.104821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:24.109318 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 363/737] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:12:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:24.110930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a272c-3fdc-45d5-832c-1aefbd41ca71 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:24.113506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8d222-43a8-4d30-b31f-ce9f698e79ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:24.117598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8d222-43a8-4d30-b31f-ce9f698e79ac None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c3a8d222-43a8-4d30-b31f-ce9f698e79ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:24.145802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:24.147111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:24.148240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:24.148240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:24.148240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:24.148240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:24.151699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 375/738] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:24.152847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8d222-43a8-4d30-b31f-ce9f698e79ac None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:24.213961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:24.250189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a272c-3fdc-45d5-832c-1aefbd41ca71 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:24.296614 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678273ca-342b-4aa7-bacf-351d467ce8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:24.297747 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678273ca-342b-4aa7-bacf-351d467ce8e4 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:24.297871 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678273ca-342b-4aa7-bacf-351d467ce8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:24.298241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678273ca-342b-4aa7-bacf-351d467ce8e4 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:24.299077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678273ca-342b-4aa7-bacf-351d467ce8e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:24.300648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678273ca-342b-4aa7-bacf-351d467ce8e4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:24.324171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8d222-43a8-4d30-b31f-ce9f698e79ac None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:24.326771 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 364/739] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:12:24 2022] POST /identity/v3/services => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:12:24.328872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678273ca-342b-4aa7-bacf-351d467ce8e4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:24.425592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:24.430574 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2e211-6c7f-4792-9aa1-30fbfe27b054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:24.431436 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2e211-6c7f-4792-9aa1-30fbfe27b054 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:24.431966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2e211-6c7f-4792-9aa1-30fbfe27b054 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:24.432385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2e211-6c7f-4792-9aa1-30fbfe27b054 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:24.433577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2e211-6c7f-4792-9aa1-30fbfe27b054 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:24.433961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2e211-6c7f-4792-9aa1-30fbfe27b054 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:24.435551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2e211-6c7f-4792-9aa1-30fbfe27b054 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:24.465299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678273ca-342b-4aa7-bacf-351d467ce8e4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:24.482101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 376/740] 10.222.0.64 () {56 vars in 1135 bytes} [Fri Jul 15 15:12:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:24.490478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2e211-6c7f-4792-9aa1-30fbfe27b054 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:24.554026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64f00d-f093-4f4f-9d8c-0e46040805a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:24.555162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64f00d-f093-4f4f-9d8c-0e46040805a4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:24.555602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64f00d-f093-4f4f-9d8c-0e46040805a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:24.556026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64f00d-f093-4f4f-9d8c-0e46040805a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:24.558288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64f00d-f093-4f4f-9d8c-0e46040805a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:24.558881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64f00d-f093-4f4f-9d8c-0e46040805a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:24.560507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64f00d-f093-4f4f-9d8c-0e46040805a4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:24.587184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 365/741] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:24.595599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64f00d-f093-4f4f-9d8c-0e46040805a4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:24.643902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:24.679848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2e211-6c7f-4792-9aa1-30fbfe27b054 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:24.736992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c06fe-9ce4-471b-ad09-27e3749efd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:24.738210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c06fe-9ce4-471b-ad09-27e3749efd93 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:24.738509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c06fe-9ce4-471b-ad09-27e3749efd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:24.738790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c06fe-9ce4-471b-ad09-27e3749efd93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:24.778393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64f00d-f093-4f4f-9d8c-0e46040805a4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:24.805198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:24.835919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39150e67-3ad3-4812-a862-9c901e50e007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:24.837018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39150e67-3ad3-4812-a862-9c901e50e007 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:24.837545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39150e67-3ad3-4812-a862-9c901e50e007 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:24.838006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39150e67-3ad3-4812-a862-9c901e50e007 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:24.844321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c06fe-9ce4-471b-ad09-27e3749efd93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:24.846243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39150e67-3ad3-4812-a862-9c901e50e007 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:24.846439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c06fe-9ce4-471b-ad09-27e3749efd93 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:24.848047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39150e67-3ad3-4812-a862-9c901e50e007 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-39150e67-3ad3-4812-a862-9c901e50e007 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:24.864070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:24.865235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:24.866903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:24.866903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:24.866903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:24.866903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:24.866903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:24.866903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:24.866903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:24.866903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:24.870416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 366/742] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:24.877951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db0ad9-6d6f-43f3-851d-18b3f1bbe310 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:24.879089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db0ad9-6d6f-43f3-851d-18b3f1bbe310 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:24.879600 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db0ad9-6d6f-43f3-851d-18b3f1bbe310 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:24.881655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 367/743] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:24.882626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db0ad9-6d6f-43f3-851d-18b3f1bbe310 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:24.975297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:25.012783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 377/744] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:24 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:12:25.016915 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7065eb4-ceba-4dc4-8ea6-da4631bae845 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:25.017858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7065eb4-ceba-4dc4-8ea6-da4631bae845 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:25.018576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7065eb4-ceba-4dc4-8ea6-da4631bae845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:25.036937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db0ad9-6d6f-43f3-851d-18b3f1bbe310 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:25.044772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f7065eb4-ceba-4dc4-8ea6-da4631bae845 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:25.047361 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f7065eb4-ceba-4dc4-8ea6-da4631bae845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:25.091928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7832cf7-fac9-4d43-b0b6-e4750c857656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:25.092988 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7832cf7-fac9-4d43-b0b6-e4750c857656 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:25.093510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7832cf7-fac9-4d43-b0b6-e4750c857656 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:25.093895 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7832cf7-fac9-4d43-b0b6-e4750c857656 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:25.094761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7832cf7-fac9-4d43-b0b6-e4750c857656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:25.095078 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7832cf7-fac9-4d43-b0b6-e4750c857656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:25.096700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7832cf7-fac9-4d43-b0b6-e4750c857656 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:25.114672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 368/745] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:25.116295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7832cf7-fac9-4d43-b0b6-e4750c857656 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:25.151369 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 378/746] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:25.152990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae85430-3379-49fb-b39d-862245f765a0 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:25.153323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae85430-3379-49fb-b39d-862245f765a0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:25.153607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae85430-3379-49fb-b39d-862245f765a0 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:25.159728 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 379/747] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:25.159728 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae85430-3379-49fb-b39d-862245f765a0 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:25.187810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:25.270799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7832cf7-fac9-4d43-b0b6-e4750c857656 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:25.304808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae85430-3379-49fb-b39d-862245f765a0 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:25.319635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:25.320676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34ce72-306a-4fee-92c9-237f342364ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:25.322051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34ce72-306a-4fee-92c9-237f342364ca None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:25.322441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34ce72-306a-4fee-92c9-237f342364ca None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:25.322907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34ce72-306a-4fee-92c9-237f342364ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:25.342425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34ce72-306a-4fee-92c9-237f342364ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:25.344025 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34ce72-306a-4fee-92c9-237f342364ca None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:25.354062 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b43c4-e74e-4797-8c42-300c13ef6f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:25.354741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b43c4-e74e-4797-8c42-300c13ef6f69 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:25.355024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b43c4-e74e-4797-8c42-300c13ef6f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:25.355310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b43c4-e74e-4797-8c42-300c13ef6f69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:25.356418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b43c4-e74e-4797-8c42-300c13ef6f69 None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=2a328efd184f4988bb033c83c3321991) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:25.356734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b43c4-e74e-4797-8c42-300c13ef6f69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:25.358395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b43c4-e74e-4797-8c42-300c13ef6f69 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:25.365601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 380/748] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:25 2022] GET /identity/v3/role_assignments?user.id=2a328efd184f4988bb033c83c3321991&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:25.366916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d06393-eaab-488e-9f99-a1b4342a5cb2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:25.367209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d06393-eaab-488e-9f99-a1b4342a5cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:25.367489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d06393-eaab-488e-9f99-a1b4342a5cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ac34ce72-306a-4fee-92c9-237f342364ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:25.367775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:25.368635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:25.369621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:25.369621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:25.369621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:25.369621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:25.376074 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 369/749] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:25.376074 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34ce72-306a-4fee-92c9-237f342364ca None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:25.403818 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-94d06393-eaab-488e-9f99-a1b4342a5cb2 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:25.405541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-94d06393-eaab-488e-9f99-a1b4342a5cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:25.509372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 381/750] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:12:25.510743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d06393-eaab-488e-9f99-a1b4342a5cb2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:25.540228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:25.552757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34ce72-306a-4fee-92c9-237f342364ca None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:25.608876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0af70a-c80c-4bfe-9048-54a9db90df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:25.609982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0af70a-c80c-4bfe-9048-54a9db90df7e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:25.610364 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0af70a-c80c-4bfe-9048-54a9db90df7e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:25.610681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0af70a-c80c-4bfe-9048-54a9db90df7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:25.627146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0af70a-c80c-4bfe-9048-54a9db90df7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4d0af70a-c80c-4bfe-9048-54a9db90df7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:25.638015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:25.639906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:25.641002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:25.641002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:25.641002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:25.641002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:25.641002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:25.641002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:25.641002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:25.641002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:25.641002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:25.641002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:25.641002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:12:25.641002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:25.647330 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 370/751] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:12:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:25.647898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0af70a-c80c-4bfe-9048-54a9db90df7e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:25.669498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d06393-eaab-488e-9f99-a1b4342a5cb2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:25.672690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:25.712551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcb014-46c3-4fcf-8b07-5f5ab0e5ea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:25.713416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcb014-46c3-4fcf-8b07-5f5ab0e5ea60 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:25.713772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcb014-46c3-4fcf-8b07-5f5ab0e5ea60 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:25.714118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcb014-46c3-4fcf-8b07-5f5ab0e5ea60 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:25.714926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcb014-46c3-4fcf-8b07-5f5ab0e5ea60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:25.715307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcb014-46c3-4fcf-8b07-5f5ab0e5ea60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:25.716917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcb014-46c3-4fcf-8b07-5f5ab0e5ea60 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:25.731277 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 382/752] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:25.736653 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcb014-46c3-4fcf-8b07-5f5ab0e5ea60 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:25.781374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0af70a-c80c-4bfe-9048-54a9db90df7e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:25.838628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e15d84-9dbb-438c-8e42-133faa51b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:25.839439 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e15d84-9dbb-438c-8e42-133faa51b75a None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:25.839799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e15d84-9dbb-438c-8e42-133faa51b75a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:25.840151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e15d84-9dbb-438c-8e42-133faa51b75a None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:25.840976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e15d84-9dbb-438c-8e42-133faa51b75a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:25.842631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e15d84-9dbb-438c-8e42-133faa51b75a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:25.862979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 371/753] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:12:25 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:12:25.863990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e15d84-9dbb-438c-8e42-133faa51b75a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:25.880182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcb014-46c3-4fcf-8b07-5f5ab0e5ea60 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:25.882948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:25.954533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac7f36-b604-4131-8670-e3aa48363871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:25.955237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac7f36-b604-4131-8670-e3aa48363871 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:25.955566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac7f36-b604-4131-8670-e3aa48363871 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:25.956037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac7f36-b604-4131-8670-e3aa48363871 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:25.956802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac7f36-b604-4131-8670-e3aa48363871 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:25.957190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac7f36-b604-4131-8670-e3aa48363871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:25.958702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac7f36-b604-4131-8670-e3aa48363871 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:25.988199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 383/754] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:12:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:25.998234 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac7f36-b604-4131-8670-e3aa48363871 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:26.009689 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e15d84-9dbb-438c-8e42-133faa51b75a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:26.055228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f029f-4bf3-4123-86a6-9a4521401cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:26.056055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f029f-4bf3-4123-86a6-9a4521401cfd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:26.056344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f029f-4bf3-4123-86a6-9a4521401cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:26.056628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f029f-4bf3-4123-86a6-9a4521401cfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:26.065465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f029f-4bf3-4123-86a6-9a4521401cfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:26.066980 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f029f-4bf3-4123-86a6-9a4521401cfd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:26.068797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c02f029f-4bf3-4123-86a6-9a4521401cfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:26.086393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:26.088559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:26.090766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:26.090766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:26.090766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:26.090766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:26.090766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:26.090766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:26.090766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:26.090766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:26.090766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 372/755] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:26.093768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f029f-4bf3-4123-86a6-9a4521401cfd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:26.180894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:26.222145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f029f-4bf3-4123-86a6-9a4521401cfd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:26.238706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac7f36-b604-4131-8670-e3aa48363871 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:26.269234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134239f-93c2-4dc3-87da-68074fe6a24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:26.270500 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134239f-93c2-4dc3-87da-68074fe6a24f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:26.270919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134239f-93c2-4dc3-87da-68074fe6a24f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:26.271268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134239f-93c2-4dc3-87da-68074fe6a24f None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:26.272151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134239f-93c2-4dc3-87da-68074fe6a24f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:26.272472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134239f-93c2-4dc3-87da-68074fe6a24f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:26.274134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134239f-93c2-4dc3-87da-68074fe6a24f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:26.288162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 373/756] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:26.291376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ccc6a-e523-4589-9c79-7bf6efff7ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:26.292638 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ccc6a-e523-4589-9c79-7bf6efff7ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:26.293182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ccc6a-e523-4589-9c79-7bf6efff7ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:26.293529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ccc6a-e523-4589-9c79-7bf6efff7ae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:26.294073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134239f-93c2-4dc3-87da-68074fe6a24f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:26.315040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ccc6a-e523-4589-9c79-7bf6efff7ae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:26.316707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ccc6a-e523-4589-9c79-7bf6efff7ae7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-b20ccc6a-e523-4589-9c79-7bf6efff7ae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:26.345698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:26.347862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:26.349097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:26.349097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:26.349097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:26.349097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:26.349097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 384/757] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:26.355592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ccc6a-e523-4589-9c79-7bf6efff7ae7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:26.416941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134239f-93c2-4dc3-87da-68074fe6a24f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:26.451721 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:26.460641 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636baf2-9d58-4c3c-a7fd-57dec44f498e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:26.461346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636baf2-9d58-4c3c-a7fd-57dec44f498e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:26.461637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636baf2-9d58-4c3c-a7fd-57dec44f498e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:26.461922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636baf2-9d58-4c3c-a7fd-57dec44f498e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:26.462910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636baf2-9d58-4c3c-a7fd-57dec44f498e None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=04f3a308ee69455287ac460d9ab2aef0) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:26.463233 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636baf2-9d58-4c3c-a7fd-57dec44f498e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:26.464720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636baf2-9d58-4c3c-a7fd-57dec44f498e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:26.471859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 374/758] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:26 2022] GET /identity/v3/role_assignments?user.id=04f3a308ee69455287ac460d9ab2aef0&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=87593f63c4744eac870c07b006022e77 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:26.520041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:26.565243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ccc6a-e523-4589-9c79-7bf6efff7ae7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:26.654534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235ccc8-c785-4449-824b-514e71c18443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:26.655269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235ccc8-c785-4449-824b-514e71c18443 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:26.655554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235ccc8-c785-4449-824b-514e71c18443 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:26.655883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235ccc8-c785-4449-824b-514e71c18443 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:26.656635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235ccc8-c785-4449-824b-514e71c18443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:26.656971 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235ccc8-c785-4449-824b-514e71c18443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:26.658419 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235ccc8-c785-4449-824b-514e71c18443 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:26.677700 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 385/759] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:26.682952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636baf2-9d58-4c3c-a7fd-57dec44f498e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:26.834030 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636baf2-9d58-4c3c-a7fd-57dec44f498e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:26.872313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce9e77-7c0c-4bcd-a410-5771a1944e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:26.873053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce9e77-7c0c-4bcd-a410-5771a1944e7d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:26.873371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce9e77-7c0c-4bcd-a410-5771a1944e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:26.873651 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce9e77-7c0c-4bcd-a410-5771a1944e7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:26.884623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce9e77-7c0c-4bcd-a410-5771a1944e7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:26.886182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce9e77-7c0c-4bcd-a410-5771a1944e7d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b3ce9e77-7c0c-4bcd-a410-5771a1944e7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:26.905813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:26.906835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:26.908402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:26.908402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:26.908402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:26.908402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:26.908402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:26.908402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:26.908402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:26.908402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:26.908402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:12:26.908402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:26.909784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 375/760] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Jul 15 15:12:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:26.918827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235ccc8-c785-4449-824b-514e71c18443 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:26.971642 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbffcca-fa4f-4c41-9284-85a27bd78814 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:26.971992 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbffcca-fa4f-4c41-9284-85a27bd78814 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:26.972202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbffcca-fa4f-4c41-9284-85a27bd78814 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:26.973940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 376/761] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:12:26.980269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0bb0b-cf6c-4b69-98d5-8426dc30b8a3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:26.980664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0bb0b-cf6c-4b69-98d5-8426dc30b8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:26.980819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0bb0b-cf6c-4b69-98d5-8426dc30b8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:27.022569 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-dbe0bb0b-cf6c-4b69-98d5-8426dc30b8a3 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:27.024186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dbe0bb0b-cf6c-4b69-98d5-8426dc30b8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:27.124961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235ccc8-c785-4449-824b-514e71c18443 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:27.137321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:27.183962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2643e7-6e76-452b-a987-e0ba7123aba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:27.184689 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2643e7-6e76-452b-a987-e0ba7123aba4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:27.184977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2643e7-6e76-452b-a987-e0ba7123aba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:27.185294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2643e7-6e76-452b-a987-e0ba7123aba4 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:27.186808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2643e7-6e76-452b-a987-e0ba7123aba4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:27.187138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2643e7-6e76-452b-a987-e0ba7123aba4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:27.188899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2643e7-6e76-452b-a987-e0ba7123aba4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:27.197721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:27.204629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 377/762] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:27.224997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 386/763] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Jul 15 15:12:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:27.230588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0bb0b-cf6c-4b69-98d5-8426dc30b8a3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:27.241663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2643e7-6e76-452b-a987-e0ba7123aba4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:27.444037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0bb0b-cf6c-4b69-98d5-8426dc30b8a3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:27.478648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2643e7-6e76-452b-a987-e0ba7123aba4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:27.533478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f8726-3180-4664-a26d-ac2a7e834eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:27.534310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f8726-3180-4664-a26d-ac2a7e834eab None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:27.534599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f8726-3180-4664-a26d-ac2a7e834eab None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:27.534881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f8726-3180-4664-a26d-ac2a7e834eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:27.565927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91681e-887e-4643-aa3d-0119d709f828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:27.566146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f8726-3180-4664-a26d-ac2a7e834eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:27.566779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91681e-887e-4643-aa3d-0119d709f828 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:27.567070 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91681e-887e-4643-aa3d-0119d709f828 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:27.567353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91681e-887e-4643-aa3d-0119d709f828 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:27.567458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f8726-3180-4664-a26d-ac2a7e834eab None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:27.568067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91681e-887e-4643-aa3d-0119d709f828 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:27.569503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91681e-887e-4643-aa3d-0119d709f828 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ca91681e-887e-4643-aa3d-0119d709f828 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:27.584101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:27.585577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:27.586819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 387/764] 10.222.0.64 () {56 vars in 1129 bytes} [Fri Jul 15 15:12:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:27.592013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91681e-887e-4643-aa3d-0119d709f828 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c40f8726-3180-4664-a26d-ac2a7e834eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:27.609382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:27.610373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:27.611255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:27.611255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:27.611255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:27.611255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:27.617556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 378/765] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:27.623653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f8726-3180-4664-a26d-ac2a7e834eab None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:27.675074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:27.728427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91681e-887e-4643-aa3d-0119d709f828 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:27.761223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:27.781654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180f23-c0c9-419a-bbf1-63aaea3acd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:27.783460 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180f23-c0c9-419a-bbf1-63aaea3acd50 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:27.783764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180f23-c0c9-419a-bbf1-63aaea3acd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:27.784146 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180f23-c0c9-419a-bbf1-63aaea3acd50 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:27.784947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180f23-c0c9-419a-bbf1-63aaea3acd50 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:27.785333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180f23-c0c9-419a-bbf1-63aaea3acd50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:27.787163 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180f23-c0c9-419a-bbf1-63aaea3acd50 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:27.794251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 388/766] 10.222.0.64 () {56 vars in 1124 bytes} [Fri Jul 15 15:12:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:27.801626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180f23-c0c9-419a-bbf1-63aaea3acd50 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:27.951436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f8726-3180-4664-a26d-ac2a7e834eab None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:27.969130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180f23-c0c9-419a-bbf1-63aaea3acd50 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:28.009552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:28.031670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3acb4-ad7c-46ae-8d23-14b3f435b8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:28.033625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3acb4-ad7c-46ae-8d23-14b3f435b8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:28.034986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3acb4-ad7c-46ae-8d23-14b3f435b8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:28.035398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3acb4-ad7c-46ae-8d23-14b3f435b8d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:28.036222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3acb4-ad7c-46ae-8d23-14b3f435b8d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:28.036536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3acb4-ad7c-46ae-8d23-14b3f435b8d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:28.038044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3acb4-ad7c-46ae-8d23-14b3f435b8d6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:28.053977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6a98a-cb06-4c65-ab31-47fc8a05f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:28.055415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6a98a-cb06-4c65-ab31-47fc8a05f647 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:28.056114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6a98a-cb06-4c65-ab31-47fc8a05f647 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:28.056721 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 379/767] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:28.057231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6a98a-cb06-4c65-ab31-47fc8a05f647 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:28.058215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1785236-12dd-4de3-8c34-a1ec7b5151a5 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:28.058508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1785236-12dd-4de3-8c34-a1ec7b5151a5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:28.058794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1785236-12dd-4de3-8c34-a1ec7b5151a5 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:28.059283 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6a98a-cb06-4c65-ab31-47fc8a05f647 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:28.059813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6a98a-cb06-4c65-ab31-47fc8a05f647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:28.060430 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 380/768] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:28.062222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6a98a-cb06-4c65-ab31-47fc8a05f647 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:28.062958 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1785236-12dd-4de3-8c34-a1ec7b5151a5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:28.071300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 389/769] 10.222.0.64 () {56 vars in 1124 bytes} [Fri Jul 15 15:12:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:28.073122 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65acab-4526-4e75-82ea-9e54cfd85436 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:28.073773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65acab-4526-4e75-82ea-9e54cfd85436 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:28.074503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65acab-4526-4e75-82ea-9e54cfd85436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:28.099953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7b65acab-4526-4e75-82ea-9e54cfd85436 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:28.101773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7b65acab-4526-4e75-82ea-9e54cfd85436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:28.209271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 390/770] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:28.210542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:28.213502 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65acab-4526-4e75-82ea-9e54cfd85436 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:28.220618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1785236-12dd-4de3-8c34-a1ec7b5151a5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:28.275468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea128dbe-3777-4ada-af7b-c2b4e54f70e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:28.276526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea128dbe-3777-4ada-af7b-c2b4e54f70e7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:28.276849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea128dbe-3777-4ada-af7b-c2b4e54f70e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:28.277330 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea128dbe-3777-4ada-af7b-c2b4e54f70e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:28.287092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea128dbe-3777-4ada-af7b-c2b4e54f70e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:28.289768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea128dbe-3777-4ada-af7b-c2b4e54f70e7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ea128dbe-3777-4ada-af7b-c2b4e54f70e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:28.311888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:28.312944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:28.314905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:28.314905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:28.314905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:28.314905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:28.314905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:28.314905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:28.314905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:28.314905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:28.314905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 381/771] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:28.314905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea128dbe-3777-4ada-af7b-c2b4e54f70e7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:28.389497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65acab-4526-4e75-82ea-9e54cfd85436 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:28.414883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:28.446205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac23e4-e67d-4cd2-b278-d00212d5dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:28.447304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac23e4-e67d-4cd2-b278-d00212d5dbcf None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:28.448100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac23e4-e67d-4cd2-b278-d00212d5dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:28.448598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac23e4-e67d-4cd2-b278-d00212d5dbcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:28.450219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac23e4-e67d-4cd2-b278-d00212d5dbcf None admin] RBAC: Adding query filter params (interface=public, service_id=e8de2d42439a4990bc01860a83bca857, region_id=RegionOne) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:28.451077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac23e4-e67d-4cd2-b278-d00212d5dbcf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:28.453626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac23e4-e67d-4cd2-b278-d00212d5dbcf None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:28.456907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea128dbe-3777-4ada-af7b-c2b4e54f70e7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:28.465143 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 391/772] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Jul 15 15:12:28 2022] GET /identity/v3/endpoints?service_id=e8de2d42439a4990bc01860a83bca857&interface=public®ion_id=RegionOne => generated 194 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:28.466480 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac23e4-e67d-4cd2-b278-d00212d5dbcf None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:28.522948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95a1d8-9904-4bdd-a445-88f9a54d67b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:28.524813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95a1d8-9904-4bdd-a445-88f9a54d67b4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:28.525330 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95a1d8-9904-4bdd-a445-88f9a54d67b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:28.525793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95a1d8-9904-4bdd-a445-88f9a54d67b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:28.545322 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95a1d8-9904-4bdd-a445-88f9a54d67b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2a95a1d8-9904-4bdd-a445-88f9a54d67b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:28.558221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:28.559304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:28.560210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:28.560210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:28.560210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:28.560210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:28.560210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:28.560210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:28.560210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:28.560210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:28.560210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:28.560210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:28.560210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:28.560210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:28.565265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 382/773] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:28.566322 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95a1d8-9904-4bdd-a445-88f9a54d67b4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:28.595510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:28.635107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac23e4-e67d-4cd2-b278-d00212d5dbcf None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:28.690925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31e25a-97bb-4148-a66a-0f20fad6a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:28.692228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31e25a-97bb-4148-a66a-0f20fad6a8ef None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:28.692799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31e25a-97bb-4148-a66a-0f20fad6a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:28.693383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31e25a-97bb-4148-a66a-0f20fad6a8ef None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:28.695521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31e25a-97bb-4148-a66a-0f20fad6a8ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:28.696350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31e25a-97bb-4148-a66a-0f20fad6a8ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:28.699540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31e25a-97bb-4148-a66a-0f20fad6a8ef None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:28.723280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 392/774] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:28.724932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31e25a-97bb-4148-a66a-0f20fad6a8ef None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:28.730259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95a1d8-9904-4bdd-a445-88f9a54d67b4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:28.775273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bf9db-e129-4152-bdb3-253fd67f58dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:28.777016 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bf9db-e129-4152-bdb3-253fd67f58dd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:28.777561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bf9db-e129-4152-bdb3-253fd67f58dd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:28.778003 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bf9db-e129-4152-bdb3-253fd67f58dd None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:28.779232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bf9db-e129-4152-bdb3-253fd67f58dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:28.781894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bf9db-e129-4152-bdb3-253fd67f58dd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:28.793843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:28.794772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 383/775] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Jul 15 15:12:28 2022] GET /identity/v3/services => generated 772 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:28.800891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bf9db-e129-4152-bdb3-253fd67f58dd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:28.873097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31e25a-97bb-4148-a66a-0f20fad6a8ef None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:28.915870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0154de4-a0d8-4c35-842e-c22907a91138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:28.917130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0154de4-a0d8-4c35-842e-c22907a91138 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:28.917694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0154de4-a0d8-4c35-842e-c22907a91138 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:28.918248 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0154de4-a0d8-4c35-842e-c22907a91138 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:28.919712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0154de4-a0d8-4c35-842e-c22907a91138 None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:28.920341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0154de4-a0d8-4c35-842e-c22907a91138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:28.922780 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0154de4-a0d8-4c35-842e-c22907a91138 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:28.934719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 393/776] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:28.941262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f6f42-4f58-46b8-9d31-ee7c54560379 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:28.941262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f6f42-4f58-46b8-9d31-ee7c54560379 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:28.941262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f6f42-4f58-46b8-9d31-ee7c54560379 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:28.941262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 394/777] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:28.945324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f6f42-4f58-46b8-9d31-ee7c54560379 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:28.961387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:29.000043 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bf9db-e129-4152-bdb3-253fd67f58dd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:29.067530 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47c759-62c7-46d4-a588-0f04a4a08d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:29.073592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47c759-62c7-46d4-a588-0f04a4a08d9e None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:29.073592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47c759-62c7-46d4-a588-0f04a4a08d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:29.073592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47c759-62c7-46d4-a588-0f04a4a08d9e None admin] PATH_INFO: `/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/b022a37031b940c3bd67861373926e58/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:29.076016 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47c759-62c7-46d4-a588-0f04a4a08d9e None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0acc3e7b64dbab9113284b46f38ff, user_id=b022a37031b940c3bd67861373926e58, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:29.077681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47c759-62c7-46d4-a588-0f04a4a08d9e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:29.099538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 384/778] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:12:28 2022] PUT /identity/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/b022a37031b940c3bd67861373926e58/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:12:29.101084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd87db8-33f7-48f8-b0d6-f5f264369e8c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:29.101510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd87db8-33f7-48f8-b0d6-f5f264369e8c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:29.101847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd87db8-33f7-48f8-b0d6-f5f264369e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:29.122003 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:29.125145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8bd87db8-33f7-48f8-b0d6-f5f264369e8c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:29.127469 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f6f42-4f58-46b8-9d31-ee7c54560379 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:29.131669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8bd87db8-33f7-48f8-b0d6-f5f264369e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:29.189035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de4b86-3d72-4ea2-9a89-15c178166397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:29.189997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de4b86-3d72-4ea2-9a89-15c178166397 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:29.190293 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de4b86-3d72-4ea2-9a89-15c178166397 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:29.190698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de4b86-3d72-4ea2-9a89-15c178166397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:29.205008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de4b86-3d72-4ea2-9a89-15c178166397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:29.206691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de4b86-3d72-4ea2-9a89-15c178166397 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-99de4b86-3d72-4ea2-9a89-15c178166397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:29.230330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:29.232741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:29.236725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:29.236725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:29.236725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:29.236725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:29.237331 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 395/779] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:29.243066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f7f1e-5c0b-4e0a-ae66-5b7f78c5e889 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:29.243066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f7f1e-5c0b-4e0a-ae66-5b7f78c5e889 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:29.243066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f7f1e-5c0b-4e0a-ae66-5b7f78c5e889 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:29.243066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 396/780] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:29.243066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f7f1e-5c0b-4e0a-ae66-5b7f78c5e889 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:29.255312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 385/781] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:29.257005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8ebcf-08eb-4fbe-8017-ecd0780f044d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:29.257337 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8ebcf-08eb-4fbe-8017-ecd0780f044d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:29.257622 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8ebcf-08eb-4fbe-8017-ecd0780f044d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:29.295699 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-57e8ebcf-08eb-4fbe-8017-ecd0780f044d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:29.297631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-57e8ebcf-08eb-4fbe-8017-ecd0780f044d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:29.400687 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:29.402606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 386/782] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:29.410974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8ebcf-08eb-4fbe-8017-ecd0780f044d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:29.436544 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f7f1e-5c0b-4e0a-ae66-5b7f78c5e889 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:29.478812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b164f-fd7b-4ee9-a05e-a3c94a551daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:29.479763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b164f-fd7b-4ee9-a05e-a3c94a551daf None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:29.480055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b164f-fd7b-4ee9-a05e-a3c94a551daf None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:29.480389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b164f-fd7b-4ee9-a05e-a3c94a551daf None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:29.481938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b164f-fd7b-4ee9-a05e-a3c94a551daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:29.482329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b164f-fd7b-4ee9-a05e-a3c94a551daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:29.485110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b164f-fd7b-4ee9-a05e-a3c94a551daf None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:29.503950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 397/783] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:29.505608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b164f-fd7b-4ee9-a05e-a3c94a551daf None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:29.528867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:29.558368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8ebcf-08eb-4fbe-8017-ecd0780f044d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:29.614794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca982b-b94e-4b09-bd3d-fba94514b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:29.615911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca982b-b94e-4b09-bd3d-fba94514b5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:29.616525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca982b-b94e-4b09-bd3d-fba94514b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:29.616995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca982b-b94e-4b09-bd3d-fba94514b5d2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:29.617933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca982b-b94e-4b09-bd3d-fba94514b5d2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:29.620095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca982b-b94e-4b09-bd3d-fba94514b5d2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8cca982b-b94e-4b09-bd3d-fba94514b5d2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:29.638735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:29.639869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:12:29.640724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:29.649083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 387/784] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:29 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:29.650168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca982b-b94e-4b09-bd3d-fba94514b5d2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:29.664557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b164f-fd7b-4ee9-a05e-a3c94a551daf None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:29.716349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e1468-9477-4137-9a16-eda28604e94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:29.717834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e1468-9477-4137-9a16-eda28604e94a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:29.718465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e1468-9477-4137-9a16-eda28604e94a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:29.718908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e1468-9477-4137-9a16-eda28604e94a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:29.727050 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:29.734510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e1468-9477-4137-9a16-eda28604e94a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-431e1468-9477-4137-9a16-eda28604e94a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:29.745187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:29.746552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:29.747491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:29.747491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:29.747491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:29.747491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:29.747491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:29.747491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:29.747491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:29.747491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:29.747491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:29.747491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:29.747491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:12:29.747491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:29.751291 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 398/785] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:29.752664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e1468-9477-4137-9a16-eda28604e94a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:29.788841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca982b-b94e-4b09-bd3d-fba94514b5d2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:29.833858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed858ce0-7988-482b-b9dc-51281dd0f320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:29.834426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed858ce0-7988-482b-b9dc-51281dd0f320 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:29.834714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed858ce0-7988-482b-b9dc-51281dd0f320 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:29.835054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed858ce0-7988-482b-b9dc-51281dd0f320 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:29.843797 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed858ce0-7988-482b-b9dc-51281dd0f320 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:29.847322 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed858ce0-7988-482b-b9dc-51281dd0f320 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:29.853949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ed858ce0-7988-482b-b9dc-51281dd0f320 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:29.869552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:29.870932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:29.872188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:29.872188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:29.872188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:29.872188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:29.872188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:29.872188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:29.872188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:29.872188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:29.872188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 15:12:29.872188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:29.872188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 388/786] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Jul 15 15:12:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:29.873303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed858ce0-7988-482b-b9dc-51281dd0f320 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:29.898732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e1468-9477-4137-9a16-eda28604e94a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:29.943608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fac5a-7c6f-4097-ae71-84559b425fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:29.944533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fac5a-7c6f-4097-ae71-84559b425fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:29.944997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fac5a-7c6f-4097-ae71-84559b425fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:29.945450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fac5a-7c6f-4097-ae71-84559b425fc8 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:29.946322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fac5a-7c6f-4097-ae71-84559b425fc8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:29.946798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fac5a-7c6f-4097-ae71-84559b425fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:29.948355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fac5a-7c6f-4097-ae71-84559b425fc8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:29.956313 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 399/787] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:12:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:29.957512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fac5a-7c6f-4097-ae71-84559b425fc8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:30.008620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed858ce0-7988-482b-b9dc-51281dd0f320 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:30.038737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:30.056418 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a941adb-0792-4afd-9e02-2fbd95c81d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:30.057282 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a941adb-0792-4afd-9e02-2fbd95c81d31 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:30.057562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a941adb-0792-4afd-9e02-2fbd95c81d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:30.057849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a941adb-0792-4afd-9e02-2fbd95c81d31 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:30.058626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a941adb-0792-4afd-9e02-2fbd95c81d31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:30.059134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a941adb-0792-4afd-9e02-2fbd95c81d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:30.060404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a941adb-0792-4afd-9e02-2fbd95c81d31 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:30.076116 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fac5a-7c6f-4097-ae71-84559b425fc8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:30.076628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 389/788] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:30.078082 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a941adb-0792-4afd-9e02-2fbd95c81d31 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:30.115797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eecc8-ca0b-4a94-af2e-2a44da726bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:30.116874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eecc8-ca0b-4a94-af2e-2a44da726bea None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:30.117369 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eecc8-ca0b-4a94-af2e-2a44da726bea None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:30.117809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eecc8-ca0b-4a94-af2e-2a44da726bea None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:30.118809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eecc8-ca0b-4a94-af2e-2a44da726bea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:30.119269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eecc8-ca0b-4a94-af2e-2a44da726bea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:30.120986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eecc8-ca0b-4a94-af2e-2a44da726bea None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:30.124197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:30.151951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 400/789] 10.222.0.64 () {56 vars in 1149 bytes} [Fri Jul 15 15:12:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:30.153182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eecc8-ca0b-4a94-af2e-2a44da726bea None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:30.198276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a941adb-0792-4afd-9e02-2fbd95c81d31 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:30.244213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7779377-f334-4d1c-92d3-697d9018f16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:30.246475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7779377-f334-4d1c-92d3-697d9018f16a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:30.246775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7779377-f334-4d1c-92d3-697d9018f16a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:30.247060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7779377-f334-4d1c-92d3-697d9018f16a None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:30.247814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7779377-f334-4d1c-92d3-697d9018f16a None admin] RBAC: Adding query filter params (type=network) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:30.248129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7779377-f334-4d1c-92d3-697d9018f16a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:30.249675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7779377-f334-4d1c-92d3-697d9018f16a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:30.260128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 390/790] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:12:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:30.260973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7779377-f334-4d1c-92d3-697d9018f16a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:30.295783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eecc8-ca0b-4a94-af2e-2a44da726bea None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:30.331737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:30.348472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2597b-0771-4f57-a2f2-54f6c3bf1a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:30.349644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2597b-0771-4f57-a2f2-54f6c3bf1a5e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:30.349940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2597b-0771-4f57-a2f2-54f6c3bf1a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:30.350228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2597b-0771-4f57-a2f2-54f6c3bf1a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:30.366195 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2597b-0771-4f57-a2f2-54f6c3bf1a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:30.368516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2597b-0771-4f57-a2f2-54f6c3bf1a5e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-22a2597b-0771-4f57-a2f2-54f6c3bf1a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:30.394337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:30.396124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:30.398259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:30.398259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:30.398259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:30.398259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:30.398259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 401/791] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:30.399008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2597b-0771-4f57-a2f2-54f6c3bf1a5e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:30.428137 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7779377-f334-4d1c-92d3-697d9018f16a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:30.476548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:30.487809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5ff18-51e0-44f7-9d3c-08a4fa8355a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:30.489396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5ff18-51e0-44f7-9d3c-08a4fa8355a3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:30.490142 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5ff18-51e0-44f7-9d3c-08a4fa8355a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:30.490762 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5ff18-51e0-44f7-9d3c-08a4fa8355a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:30.507203 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5ff18-51e0-44f7-9d3c-08a4fa8355a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:30.509565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5ff18-51e0-44f7-9d3c-08a4fa8355a3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3aa5ff18-51e0-44f7-9d3c-08a4fa8355a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:30.538343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:30.539746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:30.541027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:30.541027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:30.541027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:30.541027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:30.541027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 391/792] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:30.541027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5ff18-51e0-44f7-9d3c-08a4fa8355a3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:30.554176 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2597b-0771-4f57-a2f2-54f6c3bf1a5e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:30.604794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcc0f9-2930-47f5-a681-277371bb4bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:30.605798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcc0f9-2930-47f5-a681-277371bb4bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:30.606258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcc0f9-2930-47f5-a681-277371bb4bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:30.606695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcc0f9-2930-47f5-a681-277371bb4bc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:30.607846 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcc0f9-2930-47f5-a681-277371bb4bc8 None admin] RBAC: Adding query filter params (interface=public, service_id=5907ff8aaa3d4f509b7f4c71880fc6c3, region_id=RegionOne) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:30.608358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcc0f9-2930-47f5-a681-277371bb4bc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:30.609994 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcc0f9-2930-47f5-a681-277371bb4bc8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:30.627090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 402/793] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Jul 15 15:12:30 2022] GET /identity/v3/endpoints?service_id=5907ff8aaa3d4f509b7f4c71880fc6c3&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:30.628990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcc0f9-2930-47f5-a681-277371bb4bc8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:30.693808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5ff18-51e0-44f7-9d3c-08a4fa8355a3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:30.696266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:30.744163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ad61e-d1fe-4b9b-8e91-4169304234e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:30.744800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ad61e-d1fe-4b9b-8e91-4169304234e2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:30.745262 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ad61e-d1fe-4b9b-8e91-4169304234e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:30.746036 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ad61e-d1fe-4b9b-8e91-4169304234e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:30.747083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ad61e-d1fe-4b9b-8e91-4169304234e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:30.747524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ad61e-d1fe-4b9b-8e91-4169304234e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:30.748998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ad61e-d1fe-4b9b-8e91-4169304234e2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:30.765149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 392/794] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:30.766069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ad61e-d1fe-4b9b-8e91-4169304234e2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:30.774756 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcc0f9-2930-47f5-a681-277371bb4bc8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:30.796771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:30.829938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebdc43-fc1f-4de8-bd5d-f946bea66e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:30.830928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebdc43-fc1f-4de8-bd5d-f946bea66e64 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:30.831368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebdc43-fc1f-4de8-bd5d-f946bea66e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:30.831837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebdc43-fc1f-4de8-bd5d-f946bea66e64 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:30.832759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebdc43-fc1f-4de8-bd5d-f946bea66e64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:30.833354 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebdc43-fc1f-4de8-bd5d-f946bea66e64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:30.835033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebdc43-fc1f-4de8-bd5d-f946bea66e64 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:30.853882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 403/795] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:30.855030 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebdc43-fc1f-4de8-bd5d-f946bea66e64 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:30.899141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ad61e-d1fe-4b9b-8e91-4169304234e2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:30.942461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395a931-eb20-4e76-ad9a-2e7e55cb6370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:30.943201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395a931-eb20-4e76-ad9a-2e7e55cb6370 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:30.943499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395a931-eb20-4e76-ad9a-2e7e55cb6370 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:30.943771 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395a931-eb20-4e76-ad9a-2e7e55cb6370 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:30.944482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395a931-eb20-4e76-ad9a-2e7e55cb6370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:30.946077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395a931-eb20-4e76-ad9a-2e7e55cb6370 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:30.952572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 393/796] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Jul 15 15:12:30 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:30.953538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395a931-eb20-4e76-ad9a-2e7e55cb6370 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:30.997640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:30.999202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebdc43-fc1f-4de8-bd5d-f946bea66e64 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:31.048736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d5b59-0958-4723-ba1b-d6da5f98d0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:31.050344 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d5b59-0958-4723-ba1b-d6da5f98d0cf None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:31.051022 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d5b59-0958-4723-ba1b-d6da5f98d0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:31.051682 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d5b59-0958-4723-ba1b-d6da5f98d0cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:31.073569 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d5b59-0958-4723-ba1b-d6da5f98d0cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:31.075878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d5b59-0958-4723-ba1b-d6da5f98d0cf None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:31.097262 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395a931-eb20-4e76-ad9a-2e7e55cb6370 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-d85d5b59-0958-4723-ba1b-d6da5f98d0cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:31.109096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:31.110910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:31.111911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:31.111911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:31.111911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:31.111911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:31.111911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:31.111911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:31.111911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:31.111911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:31.111911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 15:12:31.111911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:31.114517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 404/797] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:12:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:31.121365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d5b59-0958-4723-ba1b-d6da5f98d0cf None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:31.153106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be68f0-0a80-41b6-857e-33bd5d51e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:31.153106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be68f0-0a80-41b6-857e-33bd5d51e856 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:31.153106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be68f0-0a80-41b6-857e-33bd5d51e856 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:31.153106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be68f0-0a80-41b6-857e-33bd5d51e856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:31.156542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be68f0-0a80-41b6-857e-33bd5d51e856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:31.159265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be68f0-0a80-41b6-857e-33bd5d51e856 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-51be68f0-0a80-41b6-857e-33bd5d51e856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:31.181285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:31.182373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:31.186456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:31.186456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:31.186456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:31.186456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:31.186456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:31.186456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:31.186456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:31.186456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:31.186456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 394/798] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:31.189336 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e770b7-0725-412e-b683-dc91ea3bb6e5 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:31.189625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e770b7-0725-412e-b683-dc91ea3bb6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:31.189905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e770b7-0725-412e-b683-dc91ea3bb6e5 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:31.191657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 395/799] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:31.192471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e770b7-0725-412e-b683-dc91ea3bb6e5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:31.203704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:31.313876 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d5b59-0958-4723-ba1b-d6da5f98d0cf None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:31.324607 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:31.346245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e770b7-0725-412e-b683-dc91ea3bb6e5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:31.365726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ca80e-541e-4f03-9906-35c4ef171d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:31.366433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ca80e-541e-4f03-9906-35c4ef171d2b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:31.366976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ca80e-541e-4f03-9906-35c4ef171d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:31.367260 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ca80e-541e-4f03-9906-35c4ef171d2b None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:31.368645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ca80e-541e-4f03-9906-35c4ef171d2b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:31.369015 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ca80e-541e-4f03-9906-35c4ef171d2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:31.370557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ca80e-541e-4f03-9906-35c4ef171d2b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:31.389309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfce5d-d311-41ce-b15e-555f36189267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:31.390198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfce5d-d311-41ce-b15e-555f36189267 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:31.390587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfce5d-d311-41ce-b15e-555f36189267 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:31.390971 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfce5d-d311-41ce-b15e-555f36189267 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:31.392009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfce5d-d311-41ce-b15e-555f36189267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:31.392483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfce5d-d311-41ce-b15e-555f36189267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:31.394772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfce5d-d311-41ce-b15e-555f36189267 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:31.399279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 405/800] 10.222.0.64 () {56 vars in 1135 bytes} [Fri Jul 15 15:12:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:31.401398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01383a-a19b-482e-822e-85494f5fa0d4 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:31.401700 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01383a-a19b-482e-822e-85494f5fa0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:31.402167 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01383a-a19b-482e-822e-85494f5fa0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:31.421679 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 396/801] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:31.423435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfce5d-d311-41ce-b15e-555f36189267 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:31.426887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0c01383a-a19b-482e-822e-85494f5fa0d4 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:31.429335 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0c01383a-a19b-482e-822e-85494f5fa0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:31.540967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 406/802] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:31.542022 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01383a-a19b-482e-822e-85494f5fa0d4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:31.571268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:31.586918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfce5d-d311-41ce-b15e-555f36189267 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:31.634185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d23fa-876b-417e-a18c-03ba59c3d326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:31.635002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d23fa-876b-417e-a18c-03ba59c3d326 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:31.635278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d23fa-876b-417e-a18c-03ba59c3d326 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:31.635749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d23fa-876b-417e-a18c-03ba59c3d326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:31.647666 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d23fa-876b-417e-a18c-03ba59c3d326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:31.650281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d23fa-876b-417e-a18c-03ba59c3d326 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:31.660872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-dd6d23fa-876b-417e-a18c-03ba59c3d326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:31.677269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:31.678954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:31.680753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:31.680753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:31.680753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:31.680753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:31.690631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 397/803] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:31.690631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d23fa-876b-417e-a18c-03ba59c3d326 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:31.691227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01383a-a19b-482e-822e-85494f5fa0d4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:31.729854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f49341-82d9-4e00-9197-c792b3f19d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:31.730755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f49341-82d9-4e00-9197-c792b3f19d06 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:31.731188 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f49341-82d9-4e00-9197-c792b3f19d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:31.731342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f49341-82d9-4e00-9197-c792b3f19d06 None admin] PATH_INFO: `/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/2a328efd184f4988bb033c83c3321991/roles/0ea33b1c5ba54280862c8470178e2732` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:31.751320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f49341-82d9-4e00-9197-c792b3f19d06 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0acc3e7b64dbab9113284b46f38ff, user_id=2a328efd184f4988bb033c83c3321991, role_id=0ea33b1c5ba54280862c8470178e2732)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:31.752816 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f49341-82d9-4e00-9197-c792b3f19d06 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:31.778216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 407/804] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:12:31 2022] PUT /identity/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/2a328efd184f4988bb033c83c3321991/roles/0ea33b1c5ba54280862c8470178e2732 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:12:31.778216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f313f-0a93-4875-802d-69c3065002e8 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:31.778216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f313f-0a93-4875-802d-69c3065002e8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:31.778216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f313f-0a93-4875-802d-69c3065002e8 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:31.778216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 408/805] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:31.785124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f313f-0a93-4875-802d-69c3065002e8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:31.840524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d23fa-876b-417e-a18c-03ba59c3d326 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:31.902117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:31.905743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e8b4f-ae2a-4cae-9e79-c10f02855f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:31.908228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e8b4f-ae2a-4cae-9e79-c10f02855f1a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:31.908501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e8b4f-ae2a-4cae-9e79-c10f02855f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:31.908845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e8b4f-ae2a-4cae-9e79-c10f02855f1a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:31.912181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e8b4f-ae2a-4cae-9e79-c10f02855f1a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:31.913499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e8b4f-ae2a-4cae-9e79-c10f02855f1a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-631e8b4f-ae2a-4cae-9e79-c10f02855f1a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:31.934497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:31.935525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:12:31.936386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:31.944826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 398/806] 10.222.0.64 () {56 vars in 1129 bytes} [Fri Jul 15 15:12:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:31.944826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d405fa6-c38b-43d6-9d77-42adf4a6e152 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:31.944826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d405fa6-c38b-43d6-9d77-42adf4a6e152 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:31.944826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d405fa6-c38b-43d6-9d77-42adf4a6e152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:31.968694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f313f-0a93-4875-802d-69c3065002e8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:31.976629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6d405fa6-c38b-43d6-9d77-42adf4a6e152 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:31.978284 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6d405fa6-c38b-43d6-9d77-42adf4a6e152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:32.031231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dbaa7-342a-489d-b712-b407ef061645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:32.032829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dbaa7-342a-489d-b712-b407ef061645 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:32.033330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dbaa7-342a-489d-b712-b407ef061645 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:32.034080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dbaa7-342a-489d-b712-b407ef061645 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:32.035302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dbaa7-342a-489d-b712-b407ef061645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:32.035769 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dbaa7-342a-489d-b712-b407ef061645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:32.038071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dbaa7-342a-489d-b712-b407ef061645 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:32.063811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 409/807] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:32.063811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dbaa7-342a-489d-b712-b407ef061645 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:32.084644 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:32.100892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 399/808] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:32.102425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d405fa6-c38b-43d6-9d77-42adf4a6e152 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:32.251510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d405fa6-c38b-43d6-9d77-42adf4a6e152 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:32.258307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dbaa7-342a-489d-b712-b407ef061645 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:32.303763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:32.309584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb7b1-2404-4a18-8ad3-bafdc7ae9e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:32.311215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb7b1-2404-4a18-8ad3-bafdc7ae9e0a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:32.311534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb7b1-2404-4a18-8ad3-bafdc7ae9e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:32.311818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb7b1-2404-4a18-8ad3-bafdc7ae9e0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:32.316406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ce555-ef48-4ddc-9b93-49981b794c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:32.317923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ce555-ef48-4ddc-9b93-49981b794c9a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:32.318424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ce555-ef48-4ddc-9b93-49981b794c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:32.318932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ce555-ef48-4ddc-9b93-49981b794c9a None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:32.319950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ce555-ef48-4ddc-9b93-49981b794c9a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:32.320429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebb7b1-2404-4a18-8ad3-bafdc7ae9e0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:32.320779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ce555-ef48-4ddc-9b93-49981b794c9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:32.322681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebb7b1-2404-4a18-8ad3-bafdc7ae9e0a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:32.323065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ce555-ef48-4ddc-9b93-49981b794c9a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:32.341119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 410/809] 10.222.0.64 () {56 vars in 1124 bytes} [Fri Jul 15 15:12:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:32.341119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ce555-ef48-4ddc-9b93-49981b794c9a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2cebb7b1-2404-4a18-8ad3-bafdc7ae9e0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:32.347297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:32.348311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:32.350199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:32.350199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:32.350199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:32.350199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:32.350199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:32.350199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:32.350199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:32.350199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:32.353361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 400/810] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:32.354750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb7b1-2404-4a18-8ad3-bafdc7ae9e0a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:32.432324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:32.498499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb7b1-2404-4a18-8ad3-bafdc7ae9e0a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:32.499935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ce555-ef48-4ddc-9b93-49981b794c9a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:32.555093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790f857-a5c3-4582-a00e-87d844f032c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:32.556324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790f857-a5c3-4582-a00e-87d844f032c9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:32.556810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790f857-a5c3-4582-a00e-87d844f032c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:32.557162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5808e-3e8c-443b-a960-9ca7340458d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:32.557795 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790f857-a5c3-4582-a00e-87d844f032c9 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:32.558049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5808e-3e8c-443b-a960-9ca7340458d6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:32.558339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5808e-3e8c-443b-a960-9ca7340458d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:32.558623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5808e-3e8c-443b-a960-9ca7340458d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:32.559361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790f857-a5c3-4582-a00e-87d844f032c9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:32.559879 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790f857-a5c3-4582-a00e-87d844f032c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:32.561687 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790f857-a5c3-4582-a00e-87d844f032c9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:32.575511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5808e-3e8c-443b-a960-9ca7340458d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:32.576075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 401/811] 10.222.0.64 () {56 vars in 1124 bytes} [Fri Jul 15 15:12:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:32.578152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790f857-a5c3-4582-a00e-87d844f032c9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-38b5808e-3e8c-443b-a960-9ca7340458d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:32.582139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:32.583123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:32.584055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:32.584055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:32.584055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:32.584055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:32.584055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:32.584055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:32.584055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:32.584055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:32.584055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:32.584055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:32.584055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:12:32.584055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:32.585671 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 411/812] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:12:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:32.589436 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5808e-3e8c-443b-a960-9ca7340458d6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:32.669439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:32.736333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5808e-3e8c-443b-a960-9ca7340458d6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:32.748023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790f857-a5c3-4582-a00e-87d844f032c9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:32.770830 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:32.787371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18baab-fb49-40f3-882d-29d6c67fc27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:32.788328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18baab-fb49-40f3-882d-29d6c67fc27b None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:32.788661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18baab-fb49-40f3-882d-29d6c67fc27b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:32.789038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18baab-fb49-40f3-882d-29d6c67fc27b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:32.790060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18baab-fb49-40f3-882d-29d6c67fc27b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:32.791936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18baab-fb49-40f3-882d-29d6c67fc27b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:32.799157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225beef4-6a33-461e-bbee-edb398db250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:32.800356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225beef4-6a33-461e-bbee-edb398db250a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:32.800821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225beef4-6a33-461e-bbee-edb398db250a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:32.801279 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225beef4-6a33-461e-bbee-edb398db250a None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:32.802269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225beef4-6a33-461e-bbee-edb398db250a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:32.803420 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225beef4-6a33-461e-bbee-edb398db250a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:32.805721 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225beef4-6a33-461e-bbee-edb398db250a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:32.827521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 412/813] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Jul 15 15:12:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:12:32.828236 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 402/814] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:32.829007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18baab-fb49-40f3-882d-29d6c67fc27b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:32.830659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225beef4-6a33-461e-bbee-edb398db250a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:33.019903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225beef4-6a33-461e-bbee-edb398db250a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:33.115029 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18baab-fb49-40f3-882d-29d6c67fc27b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:33.116758 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ae93b-36f1-48cf-a2ef-1d62688bccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:33.117882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ae93b-36f1-48cf-a2ef-1d62688bccc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:33.118357 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ae93b-36f1-48cf-a2ef-1d62688bccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:33.118788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ae93b-36f1-48cf-a2ef-1d62688bccc4 None admin] PATH_INFO: `/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/04f3a308ee69455287ac460d9ab2aef0/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:33.119249 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:33.121878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ae93b-36f1-48cf-a2ef-1d62688bccc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0acc3e7b64dbab9113284b46f38ff, user_id=04f3a308ee69455287ac460d9ab2aef0, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:33.123733 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ae93b-36f1-48cf-a2ef-1d62688bccc4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:33.144343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 403/815] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:12:32 2022] PUT /identity/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/04f3a308ee69455287ac460d9ab2aef0/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:12:33.181423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a30756-ee61-4047-9e70-677c8bae410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:33.182246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30756-ee61-4047-9e70-677c8bae410e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:33.182591 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30756-ee61-4047-9e70-677c8bae410e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:33.182938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30756-ee61-4047-9e70-677c8bae410e None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:33.183877 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a30756-ee61-4047-9e70-677c8bae410e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:33.184260 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a30756-ee61-4047-9e70-677c8bae410e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:33.186688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a30756-ee61-4047-9e70-677c8bae410e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:33.198582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 413/816] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:12:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:33.205656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ae93b-36f1-48cf-a2ef-1d62688bccc4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:33.275386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:33.373525 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42363d-2489-4583-b966-86d62171b158 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:33.378687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42363d-2489-4583-b966-86d62171b158 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:33.379511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42363d-2489-4583-b966-86d62171b158 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:33.383347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 414/817] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:12:33.388609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9da30-5588-4132-9205-22f7ba0f4382 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:33.388934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9da30-5588-4132-9205-22f7ba0f4382 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:33.389257 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9da30-5588-4132-9205-22f7ba0f4382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:33.412356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ae93b-36f1-48cf-a2ef-1d62688bccc4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:33.417112 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e3f9da30-5588-4132-9205-22f7ba0f4382 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:33.418562 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e3f9da30-5588-4132-9205-22f7ba0f4382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:33.459572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bca3f-52f0-4289-abc7-559d849425e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:33.460405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bca3f-52f0-4289-abc7-559d849425e0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:33.460745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bca3f-52f0-4289-abc7-559d849425e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:33.461210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bca3f-52f0-4289-abc7-559d849425e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:33.474323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bca3f-52f0-4289-abc7-559d849425e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:33.475842 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bca3f-52f0-4289-abc7-559d849425e0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:33.506379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 415/818] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-865bca3f-52f0-4289-abc7-559d849425e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:33.507108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:33.508141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:33.509391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:33.509391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:33.509391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:33.509391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:33.509391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 404/819] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:33.514561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9da30-5588-4132-9205-22f7ba0f4382 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:33.556059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bca3f-52f0-4289-abc7-559d849425e0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:33.654553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:33.663476 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9da30-5588-4132-9205-22f7ba0f4382 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:33.709834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cedde9-3a6d-4a37-82cc-fb9c2b00920c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:33.711161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cedde9-3a6d-4a37-82cc-fb9c2b00920c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:33.711774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cedde9-3a6d-4a37-82cc-fb9c2b00920c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:33.712467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cedde9-3a6d-4a37-82cc-fb9c2b00920c None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:33.714010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cedde9-3a6d-4a37-82cc-fb9c2b00920c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:33.714905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cedde9-3a6d-4a37-82cc-fb9c2b00920c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:33.717744 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cedde9-3a6d-4a37-82cc-fb9c2b00920c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:33.734039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 416/820] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:33.741988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cedde9-3a6d-4a37-82cc-fb9c2b00920c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:33.758240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:33.794477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bca3f-52f0-4289-abc7-559d849425e0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:33.885376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4633-3edf-47ba-ab8d-438fc6f569a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:33.886625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4633-3edf-47ba-ab8d-438fc6f569a3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:33.887954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4633-3edf-47ba-ab8d-438fc6f569a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:33.888570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4633-3edf-47ba-ab8d-438fc6f569a3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:33.890042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c4633-3edf-47ba-ab8d-438fc6f569a3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:33.892290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cedde9-3a6d-4a37-82cc-fb9c2b00920c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:33.894128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c4633-3edf-47ba-ab8d-438fc6f569a3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-709c4633-3edf-47ba-ab8d-438fc6f569a3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:33.923013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:33.924190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:12:33.925024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:33.937305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 405/821] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:33 2022] GET /identity/v3/services/network => generated 88 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:33.944461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4633-3edf-47ba-ab8d-438fc6f569a3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:33.982393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702e679-98d0-4053-98e3-9f5b6988bcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:33.985899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e679-98d0-4053-98e3-9f5b6988bcea None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:33.988009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e679-98d0-4053-98e3-9f5b6988bcea None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:33.988553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e679-98d0-4053-98e3-9f5b6988bcea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:34.018957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702e679-98d0-4053-98e3-9f5b6988bcea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:34.020460 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702e679-98d0-4053-98e3-9f5b6988bcea None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-6702e679-98d0-4053-98e3-9f5b6988bcea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:34.053032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:34.054075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:34.055051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:34.055051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:34.055051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:34.055051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:34.055051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:34.055051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:34.055051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:34.055051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:34.055051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:12:34.055051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:34.064252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 417/822] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Jul 15 15:12:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:34.074437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702e679-98d0-4053-98e3-9f5b6988bcea None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:34.096842 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4633-3edf-47ba-ab8d-438fc6f569a3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:34.129467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:34.197119 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946a601-fadf-47ca-a460-a5c05b165e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:34.197837 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946a601-fadf-47ca-a460-a5c05b165e3d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:34.198133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946a601-fadf-47ca-a460-a5c05b165e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:34.198424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946a601-fadf-47ca-a460-a5c05b165e3d None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:34.199159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946a601-fadf-47ca-a460-a5c05b165e3d None admin] RBAC: Adding query filter params (name=network) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:34.199475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946a601-fadf-47ca-a460-a5c05b165e3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:34.205021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946a601-fadf-47ca-a460-a5c05b165e3d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:34.215129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 406/823] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:12:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:34.221853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946a601-fadf-47ca-a460-a5c05b165e3d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:34.254680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:34.285596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702e679-98d0-4053-98e3-9f5b6988bcea None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:34.342258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba682b-ce6a-48e6-af69-2b8da041b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:34.342977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba682b-ce6a-48e6-af69-2b8da041b1bd None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:34.344138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba682b-ce6a-48e6-af69-2b8da041b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:34.344618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba682b-ce6a-48e6-af69-2b8da041b1bd None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:34.345646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba682b-ce6a-48e6-af69-2b8da041b1bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:34.346345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba682b-ce6a-48e6-af69-2b8da041b1bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:34.348203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba682b-ce6a-48e6-af69-2b8da041b1bd None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:34.380449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946a601-fadf-47ca-a460-a5c05b165e3d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:34.386541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 418/824] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Jul 15 15:12:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:34.389315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda22ed5-1887-46f8-b66a-217f1d3028da None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:34.389615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda22ed5-1887-46f8-b66a-217f1d3028da None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:34.389914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda22ed5-1887-46f8-b66a-217f1d3028da None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:34.391593 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 419/825] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:34.397237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda22ed5-1887-46f8-b66a-217f1d3028da None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:34.432215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629f65f-c816-48bf-993e-176edf511e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:34.433153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f65f-c816-48bf-993e-176edf511e9b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:34.433447 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f65f-c816-48bf-993e-176edf511e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:34.433769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f65f-c816-48bf-993e-176edf511e9b None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:34.434506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629f65f-c816-48bf-993e-176edf511e9b None admin] RBAC: Adding query filter params (type=network) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:34.434811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629f65f-c816-48bf-993e-176edf511e9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:34.436234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629f65f-c816-48bf-993e-176edf511e9b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:34.443506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 407/826] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:12:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:34.444932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b9a09-8af9-4596-a19d-bf4eceddb44d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:34.445277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b9a09-8af9-4596-a19d-bf4eceddb44d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:34.445557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b9a09-8af9-4596-a19d-bf4eceddb44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:34.466923 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-655b9a09-8af9-4596-a19d-bf4eceddb44d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:34.469007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-655b9a09-8af9-4596-a19d-bf4eceddb44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:34.520890 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:34.577369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 408/827] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:34.577369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b9a09-8af9-4596-a19d-bf4eceddb44d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:34.581950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda22ed5-1887-46f8-b66a-217f1d3028da None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:34.603845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:34.671222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca28c2a-db1b-4baf-b3fb-0bb57c0302ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:34.672403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca28c2a-db1b-4baf-b3fb-0bb57c0302ae None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:34.673025 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca28c2a-db1b-4baf-b3fb-0bb57c0302ae None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:34.673651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca28c2a-db1b-4baf-b3fb-0bb57c0302ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:34.780014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b9a09-8af9-4596-a19d-bf4eceddb44d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:34.784840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca28c2a-db1b-4baf-b3fb-0bb57c0302ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:34.786479 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca28c2a-db1b-4baf-b3fb-0bb57c0302ae None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:34.839025 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc4fd1-120d-48f7-85c8-9b82565571ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:34.840117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4fd1-120d-48f7-85c8-9b82565571ad None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:34.840647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4fd1-120d-48f7-85c8-9b82565571ad None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:34.841187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4fd1-120d-48f7-85c8-9b82565571ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:34.842164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc4fd1-120d-48f7-85c8-9b82565571ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:34.844613 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc4fd1-120d-48f7-85c8-9b82565571ad None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:34.881674 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 409/828] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Jul 15 15:12:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:12:34.883094 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc4fd1-120d-48f7-85c8-9b82565571ad None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:34.894112 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:34.928398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 420/829] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:12:34.935025 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca28c2a-db1b-4baf-b3fb-0bb57c0302ae None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:35.073488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca28c2a-db1b-4baf-b3fb-0bb57c0302ae None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:35.102083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:35.142026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce71df-d415-4c5b-8783-2d7103b9da50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:35.142880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce71df-d415-4c5b-8783-2d7103b9da50 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:35.143171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce71df-d415-4c5b-8783-2d7103b9da50 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:35.143457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce71df-d415-4c5b-8783-2d7103b9da50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:35.154367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc4fd1-120d-48f7-85c8-9b82565571ad None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:35.164054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce71df-d415-4c5b-8783-2d7103b9da50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:35.165785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce71df-d415-4c5b-8783-2d7103b9da50 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-38ce71df-d415-4c5b-8783-2d7103b9da50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:35.203432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:35.204392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:35.205297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:35.205297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:35.205297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:35.205297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:35.207987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb767388-cca9-4988-9849-e5ae84b69570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:35.209078 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb767388-cca9-4988-9849-e5ae84b69570 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:35.209564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb767388-cca9-4988-9849-e5ae84b69570 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:35.210041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb767388-cca9-4988-9849-e5ae84b69570 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:35.214868 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 421/830] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:35.222183 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce71df-d415-4c5b-8783-2d7103b9da50 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:35.224435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb767388-cca9-4988-9849-e5ae84b69570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-eb767388-cca9-4988-9849-e5ae84b69570 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:35.238623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:35.240090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:35.241736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 410/831] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:12:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:35.247565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb767388-cca9-4988-9849-e5ae84b69570 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:35.277671 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:35.406130 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb767388-cca9-4988-9849-e5ae84b69570 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:35.408415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce71df-d415-4c5b-8783-2d7103b9da50 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:35.431613 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:35.448250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d4eac-dfe0-407a-91d7-065f1ede71fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:35.448981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d4eac-dfe0-407a-91d7-065f1ede71fd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:35.449300 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d4eac-dfe0-407a-91d7-065f1ede71fd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:35.449578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d4eac-dfe0-407a-91d7-065f1ede71fd None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:35.450535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d4eac-dfe0-407a-91d7-065f1ede71fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:35.450759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d4eac-dfe0-407a-91d7-065f1ede71fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:35.452306 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d4eac-dfe0-407a-91d7-065f1ede71fd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:35.463017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd71f1-913d-4f84-9c5f-c9a2ebfc0da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:35.463469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 411/832] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:12:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:35.464802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd71f1-913d-4f84-9c5f-c9a2ebfc0da5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:35.465614 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd71f1-913d-4f84-9c5f-c9a2ebfc0da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:35.466273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd71f1-913d-4f84-9c5f-c9a2ebfc0da5 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:35.467453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd71f1-913d-4f84-9c5f-c9a2ebfc0da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:35.468276 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd71f1-913d-4f84-9c5f-c9a2ebfc0da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:35.468858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d4eac-dfe0-407a-91d7-065f1ede71fd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:35.471788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd71f1-913d-4f84-9c5f-c9a2ebfc0da5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:35.488339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 422/833] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:35.495080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd71f1-913d-4f84-9c5f-c9a2ebfc0da5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:35.631271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:35.636353 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d4eac-dfe0-407a-91d7-065f1ede71fd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:35.659386 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd71f1-913d-4f84-9c5f-c9a2ebfc0da5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:35.679296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c2b8e-a113-4a95-a565-7bfa3afab073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:35.680512 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c2b8e-a113-4a95-a565-7bfa3afab073 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:35.681002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c2b8e-a113-4a95-a565-7bfa3afab073 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:35.681515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c2b8e-a113-4a95-a565-7bfa3afab073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:35.695230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c2b8e-a113-4a95-a565-7bfa3afab073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:35.696718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c2b8e-a113-4a95-a565-7bfa3afab073 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:35.707399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9cad3-95fb-4a74-a6cd-7ce40b80ea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:35.708982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9cad3-95fb-4a74-a6cd-7ce40b80ea45 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:35.709584 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9cad3-95fb-4a74-a6cd-7ce40b80ea45 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:35.710013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9cad3-95fb-4a74-a6cd-7ce40b80ea45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f47c2b8e-a113-4a95-a565-7bfa3afab073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:35.717362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:35.718561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:35.720732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:35.720732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:35.720732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:35.720732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:35.720732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 412/834] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:35.720732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3ac76-47d4-42d9-b731-5a74076c1e70 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:35.721398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3ac76-47d4-42d9-b731-5a74076c1e70 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:35.721398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3ac76-47d4-42d9-b731-5a74076c1e70 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:35.722739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 413/835] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:35.723060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9cad3-95fb-4a74-a6cd-7ce40b80ea45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:35.724840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3ac76-47d4-42d9-b731-5a74076c1e70 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:35.725755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9cad3-95fb-4a74-a6cd-7ce40b80ea45 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:35.776306 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-68e9cad3-95fb-4a74-a6cd-7ce40b80ea45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:35.864576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:35.865891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:35.867250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:35.867250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:35.867250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:35.867250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:35.867250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:35.867250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:35.867250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:35.867250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:35.867250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 423/836] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:35.867250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4990fc3-00d3-4b67-8cb1-6f67a9c89f69 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:35.867791 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4990fc3-00d3-4b67-8cb1-6f67a9c89f69 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:35.867791 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4990fc3-00d3-4b67-8cb1-6f67a9c89f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:35.877748 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3ac76-47d4-42d9-b731-5a74076c1e70 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:35.887591 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f4990fc3-00d3-4b67-8cb1-6f67a9c89f69 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:35.888821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f4990fc3-00d3-4b67-8cb1-6f67a9c89f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:35.938684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37404c-ad07-46f7-8ba6-8ddd596f1d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:35.939287 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37404c-ad07-46f7-8ba6-8ddd596f1d15 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:35.939572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37404c-ad07-46f7-8ba6-8ddd596f1d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:35.939958 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37404c-ad07-46f7-8ba6-8ddd596f1d15 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:35.940677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37404c-ad07-46f7-8ba6-8ddd596f1d15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:35.940986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37404c-ad07-46f7-8ba6-8ddd596f1d15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:35.942429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37404c-ad07-46f7-8ba6-8ddd596f1d15 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:35.958215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 414/837] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:35.959080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37404c-ad07-46f7-8ba6-8ddd596f1d15 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:35.983662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 424/838] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:35.986055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0c16f-56fa-41b4-ab91-ab96f2524355 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:35.986676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0c16f-56fa-41b4-ab91-ab96f2524355 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:35.986676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0c16f-56fa-41b4-ab91-ab96f2524355 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:35.988075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 425/839] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:35.988848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0c16f-56fa-41b4-ab91-ab96f2524355 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:36.080440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:36.086091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37404c-ad07-46f7-8ba6-8ddd596f1d15 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:36.101364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:36.123161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d146ff-28ec-474b-a282-5f45f45b50ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:36.123932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d146ff-28ec-474b-a282-5f45f45b50ef None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:36.124100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d146ff-28ec-474b-a282-5f45f45b50ef None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:36.124383 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d146ff-28ec-474b-a282-5f45f45b50ef None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:36.125696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d146ff-28ec-474b-a282-5f45f45b50ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:36.126017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d146ff-28ec-474b-a282-5f45f45b50ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:36.127507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d146ff-28ec-474b-a282-5f45f45b50ef None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:36.140261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0c16f-56fa-41b4-ab91-ab96f2524355 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:36.140621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 415/840] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:36.142570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193c660-294d-4e59-a1dc-07c97e3714dd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:36.142861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193c660-294d-4e59-a1dc-07c97e3714dd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:36.143136 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193c660-294d-4e59-a1dc-07c97e3714dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:36.160904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b193c660-294d-4e59-a1dc-07c97e3714dd None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:36.162162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b193c660-294d-4e59-a1dc-07c97e3714dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:36.199658 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da33c5-38c7-48c6-9b45-4af444c05fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:36.200755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da33c5-38c7-48c6-9b45-4af444c05fef None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:36.201261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da33c5-38c7-48c6-9b45-4af444c05fef None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:36.201740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da33c5-38c7-48c6-9b45-4af444c05fef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:36.212841 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da33c5-38c7-48c6-9b45-4af444c05fef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:36.213875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da33c5-38c7-48c6-9b45-4af444c05fef None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c8da33c5-38c7-48c6-9b45-4af444c05fef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:36.229923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:36.230992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:36.231921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:36.231921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:36.231921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:36.231921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:36.231921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:36.231921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:36.231921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:36.231921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:36.231921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 15:12:36.231921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:36.231921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 426/841] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Jul 15 15:12:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:36.232512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da33c5-38c7-48c6-9b45-4af444c05fef None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:36.258810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 416/842] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:36.259714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193c660-294d-4e59-a1dc-07c97e3714dd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:36.354959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da33c5-38c7-48c6-9b45-4af444c05fef None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:36.370929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:36.390466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:36.392196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193c660-294d-4e59-a1dc-07c97e3714dd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:36.397231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2786f19-5132-43ea-9bad-ba7b2f1aec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:36.398041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2786f19-5132-43ea-9bad-ba7b2f1aec92 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:36.398321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2786f19-5132-43ea-9bad-ba7b2f1aec92 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:36.398597 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2786f19-5132-43ea-9bad-ba7b2f1aec92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:36.413541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2786f19-5132-43ea-9bad-ba7b2f1aec92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-b2786f19-5132-43ea-9bad-ba7b2f1aec92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:36.422137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:36.423873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:36.425422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 427/843] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:12:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:36.426203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2786f19-5132-43ea-9bad-ba7b2f1aec92 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:36.441138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44d2d0-12ed-4f8a-b883-06e48fc11ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:36.441611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44d2d0-12ed-4f8a-b883-06e48fc11ebe None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:36.441900 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44d2d0-12ed-4f8a-b883-06e48fc11ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:36.442183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44d2d0-12ed-4f8a-b883-06e48fc11ebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:36.443033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44d2d0-12ed-4f8a-b883-06e48fc11ebe None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=b022a37031b940c3bd67861373926e58) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:36.443345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44d2d0-12ed-4f8a-b883-06e48fc11ebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:36.444822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44d2d0-12ed-4f8a-b883-06e48fc11ebe None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:36.465227 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 417/844] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:36 2022] GET /identity/v3/role_assignments?user.id=b022a37031b940c3bd67861373926e58&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=87593f63c4744eac870c07b006022e77 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:36.465227 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44d2d0-12ed-4f8a-b883-06e48fc11ebe None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:36.598201 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2786f19-5132-43ea-9bad-ba7b2f1aec92 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:36.627947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44d2d0-12ed-4f8a-b883-06e48fc11ebe None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:36.663474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e768d-f0ea-4607-ba00-51109874df81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:36.664580 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e768d-f0ea-4607-ba00-51109874df81 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:36.664981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e768d-f0ea-4607-ba00-51109874df81 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:36.665302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e768d-f0ea-4607-ba00-51109874df81 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:36.666288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e768d-f0ea-4607-ba00-51109874df81 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:36.666612 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e768d-f0ea-4607-ba00-51109874df81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:36.668088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e768d-f0ea-4607-ba00-51109874df81 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:36.686397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d862c-06ee-4e13-9ec6-5a906365319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:36.686795 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d862c-06ee-4e13-9ec6-5a906365319e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:36.687310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d862c-06ee-4e13-9ec6-5a906365319e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:36.687835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d862c-06ee-4e13-9ec6-5a906365319e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:36.689263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d862c-06ee-4e13-9ec6-5a906365319e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:36.691144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d862c-06ee-4e13-9ec6-5a906365319e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:36.699732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 428/845] 10.222.0.64 () {56 vars in 1149 bytes} [Fri Jul 15 15:12:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:36.700596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e768d-f0ea-4607-ba00-51109874df81 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ef2d862c-06ee-4e13-9ec6-5a906365319e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:36.714092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:36.715154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:12:36.716014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:36.716816 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 418/846] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:12:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:36.721118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d862c-06ee-4e13-9ec6-5a906365319e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:36.743676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:36.793445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:36.864230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e768d-f0ea-4607-ba00-51109874df81 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:36.864477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d862c-06ee-4e13-9ec6-5a906365319e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:36.906979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5e06-8839-42bd-a98b-65b2a9d9cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:36.907673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5e06-8839-42bd-a98b-65b2a9d9cef2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:36.907968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5e06-8839-42bd-a98b-65b2a9d9cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:36.908253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5e06-8839-42bd-a98b-65b2a9d9cef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:36.910416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2d79d-cfba-411d-a153-59b0e683e0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:36.911102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2d79d-cfba-411d-a153-59b0e683e0bf None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:36.911463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2d79d-cfba-411d-a153-59b0e683e0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:36.911666 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2d79d-cfba-411d-a153-59b0e683e0bf None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:36.912448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2d79d-cfba-411d-a153-59b0e683e0bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:36.912739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2d79d-cfba-411d-a153-59b0e683e0bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:36.916496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2d79d-cfba-411d-a153-59b0e683e0bf None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:36.925863 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 429/847] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:12:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:36.933273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2d79d-cfba-411d-a153-59b0e683e0bf None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:37.016295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb5e06-8839-42bd-a98b-65b2a9d9cef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:37.017959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb5e06-8839-42bd-a98b-65b2a9d9cef2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:37.039312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:37.085087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2d79d-cfba-411d-a153-59b0e683e0bf None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:37.106245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:37.140078 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33a66e-41ef-420c-9e39-679ae8249df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:37.140589 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33a66e-41ef-420c-9e39-679ae8249df4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:37.141437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33a66e-41ef-420c-9e39-679ae8249df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:37.141808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33a66e-41ef-420c-9e39-679ae8249df4 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:37.142509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33a66e-41ef-420c-9e39-679ae8249df4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:37.142848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33a66e-41ef-420c-9e39-679ae8249df4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:37.145214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33a66e-41ef-420c-9e39-679ae8249df4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:37.155150 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 430/848] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:12:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:37.156009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33a66e-41ef-420c-9e39-679ae8249df4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:37.176781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 419/849] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:36 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:12:37.178340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5e06-8839-42bd-a98b-65b2a9d9cef2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:37.310135 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33a66e-41ef-420c-9e39-679ae8249df4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:37.318184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5e06-8839-42bd-a98b-65b2a9d9cef2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:37.335903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:37.360564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c82f59-92df-4819-a248-70c1c781564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:37.361311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d072ff6-601f-4630-a69c-f0799d24d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:37.361569 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c82f59-92df-4819-a248-70c1c781564b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:37.361956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c82f59-92df-4819-a248-70c1c781564b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:37.362120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072ff6-601f-4630-a69c-f0799d24d8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:37.362408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072ff6-601f-4630-a69c-f0799d24d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:37.362499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c82f59-92df-4819-a248-70c1c781564b None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:37.362684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072ff6-601f-4630-a69c-f0799d24d8f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:37.363387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c82f59-92df-4819-a248-70c1c781564b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:37.363800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c82f59-92df-4819-a248-70c1c781564b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:37.365355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c82f59-92df-4819-a248-70c1c781564b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:37.385110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 420/850] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:12:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:37.385110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c82f59-92df-4819-a248-70c1c781564b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:37.388063 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d072ff6-601f-4630-a69c-f0799d24d8f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:37.390718 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d072ff6-601f-4630-a69c-f0799d24d8f0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2d072ff6-601f-4630-a69c-f0799d24d8f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:37.428130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:37.430395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:37.431496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:37.431496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:37.431496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:37.431496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:37.437484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 431/851] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:37.439456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d072ff6-601f-4630-a69c-f0799d24d8f0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:37.486242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:37.545600 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c82f59-92df-4819-a248-70c1c781564b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:37.597379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d8949-d420-474e-9476-90fdcac2b2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:37.598518 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d8949-d420-474e-9476-90fdcac2b2fc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:37.599099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d8949-d420-474e-9476-90fdcac2b2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:37.599562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d8949-d420-474e-9476-90fdcac2b2fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:37.612152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d8949-d420-474e-9476-90fdcac2b2fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:37.615323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d8949-d420-474e-9476-90fdcac2b2fc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:37.634340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d072ff6-601f-4630-a69c-f0799d24d8f0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1a7d8949-d420-474e-9476-90fdcac2b2fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:37.644422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:37.645415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:37.646392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:37.646392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:37.646392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:37.646392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:37.646392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 421/852] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:37.652244 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d8949-d420-474e-9476-90fdcac2b2fc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:37.689681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:37.692106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b856891-7139-45f8-aba6-97b9aeccccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:37.693249 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b856891-7139-45f8-aba6-97b9aeccccb4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:37.693621 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b856891-7139-45f8-aba6-97b9aeccccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:37.693909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b856891-7139-45f8-aba6-97b9aeccccb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:37.694785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b856891-7139-45f8-aba6-97b9aeccccb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:37.695126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b856891-7139-45f8-aba6-97b9aeccccb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:37.700041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b856891-7139-45f8-aba6-97b9aeccccb4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:37.722873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 432/853] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:37.728329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b856891-7139-45f8-aba6-97b9aeccccb4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:37.810523 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d8949-d420-474e-9476-90fdcac2b2fc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:37.853469 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:37.866871 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8551-b5ee-4fc5-b81b-2f1086620cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:37.868103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8551-b5ee-4fc5-b81b-2f1086620cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:37.868395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8551-b5ee-4fc5-b81b-2f1086620cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:37.868836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8551-b5ee-4fc5-b81b-2f1086620cc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:37.869829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8551-b5ee-4fc5-b81b-2f1086620cc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:37.870146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8551-b5ee-4fc5-b81b-2f1086620cc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:37.871356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b856891-7139-45f8-aba6-97b9aeccccb4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:37.871615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8551-b5ee-4fc5-b81b-2f1086620cc1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:37.889587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 422/854] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:37.896348 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8551-b5ee-4fc5-b81b-2f1086620cc1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:37.932734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349aaf-ce09-40ee-90d3-e2fdf3c41397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:37.934284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349aaf-ce09-40ee-90d3-e2fdf3c41397 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:37.934707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349aaf-ce09-40ee-90d3-e2fdf3c41397 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:37.935167 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349aaf-ce09-40ee-90d3-e2fdf3c41397 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:37.945582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3349aaf-ce09-40ee-90d3-e2fdf3c41397 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:37.947222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3349aaf-ce09-40ee-90d3-e2fdf3c41397 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-f3349aaf-ce09-40ee-90d3-e2fdf3c41397 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:37.970581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:37.971954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:37.973273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:37.973273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:37.973273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:37.973273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:37.973273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:37.973273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:37.973273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:37.973273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:37.973273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 15:12:37.973273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:37.973273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 433/855] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:12:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:37.978064 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349aaf-ce09-40ee-90d3-e2fdf3c41397 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:38.040323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:38.053570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8551-b5ee-4fc5-b81b-2f1086620cc1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:38.101170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973278b-3861-4e0d-b662-5c3743ac1670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:38.102173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973278b-3861-4e0d-b662-5c3743ac1670 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:38.102704 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973278b-3861-4e0d-b662-5c3743ac1670 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:38.103146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973278b-3861-4e0d-b662-5c3743ac1670 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:38.113303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973278b-3861-4e0d-b662-5c3743ac1670 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:38.114745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973278b-3861-4e0d-b662-5c3743ac1670 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f973278b-3861-4e0d-b662-5c3743ac1670 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:38.131125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:38.132100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:38.133017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:38.133017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:38.133017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:38.133017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:38.133017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:38.133017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:38.133017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:38.133017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:38.137266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 423/856] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:38.138288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973278b-3861-4e0d-b662-5c3743ac1670 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:38.147600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349aaf-ce09-40ee-90d3-e2fdf3c41397 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:38.211046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0e901-93bd-405b-96de-12515928c962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:38.212131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0e901-93bd-405b-96de-12515928c962 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:38.212972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0e901-93bd-405b-96de-12515928c962 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:38.213510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0e901-93bd-405b-96de-12515928c962 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:38.215441 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0e901-93bd-405b-96de-12515928c962 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:38.216139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0e901-93bd-405b-96de-12515928c962 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:38.219232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0e901-93bd-405b-96de-12515928c962 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:38.246306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 434/857] 10.222.0.64 () {56 vars in 1135 bytes} [Fri Jul 15 15:12:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:38.252111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0e901-93bd-405b-96de-12515928c962 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:38.265247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:38.285340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973278b-3861-4e0d-b662-5c3743ac1670 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:38.342374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a319c95-240d-45c2-a7c6-147258fea879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:38.343100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a319c95-240d-45c2-a7c6-147258fea879 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:38.343510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a319c95-240d-45c2-a7c6-147258fea879 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:38.343652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a319c95-240d-45c2-a7c6-147258fea879 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:38.344496 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a319c95-240d-45c2-a7c6-147258fea879 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:38.344805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a319c95-240d-45c2-a7c6-147258fea879 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:38.346439 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a319c95-240d-45c2-a7c6-147258fea879 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:38.361648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 424/858] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:38.371384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a319c95-240d-45c2-a7c6-147258fea879 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:38.392785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:38.409711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0e901-93bd-405b-96de-12515928c962 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:38.454596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb957cff-1817-4f4a-8a22-13f231486b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:38.455524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb957cff-1817-4f4a-8a22-13f231486b02 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:38.455805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb957cff-1817-4f4a-8a22-13f231486b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:38.456141 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb957cff-1817-4f4a-8a22-13f231486b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:38.530785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a319c95-240d-45c2-a7c6-147258fea879 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:38.545106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb957cff-1817-4f4a-8a22-13f231486b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:38.546543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb957cff-1817-4f4a-8a22-13f231486b02 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:38.555679 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:38.576659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bbb22-b180-4706-8440-4431e206196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:38.577808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bbb22-b180-4706-8440-4431e206196b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:38.578344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bbb22-b180-4706-8440-4431e206196b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:38.578908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bbb22-b180-4706-8440-4431e206196b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:38.580083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bbb22-b180-4706-8440-4431e206196b None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=2a328efd184f4988bb033c83c3321991) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:38.580610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bbb22-b180-4706-8440-4431e206196b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:38.582522 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bbb22-b180-4706-8440-4431e206196b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:38.590166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 425/859] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:38 2022] GET /identity/v3/role_assignments?user.id=2a328efd184f4988bb033c83c3321991&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:38.675865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb93a15-a893-4c73-a8e5-51d49260d869 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:38.676199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb93a15-a893-4c73-a8e5-51d49260d869 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:38.676369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb93a15-a893-4c73-a8e5-51d49260d869 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:38.677891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 435/860] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 15:12:38.678045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 426/861] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:12:38.683945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a1b14-a0dd-48df-ac48-fb7b5cda6fa1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:38.684134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb93a15-a893-4c73-a8e5-51d49260d869 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:38.684340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a1b14-a0dd-48df-ac48-fb7b5cda6fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:38.684585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a1b14-a0dd-48df-ac48-fb7b5cda6fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:38.703066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4b7a1b14-a0dd-48df-ac48-fb7b5cda6fa1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:38.705172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4b7a1b14-a0dd-48df-ac48-fb7b5cda6fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:38.801315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 436/862] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:38.816597 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:38.824346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a1b14-a0dd-48df-ac48-fb7b5cda6fa1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:38.868811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb93a15-a893-4c73-a8e5-51d49260d869 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:38.897768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:38.927656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edef691-a954-44ae-94ea-2da1e796d7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:38.928775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edef691-a954-44ae-94ea-2da1e796d7de None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:38.929236 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edef691-a954-44ae-94ea-2da1e796d7de None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:38.929718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edef691-a954-44ae-94ea-2da1e796d7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:38.948935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edef691-a954-44ae-94ea-2da1e796d7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:38.951418 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edef691-a954-44ae-94ea-2da1e796d7de None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1edef691-a954-44ae-94ea-2da1e796d7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:38.971671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:38.972809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:38.973948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:38.973948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:38.973948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:38.973948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:38.974343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 427/863] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:38.982825 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edef691-a954-44ae-94ea-2da1e796d7de None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:39.014063 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a1b14-a0dd-48df-ac48-fb7b5cda6fa1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:39.069357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4709a29-b21b-4f58-a915-b456cb521b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:39.070239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4709a29-b21b-4f58-a915-b456cb521b62 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:39.070515 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4709a29-b21b-4f58-a915-b456cb521b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:39.070793 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4709a29-b21b-4f58-a915-b456cb521b62 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:39.071497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4709a29-b21b-4f58-a915-b456cb521b62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:39.072941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4709a29-b21b-4f58-a915-b456cb521b62 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-f4709a29-b21b-4f58-a915-b456cb521b62 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:39.095675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:39.096713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:12:39.097610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:39.098414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 437/864] 10.222.0.64 () {56 vars in 1132 bytes} [Fri Jul 15 15:12:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:39.105774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4709a29-b21b-4f58-a915-b456cb521b62 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:39.154245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edef691-a954-44ae-94ea-2da1e796d7de None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:39.202500 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:39.223106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd87c-adbf-4689-8fc1-9dcd9d143d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:39.224497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd87c-adbf-4689-8fc1-9dcd9d143d67 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:39.225174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd87c-adbf-4689-8fc1-9dcd9d143d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:39.225778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd87c-adbf-4689-8fc1-9dcd9d143d67 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:39.227243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fd87c-adbf-4689-8fc1-9dcd9d143d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:39.227936 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fd87c-adbf-4689-8fc1-9dcd9d143d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:39.230822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fd87c-adbf-4689-8fc1-9dcd9d143d67 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:39.253378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 428/865] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:39.255720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd87c-adbf-4689-8fc1-9dcd9d143d67 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:39.270011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:39.276050 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4709a29-b21b-4f58-a915-b456cb521b62 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:39.324103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406676e7-dd75-478e-bcf4-ea4637856af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:39.325213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406676e7-dd75-478e-bcf4-ea4637856af3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:39.325702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406676e7-dd75-478e-bcf4-ea4637856af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:39.326203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406676e7-dd75-478e-bcf4-ea4637856af3 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:39.327453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406676e7-dd75-478e-bcf4-ea4637856af3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:39.327943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406676e7-dd75-478e-bcf4-ea4637856af3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:39.331120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406676e7-dd75-478e-bcf4-ea4637856af3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:39.339427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 438/866] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Jul 15 15:12:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:39.347647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406676e7-dd75-478e-bcf4-ea4637856af3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:39.415901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd87c-adbf-4689-8fc1-9dcd9d143d67 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:39.485373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670f14f-23b8-4f00-92a9-68d82210a301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:39.486085 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670f14f-23b8-4f00-92a9-68d82210a301 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:39.486366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670f14f-23b8-4f00-92a9-68d82210a301 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:39.486640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670f14f-23b8-4f00-92a9-68d82210a301 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:39.493581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406676e7-dd75-478e-bcf4-ea4637856af3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:39.494916 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670f14f-23b8-4f00-92a9-68d82210a301 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:39.496514 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670f14f-23b8-4f00-92a9-68d82210a301 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-0670f14f-23b8-4f00-92a9-68d82210a301 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:39.512488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:39.514474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:39.516959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:39.516959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:39.516959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:39.516959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:39.516959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:39.516959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:39.516959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:39.516959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:39.516959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 429/867] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:39.521035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670f14f-23b8-4f00-92a9-68d82210a301 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:39.563009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc9a08-f256-4fb2-ae8f-deb6780af4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:39.564645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc9a08-f256-4fb2-ae8f-deb6780af4ca None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:39.565490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc9a08-f256-4fb2-ae8f-deb6780af4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:39.566156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc9a08-f256-4fb2-ae8f-deb6780af4ca None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:39.567627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc9a08-f256-4fb2-ae8f-deb6780af4ca None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:39.568354 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc9a08-f256-4fb2-ae8f-deb6780af4ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:39.570933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc9a08-f256-4fb2-ae8f-deb6780af4ca None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:39.581415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:39.582973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 439/868] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Jul 15 15:12:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:39.686312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670f14f-23b8-4f00-92a9-68d82210a301 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:39.727800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aef6d-1d0f-494f-97f7-0055eed26a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:39.728490 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aef6d-1d0f-494f-97f7-0055eed26a83 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:39.728772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aef6d-1d0f-494f-97f7-0055eed26a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:39.729052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aef6d-1d0f-494f-97f7-0055eed26a83 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:39.729908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aef6d-1d0f-494f-97f7-0055eed26a83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:39.730228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aef6d-1d0f-494f-97f7-0055eed26a83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:39.731780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aef6d-1d0f-494f-97f7-0055eed26a83 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:39.748292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 430/869] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:39.756087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc9a08-f256-4fb2-ae8f-deb6780af4ca None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:39.797792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:39.846235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040706e-99b3-417d-9d3f-c62b388ebaf7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:39.846650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040706e-99b3-417d-9d3f-c62b388ebaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:39.846938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040706e-99b3-417d-9d3f-c62b388ebaf7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:39.848796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 431/870] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:12:39.854483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4a0a-c9d0-4f1b-a11d-c19fc527cb02 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:39.854769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4a0a-c9d0-4f1b-a11d-c19fc527cb02 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:39.855053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4a0a-c9d0-4f1b-a11d-c19fc527cb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:39.879415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e69c4a0a-c9d0-4f1b-a11d-c19fc527cb02 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:39.880675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e69c4a0a-c9d0-4f1b-a11d-c19fc527cb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:39.899390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc9a08-f256-4fb2-ae8f-deb6780af4ca None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:39.956487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a48ec-22e5-44a2-8656-af5621031f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:39.957315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a48ec-22e5-44a2-8656-af5621031f1b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:39.957667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a48ec-22e5-44a2-8656-af5621031f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:39.957948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a48ec-22e5-44a2-8656-af5621031f1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:39.958726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a48ec-22e5-44a2-8656-af5621031f1b None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=04f3a308ee69455287ac460d9ab2aef0) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:39.959041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a48ec-22e5-44a2-8656-af5621031f1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:39.960587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a48ec-22e5-44a2-8656-af5621031f1b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:39.970422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 440/871] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:39 2022] GET /identity/v3/role_assignments?user.id=04f3a308ee69455287ac460d9ab2aef0&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=87593f63c4744eac870c07b006022e77 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:40.004847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 432/872] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:40.032830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a48ec-22e5-44a2-8656-af5621031f1b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:40.170231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:40.180817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a48ec-22e5-44a2-8656-af5621031f1b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:40.228292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94a1b7-b2e1-44ea-81be-9774a46b673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:40.228990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94a1b7-b2e1-44ea-81be-9774a46b673d None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:40.229312 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94a1b7-b2e1-44ea-81be-9774a46b673d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:40.229596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94a1b7-b2e1-44ea-81be-9774a46b673d None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:40.230350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94a1b7-b2e1-44ea-81be-9774a46b673d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:40.231756 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94a1b7-b2e1-44ea-81be-9774a46b673d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:40.253643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 441/873] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:12:40 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:12:41.178273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93cce0-c7b0-4956-a573-88d01f5c0aa8 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:41.178808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93cce0-c7b0-4956-a573-88d01f5c0aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:41.178808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93cce0-c7b0-4956-a573-88d01f5c0aa8 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:41.180682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 433/874] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:41.186358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9c2c0-d5b1-4fa3-a2c6-b2d19c021a83 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:41.186878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9c2c0-d5b1-4fa3-a2c6-b2d19c021a83 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:41.187041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9c2c0-d5b1-4fa3-a2c6-b2d19c021a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:41.206142 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-cda9c2c0-d5b1-4fa3-a2c6-b2d19c021a83 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:41.207374 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cda9c2c0-d5b1-4fa3-a2c6-b2d19c021a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:41.296438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 442/875] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:41.319840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93cce0-c7b0-4956-a573-88d01f5c0aa8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:41.363065 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:41.435526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93cce0-c7b0-4956-a573-88d01f5c0aa8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:41.472359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33811af2-3294-48b6-a98f-f95c1b11dc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:41.473227 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33811af2-3294-48b6-a98f-f95c1b11dc77 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:41.473513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33811af2-3294-48b6-a98f-f95c1b11dc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:41.473791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33811af2-3294-48b6-a98f-f95c1b11dc77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:41.486459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33811af2-3294-48b6-a98f-f95c1b11dc77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-33811af2-3294-48b6-a98f-f95c1b11dc77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:41.495167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:41.496486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:41.497853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:41.497853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:41.497853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:41.497853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:41.497853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:41.497853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:41.497853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:41.497853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:41.497853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:41.497853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:41.497853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 15:12:41.497853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:41.501187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 434/876] 10.222.0.64 () {56 vars in 1120 bytes} [Fri Jul 15 15:12:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:41.504102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9c2c0-d5b1-4fa3-a2c6-b2d19c021a83 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:41.610640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:41.641614 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9c2c0-d5b1-4fa3-a2c6-b2d19c021a83 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:41.680174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2699ff-bcc0-4259-ae41-347f4be3cbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:41.680868 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2699ff-bcc0-4259-ae41-347f4be3cbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:41.681181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2699ff-bcc0-4259-ae41-347f4be3cbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:41.681466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2699ff-bcc0-4259-ae41-347f4be3cbd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:41.682239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2699ff-bcc0-4259-ae41-347f4be3cbd9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:41.682546 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2699ff-bcc0-4259-ae41-347f4be3cbd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:41.683954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2699ff-bcc0-4259-ae41-347f4be3cbd9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:41.694635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 443/877] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Jul 15 15:12:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:41.702519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33811af2-3294-48b6-a98f-f95c1b11dc77 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:41.805239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:41.813175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33811af2-3294-48b6-a98f-f95c1b11dc77 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:41.864291 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213825bc-c659-46c8-9231-4c30c005c1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:41.865132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213825bc-c659-46c8-9231-4c30c005c1ed None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:41.865448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213825bc-c659-46c8-9231-4c30c005c1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:41.865730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213825bc-c659-46c8-9231-4c30c005c1ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:41.877609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213825bc-c659-46c8-9231-4c30c005c1ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:41.879448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213825bc-c659-46c8-9231-4c30c005c1ed None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-213825bc-c659-46c8-9231-4c30c005c1ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:41.897934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:41.898888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:41.899789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:41.899789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:41.899789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:41.899789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:41.900472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 435/878] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:41.906698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2699ff-bcc0-4259-ae41-347f4be3cbd9 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:42.018584 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2699ff-bcc0-4259-ae41-347f4be3cbd9 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:42.055573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069412f-8911-401f-a066-cacad68de00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:42.056252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069412f-8911-401f-a066-cacad68de00a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:42.056538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069412f-8911-401f-a066-cacad68de00a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:42.056815 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069412f-8911-401f-a066-cacad68de00a None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:42.057574 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069412f-8911-401f-a066-cacad68de00a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:42.057883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069412f-8911-401f-a066-cacad68de00a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:42.059279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069412f-8911-401f-a066-cacad68de00a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:42.068973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:42.073582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 444/879] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:42.082148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213825bc-c659-46c8-9231-4c30c005c1ed None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:42.200159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213825bc-c659-46c8-9231-4c30c005c1ed None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:42.217780 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a87d5-e329-482c-9b9b-551b2dad3639 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:42.218473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a87d5-e329-482c-9b9b-551b2dad3639 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:42.218473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a87d5-e329-482c-9b9b-551b2dad3639 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:42.221223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 445/880] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:12:42.225879 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeb092-42fe-4604-986f-470ad9cb0c0b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:42.226172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeb092-42fe-4604-986f-470ad9cb0c0b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:42.226455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeb092-42fe-4604-986f-470ad9cb0c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:42.249690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-deeeb092-42fe-4604-986f-470ad9cb0c0b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:42.251044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-deeeb092-42fe-4604-986f-470ad9cb0c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:42.256482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d00ac3-2f0c-4e9a-af00-c430fdb5c877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:42.257814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d00ac3-2f0c-4e9a-af00-c430fdb5c877 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:42.258345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d00ac3-2f0c-4e9a-af00-c430fdb5c877 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:42.258937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d00ac3-2f0c-4e9a-af00-c430fdb5c877 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:42.269988 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d00ac3-2f0c-4e9a-af00-c430fdb5c877 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:42.271928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d00ac3-2f0c-4e9a-af00-c430fdb5c877 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-38d00ac3-2f0c-4e9a-af00-c430fdb5c877 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:42.297125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:42.298794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:42.300362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:42.300362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:42.300362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:42.300362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:42.300362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:42.300362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:42.300362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:42.300362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:42.300362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 15:12:42.300362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:42.306038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 436/881] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Jul 15 15:12:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:42.313671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d00ac3-2f0c-4e9a-af00-c430fdb5c877 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:42.332212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:42.353373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 446/882] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:12:42.373376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeb092-42fe-4604-986f-470ad9cb0c0b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:42.459950 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d00ac3-2f0c-4e9a-af00-c430fdb5c877 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:42.506772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71a0d5-ca7f-4ed0-aebd-158b72fbb167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:42.507468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71a0d5-ca7f-4ed0-aebd-158b72fbb167 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:42.507753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71a0d5-ca7f-4ed0-aebd-158b72fbb167 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:42.508033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71a0d5-ca7f-4ed0-aebd-158b72fbb167 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:42.508322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeb092-42fe-4604-986f-470ad9cb0c0b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:42.508979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71a0d5-ca7f-4ed0-aebd-158b72fbb167 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:42.509318 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71a0d5-ca7f-4ed0-aebd-158b72fbb167 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:42.510803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71a0d5-ca7f-4ed0-aebd-158b72fbb167 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:42.533861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 437/883] 10.222.0.64 () {56 vars in 1149 bytes} [Fri Jul 15 15:12:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:42.535131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4bbe3-e12c-4cde-ae12-9909ba29afc9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:42.535421 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4bbe3-e12c-4cde-ae12-9909ba29afc9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:42.535698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4bbe3-e12c-4cde-ae12-9909ba29afc9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:42.541276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 438/884] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:42.543538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f613ca9-803c-4480-a2d6-8f74b7d16d84 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:42.544044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f613ca9-803c-4480-a2d6-8f74b7d16d84 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:42.544526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f613ca9-803c-4480-a2d6-8f74b7d16d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:42.555845 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:42.565805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4f613ca9-803c-4480-a2d6-8f74b7d16d84 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:42.566163 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a07a4-71e7-419f-a632-d2a064a69c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:42.566825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a07a4-71e7-419f-a632-d2a064a69c40 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:42.567672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a07a4-71e7-419f-a632-d2a064a69c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:42.567857 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4f613ca9-803c-4480-a2d6-8f74b7d16d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:42.567997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a07a4-71e7-419f-a632-d2a064a69c40 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:42.569028 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a07a4-71e7-419f-a632-d2a064a69c40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:42.571376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a07a4-71e7-419f-a632-d2a064a69c40 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:42.588760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 447/885] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:12:42 2022] POST /identity/v3/services => generated 269 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:12:42.589649 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a07a4-71e7-419f-a632-d2a064a69c40 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:42.662400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:42.684424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 439/886] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:42.687083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771be353-40c7-403d-a431-02bb63e9420c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:42.688375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771be353-40c7-403d-a431-02bb63e9420c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:42.689186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771be353-40c7-403d-a431-02bb63e9420c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:42.699017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 440/887] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:42.714277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc941ab-48f8-4327-a1b8-8489159c7737 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:42.714696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc941ab-48f8-4327-a1b8-8489159c7737 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:42.714925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc941ab-48f8-4327-a1b8-8489159c7737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:42.738768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5dc941ab-48f8-4327-a1b8-8489159c7737 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:42.740618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5dc941ab-48f8-4327-a1b8-8489159c7737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:42.779099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a07a4-71e7-419f-a632-d2a064a69c40 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:42.847566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5a032-d3f2-486d-9af3-4385d47d0be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:42.848885 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5a032-d3f2-486d-9af3-4385d47d0be2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:42.849940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5a032-d3f2-486d-9af3-4385d47d0be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:42.850828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5a032-d3f2-486d-9af3-4385d47d0be2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:42.867110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 441/888] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:42.873097 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc941ab-48f8-4327-a1b8-8489159c7737 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:42.959731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:42.979797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5a032-d3f2-486d-9af3-4385d47d0be2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:42.982410 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5a032-d3f2-486d-9af3-4385d47d0be2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:43.049995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc941ab-48f8-4327-a1b8-8489159c7737 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:43.089658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:43.111998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d47d2d-d31d-450c-b40f-320d313631e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:43.116313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d47d2d-d31d-450c-b40f-320d313631e3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:43.116313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d47d2d-d31d-450c-b40f-320d313631e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:43.116313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d47d2d-d31d-450c-b40f-320d313631e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:43.116313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d47d2d-d31d-450c-b40f-320d313631e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:43.116820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d47d2d-d31d-450c-b40f-320d313631e3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-11d47d2d-d31d-450c-b40f-320d313631e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:43.132912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:43.136859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:43.140903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 442/889] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Jul 15 15:12:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:43.143410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d47d2d-d31d-450c-b40f-320d313631e3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:43.168468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 448/890] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:42 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:12:43.168468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5a032-d3f2-486d-9af3-4385d47d0be2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:43.275136 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d47d2d-d31d-450c-b40f-320d313631e3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:43.287966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:43.304975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5a032-d3f2-486d-9af3-4385d47d0be2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:43.329154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61113a29-247d-494d-b7c6-37f2917782ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:43.330434 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61113a29-247d-494d-b7c6-37f2917782ae None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:43.330875 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61113a29-247d-494d-b7c6-37f2917782ae None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:43.331382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61113a29-247d-494d-b7c6-37f2917782ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:43.332835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61113a29-247d-494d-b7c6-37f2917782ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:43.335096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61113a29-247d-494d-b7c6-37f2917782ae None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:43.347871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4012a7-8b9e-461a-ba00-9497cf2e88da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:43.348557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4012a7-8b9e-461a-ba00-9497cf2e88da None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:43.348846 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4012a7-8b9e-461a-ba00-9497cf2e88da None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:43.349245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4012a7-8b9e-461a-ba00-9497cf2e88da None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:43.350433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4012a7-8b9e-461a-ba00-9497cf2e88da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:43.350947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4012a7-8b9e-461a-ba00-9497cf2e88da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-61113a29-247d-494d-b7c6-37f2917782ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:43.351495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:43.352645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:12:43.353711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:43.354640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4012a7-8b9e-461a-ba00-9497cf2e88da None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:43.357043 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 443/891] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:12:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:43.358246 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61113a29-247d-494d-b7c6-37f2917782ae None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:43.361651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 449/892] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Jul 15 15:12:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:43.373800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4012a7-8b9e-461a-ba00-9497cf2e88da None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:43.436408 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:43.513872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61113a29-247d-494d-b7c6-37f2917782ae None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:43.530048 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4012a7-8b9e-461a-ba00-9497cf2e88da None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:43.565666 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e57f2-a35f-4706-8f48-1f986e898d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:43.566568 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e57f2-a35f-4706-8f48-1f986e898d16 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:43.566874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e57f2-a35f-4706-8f48-1f986e898d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:43.567126 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e57f2-a35f-4706-8f48-1f986e898d16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:43.571359 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d290b-a579-470d-98c2-1a3292642621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:43.572048 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d290b-a579-470d-98c2-1a3292642621 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:43.572336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d290b-a579-470d-98c2-1a3292642621 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:43.572609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d290b-a579-470d-98c2-1a3292642621 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:43.573355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d290b-a579-470d-98c2-1a3292642621 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:43.573690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d290b-a579-470d-98c2-1a3292642621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:43.575093 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d290b-a579-470d-98c2-1a3292642621 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:43.580669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e57f2-a35f-4706-8f48-1f986e898d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:43.589621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e57f2-a35f-4706-8f48-1f986e898d16 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:43.589932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 450/893] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Jul 15 15:12:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:43.589932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d290b-a579-470d-98c2-1a3292642621 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-6c8e57f2-a35f-4706-8f48-1f986e898d16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:43.615861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:43.617198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:43.618362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:43.618362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:43.618362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:43.618362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:43.618362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 444/894] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:43.623647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:43.624609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e57f2-a35f-4706-8f48-1f986e898d16 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:43.743943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d290b-a579-470d-98c2-1a3292642621 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:43.771344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e57f2-a35f-4706-8f48-1f986e898d16 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:43.773461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:43.803274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbffdf8-bf44-4f82-9175-19c418e48188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:43.804806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbffdf8-bf44-4f82-9175-19c418e48188 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:43.805349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbffdf8-bf44-4f82-9175-19c418e48188 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:43.805921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbffdf8-bf44-4f82-9175-19c418e48188 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:43.807335 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbffdf8-bf44-4f82-9175-19c418e48188 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:43.807693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbffdf8-bf44-4f82-9175-19c418e48188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:43.810538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbffdf8-bf44-4f82-9175-19c418e48188 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:43.821247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 451/895] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:12:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:43.823531 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbffdf8-bf44-4f82-9175-19c418e48188 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:43.826103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563de13-bc87-4523-9c2d-aeb243a9235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:43.826813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563de13-bc87-4523-9c2d-aeb243a9235f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:43.827166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563de13-bc87-4523-9c2d-aeb243a9235f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:43.827454 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563de13-bc87-4523-9c2d-aeb243a9235f None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:43.828760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563de13-bc87-4523-9c2d-aeb243a9235f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:43.829103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563de13-bc87-4523-9c2d-aeb243a9235f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:43.830805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563de13-bc87-4523-9c2d-aeb243a9235f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:43.848611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 445/896] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:43.857736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563de13-bc87-4523-9c2d-aeb243a9235f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:43.977587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:43.987663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbffdf8-bf44-4f82-9175-19c418e48188 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:44.017850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563de13-bc87-4523-9c2d-aeb243a9235f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:44.045358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e015285-4b9b-44c5-88e4-7b3a61b5ce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:44.047426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e015285-4b9b-44c5-88e4-7b3a61b5ce8c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:44.048180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e015285-4b9b-44c5-88e4-7b3a61b5ce8c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:44.049040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e015285-4b9b-44c5-88e4-7b3a61b5ce8c None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:44.050694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e015285-4b9b-44c5-88e4-7b3a61b5ce8c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:44.051552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e015285-4b9b-44c5-88e4-7b3a61b5ce8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:44.055041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e015285-4b9b-44c5-88e4-7b3a61b5ce8c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:44.059199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee7858-7ccb-4d5b-a88b-8dc6bd2862a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:44.060026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee7858-7ccb-4d5b-a88b-8dc6bd2862a5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:44.060355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee7858-7ccb-4d5b-a88b-8dc6bd2862a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:44.060611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee7858-7ccb-4d5b-a88b-8dc6bd2862a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:44.073453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 452/897] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:12:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:44.073710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee7858-7ccb-4d5b-a88b-8dc6bd2862a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:44.076354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee7858-7ccb-4d5b-a88b-8dc6bd2862a5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:44.078502 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e015285-4b9b-44c5-88e4-7b3a61b5ce8c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d3ee7858-7ccb-4d5b-a88b-8dc6bd2862a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:44.105403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:44.106532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:44.107593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:44.107593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:44.107593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:44.107593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:44.107593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:44.107593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:44.107593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:44.107593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:44.116541 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 446/898] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:44.119151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee7858-7ccb-4d5b-a88b-8dc6bd2862a5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:44.158436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:44.227927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e015285-4b9b-44c5-88e4-7b3a61b5ce8c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:44.273799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee7858-7ccb-4d5b-a88b-8dc6bd2862a5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:44.277825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd52e2-be14-43aa-88b3-f9e03f554171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:44.278654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd52e2-be14-43aa-88b3-f9e03f554171 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:44.279055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd52e2-be14-43aa-88b3-f9e03f554171 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:44.279449 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd52e2-be14-43aa-88b3-f9e03f554171 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:44.280404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd52e2-be14-43aa-88b3-f9e03f554171 None admin] RBAC: Adding query filter params (interface=public, service_id=23ccbc9ee61c479dafdcd5ca3fb4c0dd, region_id=RegionOne) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:44.280832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd52e2-be14-43aa-88b3-f9e03f554171 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:44.283648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd52e2-be14-43aa-88b3-f9e03f554171 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:44.292747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 453/899] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Jul 15 15:12:44 2022] GET /identity/v3/endpoints?service_id=23ccbc9ee61c479dafdcd5ca3fb4c0dd&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:44.300037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd52e2-be14-43aa-88b3-f9e03f554171 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:44.313726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:44.327728 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab18eb3-0e43-4a08-8412-9e51710dc858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:44.328871 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab18eb3-0e43-4a08-8412-9e51710dc858 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:44.329455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab18eb3-0e43-4a08-8412-9e51710dc858 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:44.329958 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab18eb3-0e43-4a08-8412-9e51710dc858 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:44.331305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab18eb3-0e43-4a08-8412-9e51710dc858 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:44.331810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab18eb3-0e43-4a08-8412-9e51710dc858 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:44.334391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab18eb3-0e43-4a08-8412-9e51710dc858 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:44.355665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 447/900] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:44.357202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab18eb3-0e43-4a08-8412-9e51710dc858 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:44.429798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd52e2-be14-43aa-88b3-f9e03f554171 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:44.457185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:44.470946 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bfc3e-a3ac-41b0-92e6-5ea9a4f38833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:44.472025 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bfc3e-a3ac-41b0-92e6-5ea9a4f38833 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:44.472523 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bfc3e-a3ac-41b0-92e6-5ea9a4f38833 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:44.473033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bfc3e-a3ac-41b0-92e6-5ea9a4f38833 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:44.473986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bfc3e-a3ac-41b0-92e6-5ea9a4f38833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:44.475673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bfc3e-a3ac-41b0-92e6-5ea9a4f38833 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:44.487332 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab18eb3-0e43-4a08-8412-9e51710dc858 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:44.488025 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 454/901] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Jul 15 15:12:44 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:12:44.534858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c38f0-c0d9-4f2c-a8a8-bd782dc87af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:44.535544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c38f0-c0d9-4f2c-a8a8-bd782dc87af9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:44.535828 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c38f0-c0d9-4f2c-a8a8-bd782dc87af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:44.536104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c38f0-c0d9-4f2c-a8a8-bd782dc87af9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:44.536973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c38f0-c0d9-4f2c-a8a8-bd782dc87af9 None admin] RBAC: Adding query filter params (role.id=2f29372d0ad04535b7a8688fc0209d85, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=2a328efd184f4988bb033c83c3321991) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:44.537327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c38f0-c0d9-4f2c-a8a8-bd782dc87af9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:44.538839 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c38f0-c0d9-4f2c-a8a8-bd782dc87af9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:44.546228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 448/902] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:44 2022] GET /identity/v3/role_assignments?user.id=2a328efd184f4988bb033c83c3321991&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=2f29372d0ad04535b7a8688fc0209d85 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:44.891511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9acd8-0b34-461b-a56f-87656e1aeac4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:44.892223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9acd8-0b34-461b-a56f-87656e1aeac4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:44.892766 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9acd8-0b34-461b-a56f-87656e1aeac4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:44.895789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 455/903] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:44.904169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0625f60-0b7c-44c2-ac9d-822054e2da0b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:44.904648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0625f60-0b7c-44c2-ac9d-822054e2da0b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:44.905160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0625f60-0b7c-44c2-ac9d-822054e2da0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:44.934417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e0625f60-0b7c-44c2-ac9d-822054e2da0b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:44.936445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e0625f60-0b7c-44c2-ac9d-822054e2da0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:45.029194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 449/904] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:12:45.049329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9acd8-0b34-461b-a56f-87656e1aeac4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:45.148974 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:45.181415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9acd8-0b34-461b-a56f-87656e1aeac4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:45.221608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab20edc-8f63-404c-b6f1-b1357990c4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:45.222434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20edc-8f63-404c-b6f1-b1357990c4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:45.222765 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20edc-8f63-404c-b6f1-b1357990c4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:45.223048 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20edc-8f63-404c-b6f1-b1357990c4a4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:45.223715 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab20edc-8f63-404c-b6f1-b1357990c4a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:45.225142 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab20edc-8f63-404c-b6f1-b1357990c4a4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-bab20edc-8f63-404c-b6f1-b1357990c4a4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:45.239051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:45.240058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:12:45.240888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:45.245110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 456/905] 10.222.0.64 () {56 vars in 1132 bytes} [Fri Jul 15 15:12:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:45.246825 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0625f60-0b7c-44c2-ac9d-822054e2da0b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:45.339208 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:45.372097 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0625f60-0b7c-44c2-ac9d-822054e2da0b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:45.410479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6ff37-f876-4bae-83aa-09ae2d5510a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:45.411081 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6ff37-f876-4bae-83aa-09ae2d5510a4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:45.411362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6ff37-f876-4bae-83aa-09ae2d5510a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:45.411637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6ff37-f876-4bae-83aa-09ae2d5510a4 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:45.412397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6ff37-f876-4bae-83aa-09ae2d5510a4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:45.413250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6ff37-f876-4bae-83aa-09ae2d5510a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:45.414688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6ff37-f876-4bae-83aa-09ae2d5510a4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:45.422004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 450/906] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Jul 15 15:12:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:45.427968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab20edc-8f63-404c-b6f1-b1357990c4a4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:45.539454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab20edc-8f63-404c-b6f1-b1357990c4a4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:45.576174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9624641-4530-413c-bba9-7e90e9055475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:45.576861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624641-4530-413c-bba9-7e90e9055475 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:45.577176 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624641-4530-413c-bba9-7e90e9055475 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:45.577460 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624641-4530-413c-bba9-7e90e9055475 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:45.578231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9624641-4530-413c-bba9-7e90e9055475 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:45.578542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9624641-4530-413c-bba9-7e90e9055475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:45.579936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9624641-4530-413c-bba9-7e90e9055475 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:45.589209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 457/907] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Jul 15 15:12:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:45.595147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6ff37-f876-4bae-83aa-09ae2d5510a4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:45.754360 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6ff37-f876-4bae-83aa-09ae2d5510a4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:45.811132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7342c5-453b-4c8a-8341-e1ff484bca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:45.811892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7342c5-453b-4c8a-8341-e1ff484bca57 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:45.812221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7342c5-453b-4c8a-8341-e1ff484bca57 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:45.812501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7342c5-453b-4c8a-8341-e1ff484bca57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:45.813476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7342c5-453b-4c8a-8341-e1ff484bca57 None admin] RBAC: Adding query filter params (interface=public, service_id=001481e6382f4116a948a69e54544a76, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:45.813791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7342c5-453b-4c8a-8341-e1ff484bca57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:45.815233 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7342c5-453b-4c8a-8341-e1ff484bca57 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:45.824512 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 451/908] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Jul 15 15:12:45 2022] GET /identity/v3/endpoints?service_id=001481e6382f4116a948a69e54544a76&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:45.830916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9624641-4530-413c-bba9-7e90e9055475 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:45.834463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:45.964764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf99f-dff2-4820-9e4b-b6fad3d148d5 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:45.965279 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf99f-dff2-4820-9e4b-b6fad3d148d5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:45.965756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf99f-dff2-4820-9e4b-b6fad3d148d5 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:45.968573 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 452/909] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:45.971270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9624641-4530-413c-bba9-7e90e9055475 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:45.976221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1db39c-5db9-4975-82af-443a08373f62 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:45.976739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1db39c-5db9-4975-82af-443a08373f62 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:45.977202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1db39c-5db9-4975-82af-443a08373f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:45.987102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:46.008083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-dc1db39c-5db9-4975-82af-443a08373f62 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:46.010669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dc1db39c-5db9-4975-82af-443a08373f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:46.033472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea85d64-eed6-4ff3-81bc-a3a27ffc328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:46.034539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea85d64-eed6-4ff3-81bc-a3a27ffc328f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:46.035024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea85d64-eed6-4ff3-81bc-a3a27ffc328f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:46.035503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea85d64-eed6-4ff3-81bc-a3a27ffc328f None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:46.036741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea85d64-eed6-4ff3-81bc-a3a27ffc328f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:46.039206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea85d64-eed6-4ff3-81bc-a3a27ffc328f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:46.050355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 458/910] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Jul 15 15:12:45 2022] GET /identity/v3/services => generated 1268 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:12:46.108955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 453/911] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:46.131850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea85d64-eed6-4ff3-81bc-a3a27ffc328f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:46.231989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:46.271786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea85d64-eed6-4ff3-81bc-a3a27ffc328f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:46.309150 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740467b-5cf3-4190-a320-1438b95ab978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:46.309837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740467b-5cf3-4190-a320-1438b95ab978 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:46.310125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740467b-5cf3-4190-a320-1438b95ab978 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:46.310405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740467b-5cf3-4190-a320-1438b95ab978 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:46.311153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740467b-5cf3-4190-a320-1438b95ab978 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:46.313155 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740467b-5cf3-4190-a320-1438b95ab978 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:46.331409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 459/912] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:12:46 2022] POST /identity/v3/services => generated 241 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:12:46.740675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbdcd5-6aa0-417b-84f4-bb94cdcef6aa None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:46.741458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbdcd5-6aa0-417b-84f4-bb94cdcef6aa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:46.741458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbdcd5-6aa0-417b-84f4-bb94cdcef6aa None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:46.742930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 454/913] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:46.748325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13398102-9a8e-47d7-bf81-b9ca69360a45 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:46.749052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13398102-9a8e-47d7-bf81-b9ca69360a45 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:46.749052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13398102-9a8e-47d7-bf81-b9ca69360a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:46.768905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-13398102-9a8e-47d7-bf81-b9ca69360a45 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:46.770176 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-13398102-9a8e-47d7-bf81-b9ca69360a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:46.875437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 460/914] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:46.904397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbdcd5-6aa0-417b-84f4-bb94cdcef6aa None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:47.024453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667f1ff-1a2d-4f18-8d0f-ce13b06d4b12 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:47.024877 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667f1ff-1a2d-4f18-8d0f-ce13b06d4b12 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:47.025052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667f1ff-1a2d-4f18-8d0f-ce13b06d4b12 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:47.027923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 461/915] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:47.033301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbdcd5-6aa0-417b-84f4-bb94cdcef6aa None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:47.034622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663fa8-ab6a-4acf-a520-b5184891f451 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:47.035092 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663fa8-ab6a-4acf-a520-b5184891f451 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:47.035385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663fa8-ab6a-4acf-a520-b5184891f451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:47.059824 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a8663fa8-ab6a-4acf-a520-b5184891f451 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:47.061738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a8663fa8-ab6a-4acf-a520-b5184891f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:47.077229 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb26e53-e687-44d7-8e71-cd9e5344d6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:47.078993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb26e53-e687-44d7-8e71-cd9e5344d6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:47.079441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb26e53-e687-44d7-8e71-cd9e5344d6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:47.079864 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb26e53-e687-44d7-8e71-cd9e5344d6b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:47.083142 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:47.094347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb26e53-e687-44d7-8e71-cd9e5344d6b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9bb26e53-e687-44d7-8e71-cd9e5344d6b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:47.107619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:47.109010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:47.110091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:47.110091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:47.110091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:47.110091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:47.110091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:47.110091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:47.110091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:47.110091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:47.110091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:47.110091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:47.110091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 15:12:47.110091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:47.112441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 455/916] 10.222.0.64 () {56 vars in 1120 bytes} [Fri Jul 15 15:12:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:47.119888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb26e53-e687-44d7-8e71-cd9e5344d6b2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:47.152288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:47.193527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 462/917] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:47.213555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8663fa8-ab6a-4acf-a520-b5184891f451 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:47.291000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb26e53-e687-44d7-8e71-cd9e5344d6b2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:47.348262 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef47024-0511-42da-b109-1c54cc94a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:47.349583 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef47024-0511-42da-b109-1c54cc94a974 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:47.350080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef47024-0511-42da-b109-1c54cc94a974 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:47.350542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef47024-0511-42da-b109-1c54cc94a974 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:47.351762 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef47024-0511-42da-b109-1c54cc94a974 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:47.352251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef47024-0511-42da-b109-1c54cc94a974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:47.353674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8663fa8-ab6a-4acf-a520-b5184891f451 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:47.354562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef47024-0511-42da-b109-1c54cc94a974 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:47.377120 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 456/918] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Jul 15 15:12:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:47.382100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef47024-0511-42da-b109-1c54cc94a974 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:47.411011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeccdb0-0050-4b12-b96e-bec7a8d07420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:47.412214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeccdb0-0050-4b12-b96e-bec7a8d07420 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:47.412763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeccdb0-0050-4b12-b96e-bec7a8d07420 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:47.413288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeccdb0-0050-4b12-b96e-bec7a8d07420 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:47.414241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeccdb0-0050-4b12-b96e-bec7a8d07420 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:47.415933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeccdb0-0050-4b12-b96e-bec7a8d07420 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ffeccdb0-0050-4b12-b96e-bec7a8d07420 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:47.430984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:47.432075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:12:47.432905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:47.437113 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 463/919] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:12:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:47.444885 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeccdb0-0050-4b12-b96e-bec7a8d07420 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:47.464433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:47.509404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:47.526557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef47024-0511-42da-b109-1c54cc94a974 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:47.566371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61f0e8-8422-410e-9d8d-56f6043e7be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:47.567346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61f0e8-8422-410e-9d8d-56f6043e7be0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:47.567783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61f0e8-8422-410e-9d8d-56f6043e7be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:47.568245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61f0e8-8422-410e-9d8d-56f6043e7be0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:47.580748 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61f0e8-8422-410e-9d8d-56f6043e7be0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:47.582794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61f0e8-8422-410e-9d8d-56f6043e7be0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:47.585419 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeccdb0-0050-4b12-b96e-bec7a8d07420 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3d61f0e8-8422-410e-9d8d-56f6043e7be0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:47.617551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:47.618544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:47.619467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:47.619467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:47.619467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:47.619467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:47.625241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 457/920] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:47.627181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61f0e8-8422-410e-9d8d-56f6043e7be0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:47.634210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac77ee9-70fe-4dfa-be3c-5ff4bc3a03e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:47.635222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac77ee9-70fe-4dfa-be3c-5ff4bc3a03e6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:47.635845 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac77ee9-70fe-4dfa-be3c-5ff4bc3a03e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:47.636315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac77ee9-70fe-4dfa-be3c-5ff4bc3a03e6 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:47.637340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac77ee9-70fe-4dfa-be3c-5ff4bc3a03e6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:47.637980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac77ee9-70fe-4dfa-be3c-5ff4bc3a03e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:47.640343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac77ee9-70fe-4dfa-be3c-5ff4bc3a03e6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:47.652149 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 464/921] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:12:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:47.653499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac77ee9-70fe-4dfa-be3c-5ff4bc3a03e6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:47.775364 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61f0e8-8422-410e-9d8d-56f6043e7be0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:47.790545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:47.808491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac77ee9-70fe-4dfa-be3c-5ff4bc3a03e6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:47.828390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:47.829156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfae8c-cc66-4ed1-892e-d636adef0c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:47.831966 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfae8c-cc66-4ed1-892e-d636adef0c90 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:47.833700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfae8c-cc66-4ed1-892e-d636adef0c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:47.835051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfae8c-cc66-4ed1-892e-d636adef0c90 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:47.837566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfae8c-cc66-4ed1-892e-d636adef0c90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:47.838297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfae8c-cc66-4ed1-892e-d636adef0c90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:47.840974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfae8c-cc66-4ed1-892e-d636adef0c90 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:47.859328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc104a8-1627-448b-a5c4-e21572460dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:47.860391 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc104a8-1627-448b-a5c4-e21572460dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:47.860904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc104a8-1627-448b-a5c4-e21572460dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:47.861447 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc104a8-1627-448b-a5c4-e21572460dc0 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:47.862383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc104a8-1627-448b-a5c4-e21572460dc0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:47.862907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc104a8-1627-448b-a5c4-e21572460dc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:47.864718 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc104a8-1627-448b-a5c4-e21572460dc0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:47.865007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 458/922] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:47.866516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfae8c-cc66-4ed1-892e-d636adef0c90 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:47.880089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 465/923] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Jul 15 15:12:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:47.881454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc104a8-1627-448b-a5c4-e21572460dc0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:48.019554 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfae8c-cc66-4ed1-892e-d636adef0c90 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:48.045849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc104a8-1627-448b-a5c4-e21572460dc0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:48.064769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea52112-f4a6-4da9-8427-363408da9d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:48.065999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea52112-f4a6-4da9-8427-363408da9d9b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:48.066499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea52112-f4a6-4da9-8427-363408da9d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:48.067008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea52112-f4a6-4da9-8427-363408da9d9b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:48.075394 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea52112-f4a6-4da9-8427-363408da9d9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:48.077307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea52112-f4a6-4da9-8427-363408da9d9b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:48.088613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eba2a4-12e0-481c-b753-4f8c84ec7b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:48.089339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eba2a4-12e0-481c-b753-4f8c84ec7b62 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:48.089631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eba2a4-12e0-481c-b753-4f8c84ec7b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:48.089915 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eba2a4-12e0-481c-b753-4f8c84ec7b62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:48.090688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eba2a4-12e0-481c-b753-4f8c84ec7b62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:48.092091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eba2a4-12e0-481c-b753-4f8c84ec7b62 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-0ea52112-f4a6-4da9-8427-363408da9d9b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:48.097308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:48.098281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:48.099241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:48.099241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:48.099241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:48.099241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:48.099241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:48.099241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:48.099241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:48.099241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:48.099241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 15:12:48.099241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:48.101995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 459/924] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Jul 15 15:12:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:48.109846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea52112-f4a6-4da9-8427-363408da9d9b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:48.133098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 466/925] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Jul 15 15:12:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:12:48.163422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:48.276404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea52112-f4a6-4da9-8427-363408da9d9b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:48.334004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820e4ff-941f-4427-9702-1ea599cc4a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:48.335389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820e4ff-941f-4427-9702-1ea599cc4a3c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:48.335934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820e4ff-941f-4427-9702-1ea599cc4a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:48.336426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820e4ff-941f-4427-9702-1ea599cc4a3c None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:48.337626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820e4ff-941f-4427-9702-1ea599cc4a3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:48.338221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820e4ff-941f-4427-9702-1ea599cc4a3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:48.340048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820e4ff-941f-4427-9702-1ea599cc4a3c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:48.366918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 460/926] 10.222.0.64 () {56 vars in 1149 bytes} [Fri Jul 15 15:12:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:48.375677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eba2a4-12e0-481c-b753-4f8c84ec7b62 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:48.414770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c49b0-3e0f-4086-bdb8-a1cbec5eee38 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:48.415131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c49b0-3e0f-4086-bdb8-a1cbec5eee38 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:48.415498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c49b0-3e0f-4086-bdb8-a1cbec5eee38 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:48.417079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 461/927] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:48.423274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:48.425664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847871a-70d2-4975-9e6e-207571224d98 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:48.426071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847871a-70d2-4975-9e6e-207571224d98 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:48.426908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847871a-70d2-4975-9e6e-207571224d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:48.455327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f847871a-70d2-4975-9e6e-207571224d98 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:48.456552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f847871a-70d2-4975-9e6e-207571224d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:48.531906 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eba2a4-12e0-481c-b753-4f8c84ec7b62 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:48.556788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 462/928] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:12:48.587664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847871a-70d2-4975-9e6e-207571224d98 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:48.589641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e79e21-86a9-41e4-bdf5-92b3c09300bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:48.590767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e79e21-86a9-41e4-bdf5-92b3c09300bb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:48.591102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e79e21-86a9-41e4-bdf5-92b3c09300bb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:48.591512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e79e21-86a9-41e4-bdf5-92b3c09300bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:48.604670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e79e21-86a9-41e4-bdf5-92b3c09300bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:48.606341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e79e21-86a9-41e4-bdf5-92b3c09300bb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:48.618210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-b0e79e21-86a9-41e4-bdf5-92b3c09300bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:48.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:48.631528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:48.632433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:48.632433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:48.632433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:48.632433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:48.634970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 467/929] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:48.641079 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e79e21-86a9-41e4-bdf5-92b3c09300bb None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:48.794873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:48.803121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847871a-70d2-4975-9e6e-207571224d98 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:48.825713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e79e21-86a9-41e4-bdf5-92b3c09300bb None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:48.871151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f376a-ea80-472b-9781-c242396b064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:48.871879 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f376a-ea80-472b-9781-c242396b064d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:48.872170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f376a-ea80-472b-9781-c242396b064d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:48.872448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f376a-ea80-472b-9781-c242396b064d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:48.873151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f376a-ea80-472b-9781-c242396b064d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:48.873967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa78d2-f1c8-4593-8ce2-36facf813c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:48.874646 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f376a-ea80-472b-9781-c242396b064d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:48.875026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa78d2-f1c8-4593-8ce2-36facf813c57 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:48.875447 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa78d2-f1c8-4593-8ce2-36facf813c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:48.875869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa78d2-f1c8-4593-8ce2-36facf813c57 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:48.876916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa78d2-f1c8-4593-8ce2-36facf813c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:48.877265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa78d2-f1c8-4593-8ce2-36facf813c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:48.879359 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa78d2-f1c8-4593-8ce2-36facf813c57 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f06f376a-ea80-472b-9781-c242396b064d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:48.896254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:48.897294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:48.898170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 463/930] 10.222.0.64 () {56 vars in 1132 bytes} [Fri Jul 15 15:12:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:48.899587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5917c-d101-472f-abff-854145afc5f8 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:48.899839 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5917c-d101-472f-abff-854145afc5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:48.900121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5917c-d101-472f-abff-854145afc5f8 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:48.905103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 464/931] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:48.905103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5917c-d101-472f-abff-854145afc5f8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:48.908018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 468/932] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:48.909638 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6306ad6-3bd7-4ee8-9201-9d48c391f8eb None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:48.910098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6306ad6-3bd7-4ee8-9201-9d48c391f8eb None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:48.910552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6306ad6-3bd7-4ee8-9201-9d48c391f8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:48.932787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b6306ad6-3bd7-4ee8-9201-9d48c391f8eb None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:48.934208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b6306ad6-3bd7-4ee8-9201-9d48c391f8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:49.026112 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 469/933] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:49.027695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6306ad6-3bd7-4ee8-9201-9d48c391f8eb None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:49.037911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:49.085295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5917c-d101-472f-abff-854145afc5f8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:49.142324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92b240-a5d1-4292-bd10-575f3e7a0988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:49.143351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92b240-a5d1-4292-bd10-575f3e7a0988 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:49.143833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92b240-a5d1-4292-bd10-575f3e7a0988 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:49.144634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92b240-a5d1-4292-bd10-575f3e7a0988 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:49.145114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92b240-a5d1-4292-bd10-575f3e7a0988 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:49.145441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92b240-a5d1-4292-bd10-575f3e7a0988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:49.147466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92b240-a5d1-4292-bd10-575f3e7a0988 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:49.153098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:49.160019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 465/934] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Jul 15 15:12:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:49.160019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92b240-a5d1-4292-bd10-575f3e7a0988 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:49.198385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6306ad6-3bd7-4ee8-9201-9d48c391f8eb None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:49.246400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b8ebb-7266-4495-8b31-36e606be1aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:49.247215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b8ebb-7266-4495-8b31-36e606be1aaa None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:49.247578 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b8ebb-7266-4495-8b31-36e606be1aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:49.247858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b8ebb-7266-4495-8b31-36e606be1aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:49.256740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b8ebb-7266-4495-8b31-36e606be1aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:49.258301 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b8ebb-7266-4495-8b31-36e606be1aaa None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c74b8ebb-7266-4495-8b31-36e606be1aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:49.275851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:49.276844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:49.283444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:49.283444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:49.283444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:49.283444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:49.283444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:49.283444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:49.283444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:49.283444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:49.283444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 470/935] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:49.283444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b8ebb-7266-4495-8b31-36e606be1aaa None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:49.313514 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92b240-a5d1-4292-bd10-575f3e7a0988 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:49.359668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a475fd3-8aaa-4346-9239-b3a0efd414ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:49.360517 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a475fd3-8aaa-4346-9239-b3a0efd414ab None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:49.360859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a475fd3-8aaa-4346-9239-b3a0efd414ab None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:49.361180 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a475fd3-8aaa-4346-9239-b3a0efd414ab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:49.361893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a475fd3-8aaa-4346-9239-b3a0efd414ab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:49.363317 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a475fd3-8aaa-4346-9239-b3a0efd414ab None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-6a475fd3-8aaa-4346-9239-b3a0efd414ab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:49.377449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:49.379138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:49.380051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 466/936] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Jul 15 15:12:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:49.381338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a475fd3-8aaa-4346-9239-b3a0efd414ab None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:49.387511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:49.433912 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b8ebb-7266-4495-8b31-36e606be1aaa None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:49.480490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:49.491281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc19064-4e80-40a2-8021-0e674abeb370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:49.492175 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc19064-4e80-40a2-8021-0e674abeb370 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:49.492860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc19064-4e80-40a2-8021-0e674abeb370 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:49.494610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc19064-4e80-40a2-8021-0e674abeb370 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:49.495368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc19064-4e80-40a2-8021-0e674abeb370 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:49.495687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc19064-4e80-40a2-8021-0e674abeb370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:49.497241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc19064-4e80-40a2-8021-0e674abeb370 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:49.505797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 471/937] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Jul 15 15:12:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:49.506459 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc19064-4e80-40a2-8021-0e674abeb370 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:49.547103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a475fd3-8aaa-4346-9239-b3a0efd414ab None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:49.608553 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425fe88-755c-4c00-a7f3-cd4cb6dac470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:49.609544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425fe88-755c-4c00-a7f3-cd4cb6dac470 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:49.609833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425fe88-755c-4c00-a7f3-cd4cb6dac470 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:49.610113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425fe88-755c-4c00-a7f3-cd4cb6dac470 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:49.610933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425fe88-755c-4c00-a7f3-cd4cb6dac470 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:49.611246 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425fe88-755c-4c00-a7f3-cd4cb6dac470 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:49.612738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425fe88-755c-4c00-a7f3-cd4cb6dac470 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:49.628304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 467/938] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:49.630004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425fe88-755c-4c00-a7f3-cd4cb6dac470 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:49.654432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc19064-4e80-40a2-8021-0e674abeb370 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:49.702012 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f4074-c891-4095-8e6e-835b665c5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:49.703491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f4074-c891-4095-8e6e-835b665c5bec None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:49.703491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f4074-c891-4095-8e6e-835b665c5bec None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:49.703744 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f4074-c891-4095-8e6e-835b665c5bec None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:49.704453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f4074-c891-4095-8e6e-835b665c5bec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:49.704771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f4074-c891-4095-8e6e-835b665c5bec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:49.706246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f4074-c891-4095-8e6e-835b665c5bec None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:49.712729 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 472/939] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Jul 15 15:12:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:49.713616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f4074-c891-4095-8e6e-835b665c5bec None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:49.720870 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:49.771807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425fe88-755c-4c00-a7f3-cd4cb6dac470 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:49.797131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:49.823775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdb2db-64fb-47d1-a7af-84c223a742dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:49.825041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb2db-64fb-47d1-a7af-84c223a742dc None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:49.825387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb2db-64fb-47d1-a7af-84c223a742dc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:49.825871 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb2db-64fb-47d1-a7af-84c223a742dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:49.826865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdb2db-64fb-47d1-a7af-84c223a742dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:49.828301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdb2db-64fb-47d1-a7af-84c223a742dc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:49.874324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 468/940] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Jul 15 15:12:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:12:49.880850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f4074-c891-4095-8e6e-835b665c5bec None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:49.883443 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdb2db-64fb-47d1-a7af-84c223a742dc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:49.989964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319b92a-3f64-4435-a037-99a0989e9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:49.991931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b92a-3f64-4435-a037-99a0989e9da2 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:49.992412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b92a-3f64-4435-a037-99a0989e9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:49.992891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b92a-3f64-4435-a037-99a0989e9da2 None admin] PATH_INFO: `/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/2a328efd184f4988bb033c83c3321991/roles/2f29372d0ad04535b7a8688fc0209d85` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:49.998010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319b92a-3f64-4435-a037-99a0989e9da2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0acc3e7b64dbab9113284b46f38ff, user_id=2a328efd184f4988bb033c83c3321991, role_id=2f29372d0ad04535b7a8688fc0209d85)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:50.004168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319b92a-3f64-4435-a037-99a0989e9da2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:50.032771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 473/941] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:12:49 2022] PUT /identity/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/2a328efd184f4988bb033c83c3321991/roles/2f29372d0ad04535b7a8688fc0209d85 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:12:50.079927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdb2db-64fb-47d1-a7af-84c223a742dc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:50.103810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:50.132193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e88c00-87d3-4173-9720-1086552d7bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:50.133184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e88c00-87d3-4173-9720-1086552d7bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:50.133615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e88c00-87d3-4173-9720-1086552d7bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:50.133906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e88c00-87d3-4173-9720-1086552d7bb9 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:50.134720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e88c00-87d3-4173-9720-1086552d7bb9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:50.135032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e88c00-87d3-4173-9720-1086552d7bb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:50.136560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e88c00-87d3-4173-9720-1086552d7bb9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:50.145169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 469/942] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Jul 15 15:12:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:50.155054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319b92a-3f64-4435-a037-99a0989e9da2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:50.283166 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319b92a-3f64-4435-a037-99a0989e9da2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:50.301874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:50.325036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d673b95-cf9e-43f6-897d-8a35053d6245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:50.325753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d673b95-cf9e-43f6-897d-8a35053d6245 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:50.326030 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d673b95-cf9e-43f6-897d-8a35053d6245 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:50.326307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d673b95-cf9e-43f6-897d-8a35053d6245 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:50.327167 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d673b95-cf9e-43f6-897d-8a35053d6245 None admin] RBAC: Adding query filter params (interface=public, service_id=faf352429f424f26a2f4b875897bf2df, region_id=RegionOne) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:50.327481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d673b95-cf9e-43f6-897d-8a35053d6245 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:50.329017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d673b95-cf9e-43f6-897d-8a35053d6245 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:50.335833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 474/943] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Jul 15 15:12:50 2022] GET /identity/v3/endpoints?service_id=faf352429f424f26a2f4b875897bf2df&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:50.341771 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e88c00-87d3-4173-9720-1086552d7bb9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:50.462358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e88c00-87d3-4173-9720-1086552d7bb9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:50.509391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e60caf-e96d-4632-89c6-87b49f91bf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:50.510085 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e60caf-e96d-4632-89c6-87b49f91bf39 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:50.510368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e60caf-e96d-4632-89c6-87b49f91bf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:50.510643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e60caf-e96d-4632-89c6-87b49f91bf39 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:50.511440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e60caf-e96d-4632-89c6-87b49f91bf39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:50.512849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e60caf-e96d-4632-89c6-87b49f91bf39 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:50.520378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 470/944] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Jul 15 15:12:50 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:12:50.596350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf862ca2-3cce-44c4-b89e-163277230fcd None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:50.596711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf862ca2-3cce-44c4-b89e-163277230fcd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:50.596921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf862ca2-3cce-44c4-b89e-163277230fcd None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:50.598619 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 475/945] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:50.610144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded3b23-3807-45d4-8ffa-e4ddfdd428cd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:50.610467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded3b23-3807-45d4-8ffa-e4ddfdd428cd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:50.610703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded3b23-3807-45d4-8ffa-e4ddfdd428cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:50.631623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-eded3b23-3807-45d4-8ffa-e4ddfdd428cd None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:50.632866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eded3b23-3807-45d4-8ffa-e4ddfdd428cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:50.692661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:50.721513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 471/946] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:50.747693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf862ca2-3cce-44c4-b89e-163277230fcd None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:50.884107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf862ca2-3cce-44c4-b89e-163277230fcd None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:50.960264 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82cab5-9b06-4099-94a8-f1469f73d2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:50.961431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82cab5-9b06-4099-94a8-f1469f73d2c7 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:50.961924 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82cab5-9b06-4099-94a8-f1469f73d2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:50.962400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82cab5-9b06-4099-94a8-f1469f73d2c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:50.963710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82cab5-9b06-4099-94a8-f1469f73d2c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:50.966431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82cab5-9b06-4099-94a8-f1469f73d2c7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:50.969581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: WARNING keystone.server.flask.common [None req-8c82cab5-9b06-4099-94a8-f1469f73d2c7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 15 15:12:51.003812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.sql.core [None req-8c82cab5-9b06-4099-94a8-f1469f73d2c7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 15:12:51.003812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 15:12:51.003812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [parameters: {'id': '815a3da71d754aea8c86ad1c6c97c8a4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 15:12:51.003812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80236) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-8c82cab5-9b06-4099-94a8-f1469f73d2c7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 815a3da71d754aea8c86ad1c6c97c8a4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 815a3da71d754aea8c86ad1c6c97c8a4. Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application conn.query(q) Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 15:12:51.012355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result.read() Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 15 15:12:51.013279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application next(self.gen) Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application yield resource Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application next(self.gen) Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise self.value Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application session.commit() Jul 15 15:12:51.014211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.session.flush() Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application compat.raise_( Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 15:12:51.016379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 15:12:51.017308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application conn.query(q) Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result.read() Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 15:12:51.018151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [parameters: {'id': '815a3da71d754aea8c86ad1c6c97c8a4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:51.023174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:51.025042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:51.027457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:51.027457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 15 15:12:51.027457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 15 15:12:51.027457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:51.027457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:51.027457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 15 15:12:51.027457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 15 15:12:51.027457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 815a3da71d754aea8c86ad1c6c97c8a4. Jul 15 15:12:51.027457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:51.027457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 476/947] 10.222.0.64 () {60 vars in 1140 bytes} [Fri Jul 15 15:12:50 2022] POST /identity/v3/projects => generated 262 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:51.028952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded3b23-3807-45d4-8ffa-e4ddfdd428cd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:51.145400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded3b23-3807-45d4-8ffa-e4ddfdd428cd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:51.190277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbab65a-abce-48c9-8347-943e0809c97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:51.191106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbab65a-abce-48c9-8347-943e0809c97a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:51.191396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbab65a-abce-48c9-8347-943e0809c97a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:51.191681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbab65a-abce-48c9-8347-943e0809c97a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:51.199476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbab65a-abce-48c9-8347-943e0809c97a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:51.200966 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbab65a-abce-48c9-8347-943e0809c97a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1fbab65a-abce-48c9-8347-943e0809c97a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:51.216664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:51.219409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:51.221503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:51.221503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:51.221503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:51.221503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:51.221503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:51.221503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:51.221503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:51.221503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:51.221503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 472/948] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:51.226664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82cab5-9b06-4099-94a8-f1469f73d2c7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:51.285721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:51.352188 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82cab5-9b06-4099-94a8-f1469f73d2c7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:51.391649 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582e965-db46-4388-b422-4b61e36bb3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:51.392339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582e965-db46-4388-b422-4b61e36bb3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:51.392623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582e965-db46-4388-b422-4b61e36bb3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:51.392899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582e965-db46-4388-b422-4b61e36bb3d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:51.393708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582e965-db46-4388-b422-4b61e36bb3d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:51.394018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582e965-db46-4388-b422-4b61e36bb3d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:51.395767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582e965-db46-4388-b422-4b61e36bb3d4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:51.419568 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 477/949] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:12:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:52.333744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419a8f6-fcda-4050-a425-b29ef552e52d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:52.334311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419a8f6-fcda-4050-a425-b29ef552e52d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:52.334311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419a8f6-fcda-4050-a425-b29ef552e52d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:52.337027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 473/950] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:52.344367 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb05568-97ee-4195-b8df-89913778ad2f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:52.344890 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb05568-97ee-4195-b8df-89913778ad2f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:52.345120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb05568-97ee-4195-b8df-89913778ad2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:52.364458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0eb05568-97ee-4195-b8df-89913778ad2f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:52.366052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0eb05568-97ee-4195-b8df-89913778ad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:52.461234 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 478/951] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:12:52.480612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419a8f6-fcda-4050-a425-b29ef552e52d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:52.534559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:52.626343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419a8f6-fcda-4050-a425-b29ef552e52d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:52.664206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4b591-71e2-4f4b-8f11-aff709f9e6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:52.665030 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b591-71e2-4f4b-8f11-aff709f9e6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:52.665347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b591-71e2-4f4b-8f11-aff709f9e6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:52.665626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b591-71e2-4f4b-8f11-aff709f9e6e3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:52.666295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4b591-71e2-4f4b-8f11-aff709f9e6e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:52.667693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4b591-71e2-4f4b-8f11-aff709f9e6e3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ffd4b591-71e2-4f4b-8f11-aff709f9e6e3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:52.680987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:52.682195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:52.683121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 474/952] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:52.691602 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb05568-97ee-4195-b8df-89913778ad2f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:52.735613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:52.774556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38dff7-c958-463f-a4eb-05d48a278a32 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:52.774887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38dff7-c958-463f-a4eb-05d48a278a32 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:52.775123 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38dff7-c958-463f-a4eb-05d48a278a32 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:52.776688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 475/953] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:12:52.783213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65839860-8e3b-43aa-9bef-4ec64a5aa8bd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:52.783847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65839860-8e3b-43aa-9bef-4ec64a5aa8bd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:52.784384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65839860-8e3b-43aa-9bef-4ec64a5aa8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:52.808595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-65839860-8e3b-43aa-9bef-4ec64a5aa8bd None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:52.810903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-65839860-8e3b-43aa-9bef-4ec64a5aa8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:52.849708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb05568-97ee-4195-b8df-89913778ad2f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:52.901560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 476/954] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:12:52.903038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d5b15-b794-48cd-a529-6444e6e72ef0 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:52.903338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d5b15-b794-48cd-a529-6444e6e72ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:52.903618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d5b15-b794-48cd-a529-6444e6e72ef0 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:52.904942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 477/955] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:52.911150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68782a2b-e77f-4b86-a0c4-c562fe1e2a02 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:52.911440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68782a2b-e77f-4b86-a0c4-c562fe1e2a02 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:52.911722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68782a2b-e77f-4b86-a0c4-c562fe1e2a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:52.912334 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b2f1-e97a-4c41-9eab-aff6bc034d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:52.913244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b2f1-e97a-4c41-9eab-aff6bc034d4d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:52.913811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b2f1-e97a-4c41-9eab-aff6bc034d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:52.914308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b2f1-e97a-4c41-9eab-aff6bc034d4d None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:52.915347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931b2f1-e97a-4c41-9eab-aff6bc034d4d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:52.915759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931b2f1-e97a-4c41-9eab-aff6bc034d4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:52.917490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931b2f1-e97a-4c41-9eab-aff6bc034d4d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:52.929147 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 479/956] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:12:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:52.930618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b2f1-e97a-4c41-9eab-aff6bc034d4d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:52.936942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-68782a2b-e77f-4b86-a0c4-c562fe1e2a02 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:52.939012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-68782a2b-e77f-4b86-a0c4-c562fe1e2a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:52.984194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:53.053527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 478/957] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:12:53.055660 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68782a2b-e77f-4b86-a0c4-c562fe1e2a02 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:53.057206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:53.069875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b2f1-e97a-4c41-9eab-aff6bc034d4d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:53.131498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df223274-add7-4a24-bd0e-7992970b0000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:53.133203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223274-add7-4a24-bd0e-7992970b0000 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:53.133880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223274-add7-4a24-bd0e-7992970b0000 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:53.134487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223274-add7-4a24-bd0e-7992970b0000 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:53.142047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df223274-add7-4a24-bd0e-7992970b0000 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:53.142766 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df223274-add7-4a24-bd0e-7992970b0000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:53.151120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df223274-add7-4a24-bd0e-7992970b0000 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:53.185211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 480/958] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:12:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:53.185211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df223274-add7-4a24-bd0e-7992970b0000 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:53.253277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68782a2b-e77f-4b86-a0c4-c562fe1e2a02 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:53.295414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4dccf-9d92-4f3b-a825-e861fa6dba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:53.296928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4dccf-9d92-4f3b-a825-e861fa6dba3c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:53.297239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4dccf-9d92-4f3b-a825-e861fa6dba3c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:53.297511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4dccf-9d92-4f3b-a825-e861fa6dba3c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:53.327217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4dccf-9d92-4f3b-a825-e861fa6dba3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:12:53.334674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df223274-add7-4a24-bd0e-7992970b0000 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e8a4dccf-9d92-4f3b-a825-e861fa6dba3c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:12:53.337901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:53.340362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:53.344575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 479/959] 10.222.0.64 () {56 vars in 1120 bytes} [Fri Jul 15 15:12:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:53.347827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4dccf-9d92-4f3b-a825-e861fa6dba3c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:53.383182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:53.407710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a244205-b629-47bb-8286-403d3cd50e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:53.409273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a244205-b629-47bb-8286-403d3cd50e2c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:53.409771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a244205-b629-47bb-8286-403d3cd50e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:53.410255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a244205-b629-47bb-8286-403d3cd50e2c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:53.411266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a244205-b629-47bb-8286-403d3cd50e2c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:53.412930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a244205-b629-47bb-8286-403d3cd50e2c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-5a244205-b629-47bb-8286-403d3cd50e2c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:53.426208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:53.427322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:53.428178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 481/960] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Jul 15 15:12:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:53.435680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a244205-b629-47bb-8286-403d3cd50e2c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:53.477989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:53.522107 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4dccf-9d92-4f3b-a825-e861fa6dba3c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:53.565296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ed90e-23a2-4e06-b588-f0ae3a4d57e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:53.566041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ed90e-23a2-4e06-b588-f0ae3a4d57e2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:53.566474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ed90e-23a2-4e06-b588-f0ae3a4d57e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:53.566970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ed90e-23a2-4e06-b588-f0ae3a4d57e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:53.569255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ed90e-23a2-4e06-b588-f0ae3a4d57e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:53.569754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ed90e-23a2-4e06-b588-f0ae3a4d57e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:53.571515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ed90e-23a2-4e06-b588-f0ae3a4d57e2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:53.589177 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 480/961] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Jul 15 15:12:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:53.593121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ed90e-23a2-4e06-b588-f0ae3a4d57e2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:53.595438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a244205-b629-47bb-8286-403d3cd50e2c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:53.645974 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2d5b6-50dc-4175-8bea-7198dfc43d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:53.646730 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2d5b6-50dc-4175-8bea-7198dfc43d6e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:53.647173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2d5b6-50dc-4175-8bea-7198dfc43d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:53.647462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2d5b6-50dc-4175-8bea-7198dfc43d6e None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:53.648236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2d5b6-50dc-4175-8bea-7198dfc43d6e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:53.649223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2d5b6-50dc-4175-8bea-7198dfc43d6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:53.650005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2d5b6-50dc-4175-8bea-7198dfc43d6e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:53.662208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 482/962] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Jul 15 15:12:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:53.663535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2d5b6-50dc-4175-8bea-7198dfc43d6e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:53.707429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:53.726632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ed90e-23a2-4e06-b588-f0ae3a4d57e2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:53.776654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be5e0b-40ed-4159-b99f-50b912e5bc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:53.777906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be5e0b-40ed-4159-b99f-50b912e5bc95 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:53.778635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be5e0b-40ed-4159-b99f-50b912e5bc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:53.779129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be5e0b-40ed-4159-b99f-50b912e5bc95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:53.783973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:53.795111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be5e0b-40ed-4159-b99f-50b912e5bc95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:53.797662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be5e0b-40ed-4159-b99f-50b912e5bc95 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:53.805739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2d5b6-50dc-4175-8bea-7198dfc43d6e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-23be5e0b-40ed-4159-b99f-50b912e5bc95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:53.817710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:53.818848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:53.819783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:53.819783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:53.819783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:53.819783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:53.828586 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 481/963] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:53.829913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be5e0b-40ed-4159-b99f-50b912e5bc95 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:53.846638 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9bf2-7389-4a54-b402-f94049463e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:53.847513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9bf2-7389-4a54-b402-f94049463e08 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:53.847804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9bf2-7389-4a54-b402-f94049463e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:53.848081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9bf2-7389-4a54-b402-f94049463e08 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:53.848807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae9bf2-7389-4a54-b402-f94049463e08 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:53.849140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae9bf2-7389-4a54-b402-f94049463e08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:53.850585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae9bf2-7389-4a54-b402-f94049463e08 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:53.864136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 483/964] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Jul 15 15:12:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:53.867982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9bf2-7389-4a54-b402-f94049463e08 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:53.955333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be5e0b-40ed-4159-b99f-50b912e5bc95 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:53.999248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b312ca7-951d-4e47-a9e7-2c38d1a2a5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:53.999899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b312ca7-951d-4e47-a9e7-2c38d1a2a5cd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:54.000191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b312ca7-951d-4e47-a9e7-2c38d1a2a5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:54.000474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b312ca7-951d-4e47-a9e7-2c38d1a2a5cd None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:54.001270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b312ca7-951d-4e47-a9e7-2c38d1a2a5cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:54.001588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b312ca7-951d-4e47-a9e7-2c38d1a2a5cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:54.001697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9bf2-7389-4a54-b402-f94049463e08 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:54.003290 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b312ca7-951d-4e47-a9e7-2c38d1a2a5cd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:54.019464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 482/965] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:54.020150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:54.024055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af8841-00fe-4aef-9436-52c02e5f4fc9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:54.024768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af8841-00fe-4aef-9436-52c02e5f4fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:54.025438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af8841-00fe-4aef-9436-52c02e5f4fc9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:54.027358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 483/966] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:54.028481 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af8841-00fe-4aef-9436-52c02e5f4fc9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:54.047769 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed693b-175a-4eb4-a57b-1326889e7610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:54.048456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed693b-175a-4eb4-a57b-1326889e7610 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:54.048906 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed693b-175a-4eb4-a57b-1326889e7610 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:54.049228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed693b-175a-4eb4-a57b-1326889e7610 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:54.050440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed693b-175a-4eb4-a57b-1326889e7610 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:54.052045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed693b-175a-4eb4-a57b-1326889e7610 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:54.085305 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 484/967] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Jul 15 15:12:53 2022] POST /identity/v3/endpoints => generated 349 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:12:54.087993 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea69dba-7d92-4e55-9f20-ed0c2e3b9765 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:54.088765 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea69dba-7d92-4e55-9f20-ed0c2e3b9765 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:54.089416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea69dba-7d92-4e55-9f20-ed0c2e3b9765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:54.098700 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:54.120622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8ea69dba-7d92-4e55-9f20-ed0c2e3b9765 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:54.122299 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8ea69dba-7d92-4e55-9f20-ed0c2e3b9765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:54.200002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af8841-00fe-4aef-9436-52c02e5f4fc9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:54.242697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 485/968] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:54.262026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfe0c2-5d76-4f7f-b00b-66ee3c122b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:54.262778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfe0c2-5d76-4f7f-b00b-66ee3c122b3b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:54.263060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfe0c2-5d76-4f7f-b00b-66ee3c122b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:54.263337 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfe0c2-5d76-4f7f-b00b-66ee3c122b3b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:54.267141 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea69dba-7d92-4e55-9f20-ed0c2e3b9765 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:54.277169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfe0c2-5d76-4f7f-b00b-66ee3c122b3b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:54.278982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfe0c2-5d76-4f7f-b00b-66ee3c122b3b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-24cfe0c2-5d76-4f7f-b00b-66ee3c122b3b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:54.296831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:54.298645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:54.300415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:54.300415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:54.300415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:54.300415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:54.300415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:54.300415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:54.300415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:54.300415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:54.300415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 15:12:54.300415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:54.300415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 484/969] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Jul 15 15:12:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:54.309639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfe0c2-5d76-4f7f-b00b-66ee3c122b3b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:54.383177 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:54.410919 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea69dba-7d92-4e55-9f20-ed0c2e3b9765 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:54.451756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfe0c2-5d76-4f7f-b00b-66ee3c122b3b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:54.457729 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429640fb-8b81-45b0-a06c-683aec8a5fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:54.458527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429640fb-8b81-45b0-a06c-683aec8a5fc2 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:54.458894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429640fb-8b81-45b0-a06c-683aec8a5fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:54.459295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429640fb-8b81-45b0-a06c-683aec8a5fc2 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:54.460157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429640fb-8b81-45b0-a06c-683aec8a5fc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:54.461874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429640fb-8b81-45b0-a06c-683aec8a5fc2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:54.477705 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:54.480196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.sql.core [None req-429640fb-8b81-45b0-a06c-683aec8a5fc2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 15:12:54.480196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 15:12:54.480196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [parameters: {'user_id': 'ed6f0c2f15d842d6bf781ce02633660f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 15:12:54.480196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80236) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-429640fb-8b81-45b0-a06c-683aec8a5fc2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application conn.query(q) Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result.read() Jul 15 15:12:54.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 15:12:54.490850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application next(self.gen) Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application yield resource Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application next(self.gen) Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise self.value Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application session.commit() Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 15:12:54.492091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.session.flush() Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application compat.raise_( Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 15:12:54.493206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 15:12:54.494180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application conn.query(q) Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application result.read() Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 15:12:54.496284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ed6f0c2f15d842d6bf781ce02633660f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:54.498435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 15 15:12:54.501218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 15 15:12:54.503690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 15 15:12:54.503690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 15 15:12:54.503690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 15:12:54.503690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 15:12:54.503690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 15:12:54.503690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:54.503690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 486/970] 10.222.0.64 () {60 vars in 1131 bytes} [Fri Jul 15 15:12:54 2022] POST /identity/v3/users => generated 160 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:12:54.504634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d36f8-f377-4ac0-9351-646eb7e57bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:54.504634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d36f8-f377-4ac0-9351-646eb7e57bce None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:54.504961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d36f8-f377-4ac0-9351-646eb7e57bce None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:54.504961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d36f8-f377-4ac0-9351-646eb7e57bce None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:54.505914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d36f8-f377-4ac0-9351-646eb7e57bce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:54.506289 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d36f8-f377-4ac0-9351-646eb7e57bce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:54.507753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d36f8-f377-4ac0-9351-646eb7e57bce None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:54.511085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429640fb-8b81-45b0-a06c-683aec8a5fc2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:54.532265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 485/971] 10.222.0.64 () {56 vars in 1149 bytes} [Fri Jul 15 15:12:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:54.537788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d36f8-f377-4ac0-9351-646eb7e57bce None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:54.654234 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429640fb-8b81-45b0-a06c-683aec8a5fc2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:54.698906 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49675991-92f1-4894-afb3-f5c3c355411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:54.699739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49675991-92f1-4894-afb3-f5c3c355411a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:54.700026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49675991-92f1-4894-afb3-f5c3c355411a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:54.700335 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49675991-92f1-4894-afb3-f5c3c355411a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:54.710453 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d36f8-f377-4ac0-9351-646eb7e57bce None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:54.713417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49675991-92f1-4894-afb3-f5c3c355411a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:54.717171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49675991-92f1-4894-afb3-f5c3c355411a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:54.729492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-49675991-92f1-4894-afb3-f5c3c355411a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:12:54.738662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:54.739926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:54.741351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:54.741351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:54.741351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:12:54.741351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:12:54.741351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:12:54.741351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:12:54.741351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:12:54.741351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:12:54.741351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:12:54.741351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:54.745278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 487/972] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:12:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:54.746909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49675991-92f1-4894-afb3-f5c3c355411a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:54.766222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb725542-a0e5-4002-a296-48b1cd1ddcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:54.767294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb725542-a0e5-4002-a296-48b1cd1ddcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:54.767676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb725542-a0e5-4002-a296-48b1cd1ddcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:54.768584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb725542-a0e5-4002-a296-48b1cd1ddcb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:54.822078 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:54.869900 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb725542-a0e5-4002-a296-48b1cd1ddcb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:54.871413 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb725542-a0e5-4002-a296-48b1cd1ddcb0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:54.880338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49675991-92f1-4894-afb3-f5c3c355411a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:54.918908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a7fd-00ce-4d82-a2a9-49cabb351312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:54.919796 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a7fd-00ce-4d82-a2a9-49cabb351312 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:54.920185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a7fd-00ce-4d82-a2a9-49cabb351312 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:54.920615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a7fd-00ce-4d82-a2a9-49cabb351312 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:54.922373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a7fd-00ce-4d82-a2a9-49cabb351312 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:54.922962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a7fd-00ce-4d82-a2a9-49cabb351312 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:54.924607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a7fd-00ce-4d82-a2a9-49cabb351312 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:54.969543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 488/973] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Jul 15 15:12:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:55.009320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 486/974] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:12:54 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 15:12:55.018394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a7fd-00ce-4d82-a2a9-49cabb351312 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:55.147830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a7fd-00ce-4d82-a2a9-49cabb351312 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:55.168554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:55.210335 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146dd07-8e85-46cd-8379-524f1baa093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:55.211173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146dd07-8e85-46cd-8379-524f1baa093c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:55.211494 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146dd07-8e85-46cd-8379-524f1baa093c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:55.211775 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146dd07-8e85-46cd-8379-524f1baa093c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:55.226329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146dd07-8e85-46cd-8379-524f1baa093c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:55.227830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146dd07-8e85-46cd-8379-524f1baa093c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-0146dd07-8e85-46cd-8379-524f1baa093c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:12:55.252541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:55.255124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:55.257266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:12:55.257266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:12:55.257266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:12:55.257266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:55.257266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 489/975] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:55.262475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb725542-a0e5-4002-a296-48b1cd1ddcb0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:55.282544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:55.388412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb725542-a0e5-4002-a296-48b1cd1ddcb0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:55.438059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f26d03-cfb1-4769-b363-2131f2f2fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:55.438664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f26d03-cfb1-4769-b363-2131f2f2fe46 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:55.438951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f26d03-cfb1-4769-b363-2131f2f2fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:55.439365 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f26d03-cfb1-4769-b363-2131f2f2fe46 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:55.440423 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f26d03-cfb1-4769-b363-2131f2f2fe46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:55.440423 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f26d03-cfb1-4769-b363-2131f2f2fe46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:55.441850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f26d03-cfb1-4769-b363-2131f2f2fe46 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:55.459247 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 487/976] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:55.460922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146dd07-8e85-46cd-8379-524f1baa093c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:55.513279 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528baae-9c19-4ef8-98db-47033c4dd540 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:55.513850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528baae-9c19-4ef8-98db-47033c4dd540 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:55.514374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528baae-9c19-4ef8-98db-47033c4dd540 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:55.517290 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 488/977] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:55.524297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2d10c-11c9-478c-be5a-5516f5cb64d0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:55.524606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2d10c-11c9-478c-be5a-5516f5cb64d0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:55.524730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2d10c-11c9-478c-be5a-5516f5cb64d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:55.549105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6ff2d10c-11c9-478c-be5a-5516f5cb64d0 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:55.550883 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6ff2d10c-11c9-478c-be5a-5516f5cb64d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:55.612856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146dd07-8e85-46cd-8379-524f1baa093c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:55.630463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:55.636942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 489/978] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:12:55.659393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735dbed-3d5d-4dc9-b4d6-b8457a90db21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:55.660520 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735dbed-3d5d-4dc9-b4d6-b8457a90db21 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:55.661004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735dbed-3d5d-4dc9-b4d6-b8457a90db21 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:55.662014 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735dbed-3d5d-4dc9-b4d6-b8457a90db21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:55.668907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2d10c-11c9-478c-be5a-5516f5cb64d0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:55.673671 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735dbed-3d5d-4dc9-b4d6-b8457a90db21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:55.676300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735dbed-3d5d-4dc9-b4d6-b8457a90db21 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-0735dbed-3d5d-4dc9-b4d6-b8457a90db21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:12:55.698677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:55.699643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:55.700646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:12:55.700646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:12:55.700646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:12:55.700646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:12:55.700646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:12:55.700646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:12:55.700646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:12:55.700646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:55.706503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 490/979] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:55.707308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735dbed-3d5d-4dc9-b4d6-b8457a90db21 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:55.754390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:55.810883 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2d10c-11c9-478c-be5a-5516f5cb64d0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:55.853536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa032d-89fe-4da2-bee0-b961226586b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:55.854225 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa032d-89fe-4da2-bee0-b961226586b8 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:55.854515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa032d-89fe-4da2-bee0-b961226586b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:55.854852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa032d-89fe-4da2-bee0-b961226586b8 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:55.855596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa032d-89fe-4da2-bee0-b961226586b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:55.857002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa032d-89fe-4da2-bee0-b961226586b8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:55.870306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735dbed-3d5d-4dc9-b4d6-b8457a90db21 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:55.882071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 490/980] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:12:55 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:12:55.948832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad8afe-9f8c-4392-9352-c5691546b3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:55.949999 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad8afe-9f8c-4392-9352-c5691546b3de None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:55.950521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad8afe-9f8c-4392-9352-c5691546b3de None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:55.951049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad8afe-9f8c-4392-9352-c5691546b3de None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:55.952990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad8afe-9f8c-4392-9352-c5691546b3de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:55.953561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad8afe-9f8c-4392-9352-c5691546b3de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:55.956374 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad8afe-9f8c-4392-9352-c5691546b3de None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:55.988456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 491/981] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:12:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:55.990162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa032d-89fe-4da2-bee0-b961226586b8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:56.073752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:56.131152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa032d-89fe-4da2-bee0-b961226586b8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:56.168707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdeda0-5fb5-42c3-bd04-1824b77111e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:56.169409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdeda0-5fb5-42c3-bd04-1824b77111e7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:56.169696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdeda0-5fb5-42c3-bd04-1824b77111e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:56.169979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdeda0-5fb5-42c3-bd04-1824b77111e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:56.170867 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdeda0-5fb5-42c3-bd04-1824b77111e7 None admin] RBAC: Adding query filter params (role.id=2f29372d0ad04535b7a8688fc0209d85, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=2a328efd184f4988bb033c83c3321991) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:56.171725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdeda0-5fb5-42c3-bd04-1824b77111e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:56.173346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdeda0-5fb5-42c3-bd04-1824b77111e7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:56.180139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 491/982] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:12:55 2022] GET /identity/v3/role_assignments?user.id=2a328efd184f4988bb033c83c3321991&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=2f29372d0ad04535b7a8688fc0209d85 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:56.479917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7eb1d9-2bcb-4e00-adbe-23dfb6b14c24 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:56.480463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7eb1d9-2bcb-4e00-adbe-23dfb6b14c24 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:56.480463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7eb1d9-2bcb-4e00-adbe-23dfb6b14c24 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:56.482256 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 492/983] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:56.488603 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbe898-e870-4172-a2a0-6934fed66e50 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:56.489110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbe898-e870-4172-a2a0-6934fed66e50 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:56.489193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbe898-e870-4172-a2a0-6934fed66e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:56.508266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-91cbe898-e870-4172-a2a0-6934fed66e50 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:56.509545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-91cbe898-e870-4172-a2a0-6934fed66e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:56.612244 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 492/984] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:56.634415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7eb1d9-2bcb-4e00-adbe-23dfb6b14c24 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:56.757243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:56.788077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7eb1d9-2bcb-4e00-adbe-23dfb6b14c24 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:56.824057 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7997f1-f971-4d17-ad9d-a55c835f8fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:56.824877 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7997f1-f971-4d17-ad9d-a55c835f8fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:56.825198 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7997f1-f971-4d17-ad9d-a55c835f8fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:56.825481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7997f1-f971-4d17-ad9d-a55c835f8fb9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:56.826150 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7997f1-f971-4d17-ad9d-a55c835f8fb9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:56.828091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7997f1-f971-4d17-ad9d-a55c835f8fb9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-7c7997f1-f971-4d17-ad9d-a55c835f8fb9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:56.850123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:56.851204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:56.852102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 493/985] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Jul 15 15:12:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:56.859675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbe898-e870-4172-a2a0-6934fed66e50 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:56.934668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:56.993938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbe898-e870-4172-a2a0-6934fed66e50 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:57.046581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e82bf-ac25-427c-ba41-5adb7721a697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:57.047176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e82bf-ac25-427c-ba41-5adb7721a697 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:57.047456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e82bf-ac25-427c-ba41-5adb7721a697 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:57.047735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e82bf-ac25-427c-ba41-5adb7721a697 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:57.048461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e82bf-ac25-427c-ba41-5adb7721a697 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:57.048770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e82bf-ac25-427c-ba41-5adb7721a697 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:57.050993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e82bf-ac25-427c-ba41-5adb7721a697 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:57.057261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 493/986] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Jul 15 15:12:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:57.063349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7997f1-f971-4d17-ad9d-a55c835f8fb9 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:57.192394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7997f1-f971-4d17-ad9d-a55c835f8fb9 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:57.232348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668acaf6-f98b-4d0e-8dde-bd37aa53814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:57.233031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668acaf6-f98b-4d0e-8dde-bd37aa53814a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:57.233338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668acaf6-f98b-4d0e-8dde-bd37aa53814a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:57.233691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668acaf6-f98b-4d0e-8dde-bd37aa53814a None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:57.234659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668acaf6-f98b-4d0e-8dde-bd37aa53814a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:57.235187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668acaf6-f98b-4d0e-8dde-bd37aa53814a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:57.237192 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668acaf6-f98b-4d0e-8dde-bd37aa53814a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:57.250832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 494/987] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Jul 15 15:12:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:57.251886 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e82bf-ac25-427c-ba41-5adb7721a697 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:57.371969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e82bf-ac25-427c-ba41-5adb7721a697 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:57.393721 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:57.413582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1364f3d-d13e-431d-b500-69dd679cc540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:57.414286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1364f3d-d13e-431d-b500-69dd679cc540 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:57.414567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1364f3d-d13e-431d-b500-69dd679cc540 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:57.414843 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1364f3d-d13e-431d-b500-69dd679cc540 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:57.415964 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1364f3d-d13e-431d-b500-69dd679cc540 None admin] RBAC: Adding query filter params (interface=admin, service_id=faf352429f424f26a2f4b875897bf2df, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:57.416434 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1364f3d-d13e-431d-b500-69dd679cc540 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:57.418328 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1364f3d-d13e-431d-b500-69dd679cc540 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:57.429312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 494/988] 10.222.0.64 () {56 vars in 1249 bytes} [Fri Jul 15 15:12:57 2022] GET /identity/v3/endpoints?service_id=faf352429f424f26a2f4b875897bf2df&interface=admin®ion_id=RegionOne => generated 193 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:57.430817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668acaf6-f98b-4d0e-8dde-bd37aa53814a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:57.448311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:57.572272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668acaf6-f98b-4d0e-8dde-bd37aa53814a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:57.620773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfad69c-ec6a-4303-bbef-68da5f83e473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:57.621504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfad69c-ec6a-4303-bbef-68da5f83e473 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:57.621800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfad69c-ec6a-4303-bbef-68da5f83e473 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:57.622137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfad69c-ec6a-4303-bbef-68da5f83e473 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:57.622783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfad69c-ec6a-4303-bbef-68da5f83e473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:57.624182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfad69c-ec6a-4303-bbef-68da5f83e473 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:57.631862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 495/989] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Jul 15 15:12:57 2022] GET /identity/v3/services => generated 1727 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:12:58.083505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22857ece-669f-4bfe-9aca-ef840a660b69 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:58.084033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22857ece-669f-4bfe-9aca-ef840a660b69 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:58.084115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22857ece-669f-4bfe-9aca-ef840a660b69 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:58.085697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 495/990] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:58.093622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e2c63-2844-4d46-878d-043dc5415cb9 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:58.094218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e2c63-2844-4d46-878d-043dc5415cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:58.094798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e2c63-2844-4d46-878d-043dc5415cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:58.113899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f46e2c63-2844-4d46-878d-043dc5415cb9 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:58.115450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f46e2c63-2844-4d46-878d-043dc5415cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:58.205770 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 496/991] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:12:58.228673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22857ece-669f-4bfe-9aca-ef840a660b69 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:58.355485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22857ece-669f-4bfe-9aca-ef840a660b69 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:58.393856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91d58b-7dab-4e5c-8c33-52f341ca7cd8 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:58.394190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91d58b-7dab-4e5c-8c33-52f341ca7cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:58.394427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91d58b-7dab-4e5c-8c33-52f341ca7cd8 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:58.396032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 497/992] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:12:58.406842 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b5423-9d3d-4ca3-9008-daae14785b52 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:58.407137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b5423-9d3d-4ca3-9008-daae14785b52 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:58.407424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b5423-9d3d-4ca3-9008-daae14785b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:58.411449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeb091-1864-4e04-9443-32ceb173ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:58.412265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeb091-1864-4e04-9443-32ceb173ce5e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:58.412430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:58.412645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeb091-1864-4e04-9443-32ceb173ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:58.412817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeb091-1864-4e04-9443-32ceb173ce5e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:58.413579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdeb091-1864-4e04-9443-32ceb173ce5e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:58.414993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdeb091-1864-4e04-9443-32ceb173ce5e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:58.426726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c58b5423-9d3d-4ca3-9008-daae14785b52 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-6bdeb091-1864-4e04-9443-32ceb173ce5e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:58.427899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:58.428907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:12:58.430432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 496/993] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:12:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:58.431335 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c58b5423-9d3d-4ca3-9008-daae14785b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:12:58.435133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeb091-1864-4e04-9443-32ceb173ce5e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:58.502346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:58.525100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 498/994] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:12:58.540531 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b5423-9d3d-4ca3-9008-daae14785b52 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:58.569797 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeb091-1864-4e04-9443-32ceb173ce5e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:58.617865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba5522-cdbc-4bd7-b1b4-7ed91063e76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:58.618626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba5522-cdbc-4bd7-b1b4-7ed91063e76a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:58.619245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba5522-cdbc-4bd7-b1b4-7ed91063e76a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:58.619536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba5522-cdbc-4bd7-b1b4-7ed91063e76a None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:58.620428 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba5522-cdbc-4bd7-b1b4-7ed91063e76a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:58.620744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba5522-cdbc-4bd7-b1b4-7ed91063e76a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:58.622482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba5522-cdbc-4bd7-b1b4-7ed91063e76a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:58.628378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 497/995] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:12:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:58.634381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba5522-cdbc-4bd7-b1b4-7ed91063e76a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:58.683284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b5423-9d3d-4ca3-9008-daae14785b52 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:58.719060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:58.725964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef2a03-945d-418d-97df-349c454c1fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:58.727071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef2a03-945d-418d-97df-349c454c1fda None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:58.727533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef2a03-945d-418d-97df-349c454c1fda None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:58.727811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef2a03-945d-418d-97df-349c454c1fda None admin] PATH_INFO: `/v3/services/image` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:58.728624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef2a03-945d-418d-97df-349c454c1fda None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:58.729913 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef2a03-945d-418d-97df-349c454c1fda None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-cdef2a03-945d-418d-97df-349c454c1fda None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:12:58.743910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:12:58.744979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:12:58.745941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 499/996] 10.222.0.64 () {56 vars in 1105 bytes} [Fri Jul 15 15:12:58 2022] GET /identity/v3/services/image => generated 86 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:12:58.751454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef2a03-945d-418d-97df-349c454c1fda None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:58.794392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba5522-cdbc-4bd7-b1b4-7ed91063e76a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:58.805623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:58.835004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7647b7-8bfb-4f7b-91c3-8dd26a9863f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:58.835723 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7647b7-8bfb-4f7b-91c3-8dd26a9863f2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:58.835996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7647b7-8bfb-4f7b-91c3-8dd26a9863f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:58.836285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7647b7-8bfb-4f7b-91c3-8dd26a9863f2 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:58.837031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7647b7-8bfb-4f7b-91c3-8dd26a9863f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:58.837784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7647b7-8bfb-4f7b-91c3-8dd26a9863f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:58.838746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7647b7-8bfb-4f7b-91c3-8dd26a9863f2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:58.850026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 498/997] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:12:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:58.851293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7647b7-8bfb-4f7b-91c3-8dd26a9863f2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:58.892473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef2a03-945d-418d-97df-349c454c1fda None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:58.932918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5acba-6776-4e4d-8915-c92e35939584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:58.933943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5acba-6776-4e4d-8915-c92e35939584 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:58.934242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5acba-6776-4e4d-8915-c92e35939584 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:58.934528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5acba-6776-4e4d-8915-c92e35939584 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:58.935708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5acba-6776-4e4d-8915-c92e35939584 None admin] RBAC: Adding query filter params (name=image) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:58.936024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5acba-6776-4e4d-8915-c92e35939584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:58.937767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5acba-6776-4e4d-8915-c92e35939584 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:58.949873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 500/998] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:12:58.951238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5acba-6776-4e4d-8915-c92e35939584 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:58.994838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7647b7-8bfb-4f7b-91c3-8dd26a9863f2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:59.023281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:59.060757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3acb7a-e515-475a-9e0d-057d0cad8f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:59.061985 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3acb7a-e515-475a-9e0d-057d0cad8f79 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:59.065869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3acb7a-e515-475a-9e0d-057d0cad8f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:59.065869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3acb7a-e515-475a-9e0d-057d0cad8f79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:59.065869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3acb7a-e515-475a-9e0d-057d0cad8f79 None admin] RBAC: Adding query filter params (interface=public, service_id=2e1463463cfd4359a8f86768368fbcbf, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:59.065869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3acb7a-e515-475a-9e0d-057d0cad8f79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:59.067004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3acb7a-e515-475a-9e0d-057d0cad8f79 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:59.076324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 499/999] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Jul 15 15:12:58 2022] GET /identity/v3/endpoints?service_id=2e1463463cfd4359a8f86768368fbcbf&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:59.085397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3acb7a-e515-475a-9e0d-057d0cad8f79 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:12:59.092677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5acba-6776-4e4d-8915-c92e35939584 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:59.137872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:12:59.139953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12865779-873a-483c-a9d8-b6af38e90f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:59.141120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12865779-873a-483c-a9d8-b6af38e90f14 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:59.141544 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12865779-873a-483c-a9d8-b6af38e90f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:59.141835 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12865779-873a-483c-a9d8-b6af38e90f14 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:59.142634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12865779-873a-483c-a9d8-b6af38e90f14 None admin] RBAC: Adding query filter params (type=image) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:12:59.142891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12865779-873a-483c-a9d8-b6af38e90f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:59.144724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12865779-873a-483c-a9d8-b6af38e90f14 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:59.150328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 501/1000] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:12:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:12:59.235790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3acb7a-e515-475a-9e0d-057d0cad8f79 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:12:59.279728 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083baa7f-bad4-4b97-b060-649cfd72d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:12:59.280436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083baa7f-bad4-4b97-b060-649cfd72d6dd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:59.280729 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083baa7f-bad4-4b97-b060-649cfd72d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:59.280985 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083baa7f-bad4-4b97-b060-649cfd72d6dd None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:59.282114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083baa7f-bad4-4b97-b060-649cfd72d6dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:12:59.283599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083baa7f-bad4-4b97-b060-649cfd72d6dd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:12:59.291256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 500/1001] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Jul 15 15:12:59 2022] GET /identity/v3/services => generated 1727 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:12:59.941174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9360a-85a8-4f37-9bde-0658122d9669 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:59.941688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9360a-85a8-4f37-9bde-0658122d9669 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:59.941688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9360a-85a8-4f37-9bde-0658122d9669 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:59.943112 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 502/1002] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:12:59.948568 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e6318-cfb6-474a-ba21-775138c2aee4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:12:59.948858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e6318-cfb6-474a-ba21-775138c2aee4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:12:59.949173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e6318-cfb6-474a-ba21-775138c2aee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:12:59.970463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a77e6318-cfb6-474a-ba21-775138c2aee4 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:12:59.971684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a77e6318-cfb6-474a-ba21-775138c2aee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:00.068185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 501/1003] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:12:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:00.091688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9360a-85a8-4f37-9bde-0658122d9669 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:00.226493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9360a-85a8-4f37-9bde-0658122d9669 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:00.262486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:00.277688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bf328-1dd7-4152-af2b-31d2983c4ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:00.278521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bf328-1dd7-4152-af2b-31d2983c4ada None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:00.278811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bf328-1dd7-4152-af2b-31d2983c4ada None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:00.279094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bf328-1dd7-4152-af2b-31d2983c4ada None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:00.279768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bf328-1dd7-4152-af2b-31d2983c4ada None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:00.281944 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bf328-1dd7-4152-af2b-31d2983c4ada None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2f8bf328-1dd7-4152-af2b-31d2983c4ada None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:00.296375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:00.297687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:00.304235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 503/1004] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Jul 15 15:13:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:00.305184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e6318-cfb6-474a-ba21-775138c2aee4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:00.352133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:00.445159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e6318-cfb6-474a-ba21-775138c2aee4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:00.485532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dbfbe-1a1d-420d-8370-06e6ef750005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:00.486147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dbfbe-1a1d-420d-8370-06e6ef750005 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:00.486435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dbfbe-1a1d-420d-8370-06e6ef750005 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:00.486716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dbfbe-1a1d-420d-8370-06e6ef750005 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:00.487453 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dbfbe-1a1d-420d-8370-06e6ef750005 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:00.487771 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dbfbe-1a1d-420d-8370-06e6ef750005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:00.489263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dbfbe-1a1d-420d-8370-06e6ef750005 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:00.501605 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 502/1005] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Jul 15 15:13:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:00.502912 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bf328-1dd7-4152-af2b-31d2983c4ada None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:00.632995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bf328-1dd7-4152-af2b-31d2983c4ada None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:00.681599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791dd61-a25a-45e6-88f2-4ad245fc8655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:00.682282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791dd61-a25a-45e6-88f2-4ad245fc8655 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:00.682569 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791dd61-a25a-45e6-88f2-4ad245fc8655 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:00.682850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791dd61-a25a-45e6-88f2-4ad245fc8655 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:00.683589 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791dd61-a25a-45e6-88f2-4ad245fc8655 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:00.683902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791dd61-a25a-45e6-88f2-4ad245fc8655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:00.685450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791dd61-a25a-45e6-88f2-4ad245fc8655 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:00.691951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 504/1006] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Jul 15 15:13:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:00.697601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dbfbe-1a1d-420d-8370-06e6ef750005 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:00.808067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:00.815722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dbfbe-1a1d-420d-8370-06e6ef750005 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:00.857795 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0502a-1285-4c5a-9f60-63ffe572c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:00.858508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0502a-1285-4c5a-9f60-63ffe572c80f None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:00.858794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0502a-1285-4c5a-9f60-63ffe572c80f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:00.859078 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0502a-1285-4c5a-9f60-63ffe572c80f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:00.859896 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0502a-1285-4c5a-9f60-63ffe572c80f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:00.861292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0502a-1285-4c5a-9f60-63ffe572c80f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:00.880587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 503/1007] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Jul 15 15:13:00 2022] POST /identity/v3/endpoints => generated 325 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:13:01.433455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34030-e2aa-42f9-ab7e-a6cfaae4b2a3 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:01.434286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34030-e2aa-42f9-ab7e-a6cfaae4b2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:01.434286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34030-e2aa-42f9-ab7e-a6cfaae4b2a3 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:01.435415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 505/1008] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:01.442145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dba00-9ba9-407c-a9c8-3cf1f724499d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:01.442643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dba00-9ba9-407c-a9c8-3cf1f724499d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:01.442743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dba00-9ba9-407c-a9c8-3cf1f724499d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:01.464069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-926dba00-9ba9-407c-a9c8-3cf1f724499d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:01.465319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-926dba00-9ba9-407c-a9c8-3cf1f724499d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:01.521092 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e1e98-1c5a-4272-90cc-d97adcd96b90 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:01.521494 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e1e98-1c5a-4272-90cc-d97adcd96b90 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:01.521849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e1e98-1c5a-4272-90cc-d97adcd96b90 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:01.523339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 506/1009] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:13:01.528866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733337f9-65c9-49d3-8f65-d3815e25e885 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:01.529187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733337f9-65c9-49d3-8f65-d3815e25e885 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:01.529482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733337f9-65c9-49d3-8f65-d3815e25e885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:01.552828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-733337f9-65c9-49d3-8f65-d3815e25e885 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:01.554205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-733337f9-65c9-49d3-8f65-d3815e25e885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:01.560923 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 504/1010] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:01 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:01.583788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dba00-9ba9-407c-a9c8-3cf1f724499d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:01.621895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:01.651107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 507/1011] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:01 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:13:01.675043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733337f9-65c9-49d3-8f65-d3815e25e885 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:01.698703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:01.731326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dba00-9ba9-407c-a9c8-3cf1f724499d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:01.783296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9de646-6349-42b8-9416-ed8810cd30ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:01.784054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9de646-6349-42b8-9416-ed8810cd30ec None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:01.784344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9de646-6349-42b8-9416-ed8810cd30ec None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:01.784625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9de646-6349-42b8-9416-ed8810cd30ec None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:01.785403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9de646-6349-42b8-9416-ed8810cd30ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:01.786897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9de646-6349-42b8-9416-ed8810cd30ec None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:01.807413 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 505/1012] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:13:01 2022] POST /identity/v3/services => generated 242 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:13:01.822354 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733337f9-65c9-49d3-8f65-d3815e25e885 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:01.887716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556214da-8471-4328-bea8-f8e8c004f2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:01.888549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556214da-8471-4328-bea8-f8e8c004f2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:01.888834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556214da-8471-4328-bea8-f8e8c004f2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:01.889143 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556214da-8471-4328-bea8-f8e8c004f2b9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:01.890527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556214da-8471-4328-bea8-f8e8c004f2b9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:01.891973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556214da-8471-4328-bea8-f8e8c004f2b9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-556214da-8471-4328-bea8-f8e8c004f2b9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:01.905008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:01.907617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:01.909684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 508/1013] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:13:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:13:01.912634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9de646-6349-42b8-9416-ed8810cd30ec None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:02.068389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9de646-6349-42b8-9416-ed8810cd30ec None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:02.119779 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a45226-6e07-46e5-9235-515db0114948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:02.120485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a45226-6e07-46e5-9235-515db0114948 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:02.120774 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a45226-6e07-46e5-9235-515db0114948 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:02.121052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a45226-6e07-46e5-9235-515db0114948 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:02.121827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a45226-6e07-46e5-9235-515db0114948 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:02.122138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a45226-6e07-46e5-9235-515db0114948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:02.123609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a45226-6e07-46e5-9235-515db0114948 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:02.137102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 506/1014] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:13:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:02.140542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556214da-8471-4328-bea8-f8e8c004f2b9 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:02.201019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:02.271255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556214da-8471-4328-bea8-f8e8c004f2b9 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:02.308800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aef8c5-24e1-429e-93ed-657e686795b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:02.309519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aef8c5-24e1-429e-93ed-657e686795b1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:02.309806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aef8c5-24e1-429e-93ed-657e686795b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:02.310087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aef8c5-24e1-429e-93ed-657e686795b1 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:02.310860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aef8c5-24e1-429e-93ed-657e686795b1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:02.311180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aef8c5-24e1-429e-93ed-657e686795b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:02.312706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aef8c5-24e1-429e-93ed-657e686795b1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:02.319017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 509/1015] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Jul 15 15:13:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:02.326185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a45226-6e07-46e5-9235-515db0114948 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:02.337584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:02.460404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a45226-6e07-46e5-9235-515db0114948 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:02.504484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d331d3-3d29-4f16-955e-47f4b5b7d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:02.505338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d331d3-3d29-4f16-955e-47f4b5b7d526 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:02.505761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d331d3-3d29-4f16-955e-47f4b5b7d526 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:02.507760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d331d3-3d29-4f16-955e-47f4b5b7d526 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:02.507760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d331d3-3d29-4f16-955e-47f4b5b7d526 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:02.508737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d331d3-3d29-4f16-955e-47f4b5b7d526 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:02.537114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 507/1016] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Jul 15 15:13:02 2022] POST /identity/v3/endpoints => generated 334 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:13:03.138886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52af9c-c3c0-4d21-845b-363836ab92dd None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:03.139458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52af9c-c3c0-4d21-845b-363836ab92dd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:03.139458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52af9c-c3c0-4d21-845b-363836ab92dd None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:03.141035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 510/1017] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:03.146605 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a070a-ee3b-4f05-9856-511bb7230d50 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:03.146926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a070a-ee3b-4f05-9856-511bb7230d50 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:03.147183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a070a-ee3b-4f05-9856-511bb7230d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:03.167581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-076a070a-ee3b-4f05-9856-511bb7230d50 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:03.168811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-076a070a-ee3b-4f05-9856-511bb7230d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:03.244188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:03.275046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 508/1018] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:03.299866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52af9c-c3c0-4d21-845b-363836ab92dd None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:03.449212 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52af9c-c3c0-4d21-845b-363836ab92dd None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:03.457860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:03.500230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0e7d7-5e29-4ac0-9087-1c8a3a700fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:03.501094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0e7d7-5e29-4ac0-9087-1c8a3a700fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:03.501438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0e7d7-5e29-4ac0-9087-1c8a3a700fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:03.501717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0e7d7-5e29-4ac0-9087-1c8a3a700fd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:03.503277 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0e7d7-5e29-4ac0-9087-1c8a3a700fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:03.504878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0e7d7-5e29-4ac0-9087-1c8a3a700fd4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:03.507028 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 511/1019] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:03.513211 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a070a-ee3b-4f05-9856-511bb7230d50 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:03.641265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a070a-ee3b-4f05-9856-511bb7230d50 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:03.687181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a850d9-3fae-4c8a-b936-160ef31c94d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:03.687869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a850d9-3fae-4c8a-b936-160ef31c94d9 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:03.688153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a850d9-3fae-4c8a-b936-160ef31c94d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:03.688428 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a850d9-3fae-4c8a-b936-160ef31c94d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:03.689204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a850d9-3fae-4c8a-b936-160ef31c94d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:03.690679 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a850d9-3fae-4c8a-b936-160ef31c94d9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:03.721794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 509/1020] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:13:03 2022] POST /identity/v3/projects => generated 311 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:13:04.048287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6512b-794a-43db-81bc-0fc6a62a4c25 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:04.048482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6512b-794a-43db-81bc-0fc6a62a4c25 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:04.048816 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6512b-794a-43db-81bc-0fc6a62a4c25 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:04.050575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 512/1021] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:04.056139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7385c-bda7-4f65-aaee-f2394801c684 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:04.056434 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7385c-bda7-4f65-aaee-f2394801c684 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:04.056713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7385c-bda7-4f65-aaee-f2394801c684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:04.075884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f6d7385c-bda7-4f65-aaee-f2394801c684 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:04.077272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f6d7385c-bda7-4f65-aaee-f2394801c684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:04.124612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:04.189114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 510/1022] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:04.209166 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6512b-794a-43db-81bc-0fc6a62a4c25 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:04.332329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6512b-794a-43db-81bc-0fc6a62a4c25 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:04.372786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408ee98-266c-4e04-9037-26a3f1523ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:04.373642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408ee98-266c-4e04-9037-26a3f1523ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:04.374018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408ee98-266c-4e04-9037-26a3f1523ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:04.374294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408ee98-266c-4e04-9037-26a3f1523ef7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:04.374953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408ee98-266c-4e04-9037-26a3f1523ef7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:04.376327 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408ee98-266c-4e04-9037-26a3f1523ef7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-4408ee98-266c-4e04-9037-26a3f1523ef7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:04.388887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:04.390707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:13:04.391587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:04.393409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 513/1023] 10.222.0.64 () {56 vars in 1105 bytes} [Fri Jul 15 15:13:04 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:04.396783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7385c-bda7-4f65-aaee-f2394801c684 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:04.513948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7385c-bda7-4f65-aaee-f2394801c684 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:04.553208 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511616a-43fc-4ca2-bcb9-9ca19d474d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:04.553896 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511616a-43fc-4ca2-bcb9-9ca19d474d86 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:04.554185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511616a-43fc-4ca2-bcb9-9ca19d474d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:04.554469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511616a-43fc-4ca2-bcb9-9ca19d474d86 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:04.555201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511616a-43fc-4ca2-bcb9-9ca19d474d86 None admin] RBAC: Adding query filter params (name=image) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:04.555515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511616a-43fc-4ca2-bcb9-9ca19d474d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:04.556965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511616a-43fc-4ca2-bcb9-9ca19d474d86 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:04.562868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 511/1024] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:04.568518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408ee98-266c-4e04-9037-26a3f1523ef7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:04.622246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:04.693206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408ee98-266c-4e04-9037-26a3f1523ef7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:04.730224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991ff8f-103f-403c-a801-f8d7d1df8d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:04.731036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991ff8f-103f-403c-a801-f8d7d1df8d07 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:04.731454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991ff8f-103f-403c-a801-f8d7d1df8d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:04.731847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991ff8f-103f-403c-a801-f8d7d1df8d07 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:04.732936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991ff8f-103f-403c-a801-f8d7d1df8d07 None admin] RBAC: Adding query filter params (type=image) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:04.734057 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991ff8f-103f-403c-a801-f8d7d1df8d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:04.736300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991ff8f-103f-403c-a801-f8d7d1df8d07 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:04.750171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 514/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:04.751572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511616a-43fc-4ca2-bcb9-9ca19d474d86 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:04.792302 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:04.868384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511616a-43fc-4ca2-bcb9-9ca19d474d86 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:04.916140 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bc5f4-8cb3-4ddb-b747-b1b1c1b70ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:04.916834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bc5f4-8cb3-4ddb-b747-b1b1c1b70ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:04.917150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bc5f4-8cb3-4ddb-b747-b1b1c1b70ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:04.917434 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bc5f4-8cb3-4ddb-b747-b1b1c1b70ea0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:04.918308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bc5f4-8cb3-4ddb-b747-b1b1c1b70ea0 None admin] RBAC: Adding query filter params (interface=public, service_id=20a4c3d1ae424a9a9dff082b4ea4b98e, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:04.918587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bc5f4-8cb3-4ddb-b747-b1b1c1b70ea0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:04.920015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bc5f4-8cb3-4ddb-b747-b1b1c1b70ea0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:04.930516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 512/1026] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Jul 15 15:13:04 2022] GET /identity/v3/endpoints?service_id=20a4c3d1ae424a9a9dff082b4ea4b98e&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:04.930738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7577-c84b-4ca9-b6cf-c821d3f10cb3 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:04.930738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7577-c84b-4ca9-b6cf-c821d3f10cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:04.930738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7577-c84b-4ca9-b6cf-c821d3f10cb3 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:04.931361 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 515/1027] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:04.931538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bc5f4-8cb3-4ddb-b747-b1b1c1b70ea0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:04.937199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95411c-eb40-43f8-a17a-0cec7a3077dd None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:04.937496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95411c-eb40-43f8-a17a-0cec7a3077dd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:04.937782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95411c-eb40-43f8-a17a-0cec7a3077dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:04.955374 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ab95411c-eb40-43f8-a17a-0cec7a3077dd None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:04.956595 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ab95411c-eb40-43f8-a17a-0cec7a3077dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:05.042413 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 516/1028] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:13:05.060031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95411c-eb40-43f8-a17a-0cec7a3077dd None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:05.069404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:05.073637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bc5f4-8cb3-4ddb-b747-b1b1c1b70ea0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:05.094669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:05.112551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad05cbf-dc95-43c4-99c0-c1565d0bb818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:05.113620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad05cbf-dc95-43c4-99c0-c1565d0bb818 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:05.113908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad05cbf-dc95-43c4-99c0-c1565d0bb818 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:05.114188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad05cbf-dc95-43c4-99c0-c1565d0bb818 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:05.114892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad05cbf-dc95-43c4-99c0-c1565d0bb818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:05.116290 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad05cbf-dc95-43c4-99c0-c1565d0bb818 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:05.123533 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 513/1029] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Jul 15 15:13:04 2022] GET /identity/v3/services => generated 1957 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:13:05.213821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95411c-eb40-43f8-a17a-0cec7a3077dd None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:05.271470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf71777-224c-4a74-b8d8-02ea828818ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:05.272822 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf71777-224c-4a74-b8d8-02ea828818ba None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:05.273295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf71777-224c-4a74-b8d8-02ea828818ba None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:05.273763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf71777-224c-4a74-b8d8-02ea828818ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:05.294196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf71777-224c-4a74-b8d8-02ea828818ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2cf71777-224c-4a74-b8d8-02ea828818ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:13:05.306672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:05.308579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:05.311081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 517/1030] 10.222.0.64 () {56 vars in 1120 bytes} [Fri Jul 15 15:13:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:13:05.317722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad05cbf-dc95-43c4-99c0-c1565d0bb818 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:05.442897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad05cbf-dc95-43c4-99c0-c1565d0bb818 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:05.491995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26421fd2-30f1-486e-8f25-c1ad4b3c44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:05.493593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26421fd2-30f1-486e-8f25-c1ad4b3c44dc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:05.494274 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26421fd2-30f1-486e-8f25-c1ad4b3c44dc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:05.494955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26421fd2-30f1-486e-8f25-c1ad4b3c44dc None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:05.496406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26421fd2-30f1-486e-8f25-c1ad4b3c44dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:05.497131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26421fd2-30f1-486e-8f25-c1ad4b3c44dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:05.499671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26421fd2-30f1-486e-8f25-c1ad4b3c44dc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:05.513108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 514/1031] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Jul 15 15:13:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:05.519121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf71777-224c-4a74-b8d8-02ea828818ba None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:05.625901 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:05.638498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf71777-224c-4a74-b8d8-02ea828818ba None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:05.676198 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4e7a6-39a0-4476-8230-51922970a1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:05.677002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4e7a6-39a0-4476-8230-51922970a1dc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:05.677316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4e7a6-39a0-4476-8230-51922970a1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:05.677599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4e7a6-39a0-4476-8230-51922970a1dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:05.690433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4e7a6-39a0-4476-8230-51922970a1dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:05.691917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4e7a6-39a0-4476-8230-51922970a1dc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-0da4e7a6-39a0-4476-8230-51922970a1dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:13:05.712985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:05.714844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:05.716417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:13:05.716417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:13:05.716417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:05.716417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:05.719176 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 518/1032] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:05.721048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26421fd2-30f1-486e-8f25-c1ad4b3c44dc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:05.760714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:05.849416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26421fd2-30f1-486e-8f25-c1ad4b3c44dc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:05.887564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c41ef6-ad8f-4da6-b798-76f8bb3e301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:05.888235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c41ef6-ad8f-4da6-b798-76f8bb3e301d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:05.888521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c41ef6-ad8f-4da6-b798-76f8bb3e301d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:05.888796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c41ef6-ad8f-4da6-b798-76f8bb3e301d None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:05.889582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c41ef6-ad8f-4da6-b798-76f8bb3e301d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:05.889889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c41ef6-ad8f-4da6-b798-76f8bb3e301d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:05.891265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c41ef6-ad8f-4da6-b798-76f8bb3e301d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:05.904411 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 515/1033] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:05.910659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4e7a6-39a0-4476-8230-51922970a1dc None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:06.032706 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4aafa-d1f1-4edf-a2c1-10de3e489fbf None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:06.033161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4aafa-d1f1-4edf-a2c1-10de3e489fbf None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:06.033645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4aafa-d1f1-4edf-a2c1-10de3e489fbf None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:06.035998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4e7a6-39a0-4476-8230-51922970a1dc None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:06.037114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 516/1034] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:06.041572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd6c1d-609d-4e67-80b3-74a37afb6e38 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:06.041859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd6c1d-609d-4e67-80b3-74a37afb6e38 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:06.042143 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd6c1d-609d-4e67-80b3-74a37afb6e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:06.059126 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a2cd6c1d-609d-4e67-80b3-74a37afb6e38 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:06.060325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a2cd6c1d-609d-4e67-80b3-74a37afb6e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:06.081598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af28aa5-393c-49e3-b1aa-f1c881a46da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:06.082401 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af28aa5-393c-49e3-b1aa-f1c881a46da2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:06.082687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af28aa5-393c-49e3-b1aa-f1c881a46da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:06.083019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af28aa5-393c-49e3-b1aa-f1c881a46da2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:06.091444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af28aa5-393c-49e3-b1aa-f1c881a46da2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:06.092936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af28aa5-393c-49e3-b1aa-f1c881a46da2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-1af28aa5-393c-49e3-b1aa-f1c881a46da2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:13:06.108779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:06.109931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:06.111083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:06.111083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:06.111083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:13:06.111083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:13:06.111083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:13:06.111083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:13:06.111083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:13:06.111083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:13:06.111083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:13:06.111083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:06.115005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 519/1035] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Jul 15 15:13:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:13:06.117581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af28aa5-393c-49e3-b1aa-f1c881a46da2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:06.121261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:06.165982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 517/1036] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:13:06.191989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd6c1d-609d-4e67-80b3-74a37afb6e38 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:06.207984 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:06.244147 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af28aa5-393c-49e3-b1aa-f1c881a46da2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:06.298284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9cc6c-2c18-4f99-9894-6fa0b6465dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:06.298973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9cc6c-2c18-4f99-9894-6fa0b6465dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:06.299261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9cc6c-2c18-4f99-9894-6fa0b6465dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:06.299540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9cc6c-2c18-4f99-9894-6fa0b6465dc3 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:06.300735 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9cc6c-2c18-4f99-9894-6fa0b6465dc3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:06.301048 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9cc6c-2c18-4f99-9894-6fa0b6465dc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:06.303045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9cc6c-2c18-4f99-9894-6fa0b6465dc3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:06.318577 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd6c1d-609d-4e67-80b3-74a37afb6e38 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:06.324855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 520/1037] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Jul 15 15:13:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:06.330861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9cc6c-2c18-4f99-9894-6fa0b6465dc3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:06.355958 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd626ca-a8ac-4192-a7cb-e0caf8116932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:06.356767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd626ca-a8ac-4192-a7cb-e0caf8116932 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:06.357056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd626ca-a8ac-4192-a7cb-e0caf8116932 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:06.357363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd626ca-a8ac-4192-a7cb-e0caf8116932 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:06.359158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd626ca-a8ac-4192-a7cb-e0caf8116932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:06.360636 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd626ca-a8ac-4192-a7cb-e0caf8116932 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:06.362552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 518/1038] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:06.370138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd626ca-a8ac-4192-a7cb-e0caf8116932 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:06.423751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:06.473364 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:06.474695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9cc6c-2c18-4f99-9894-6fa0b6465dc3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:06.494157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd626ca-a8ac-4192-a7cb-e0caf8116932 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:06.514585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee914f99-400c-4597-8a17-a24b3207498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:06.515249 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee914f99-400c-4597-8a17-a24b3207498d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:06.515538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee914f99-400c-4597-8a17-a24b3207498d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:06.515818 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee914f99-400c-4597-8a17-a24b3207498d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:06.538680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa1158-cdc7-4e11-b48b-7e6e9d0ed86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:06.539539 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa1158-cdc7-4e11-b48b-7e6e9d0ed86c None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:06.539870 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa1158-cdc7-4e11-b48b-7e6e9d0ed86c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:06.540194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa1158-cdc7-4e11-b48b-7e6e9d0ed86c None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:06.540978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa1158-cdc7-4e11-b48b-7e6e9d0ed86c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:06.542730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa1158-cdc7-4e11-b48b-7e6e9d0ed86c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:06.573390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 519/1039] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:13:06 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:13:06.626631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee914f99-400c-4597-8a17-a24b3207498d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:06.629710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee914f99-400c-4597-8a17-a24b3207498d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:06.710657 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:06.781353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 521/1040] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:13:06 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 15:13:06.787520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa1158-cdc7-4e11-b48b-7e6e9d0ed86c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:06.922111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa1158-cdc7-4e11-b48b-7e6e9d0ed86c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:06.960439 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6afa3-1b25-480f-b7ef-f0cb18b8f1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:06.962228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6afa3-1b25-480f-b7ef-f0cb18b8f1ca None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:06.963025 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6afa3-1b25-480f-b7ef-f0cb18b8f1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:06.963783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6afa3-1b25-480f-b7ef-f0cb18b8f1ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:06.978484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:06.987149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6afa3-1b25-480f-b7ef-f0cb18b8f1ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:06.990547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6afa3-1b25-480f-b7ef-f0cb18b8f1ca None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-15f6afa3-1b25-480f-b7ef-f0cb18b8f1ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:13:07.021615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:07.023108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:07.024010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:13:07.024010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:13:07.024010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:07.024010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:07.024836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 520/1041] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:07.034991 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee914f99-400c-4597-8a17-a24b3207498d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:07.185871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee914f99-400c-4597-8a17-a24b3207498d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:07.231370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6d4d2-b627-4404-bd01-d3e0e4ee52e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:07.232222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6d4d2-b627-4404-bd01-d3e0e4ee52e6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:07.232642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6d4d2-b627-4404-bd01-d3e0e4ee52e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:07.233289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6d4d2-b627-4404-bd01-d3e0e4ee52e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:07.234190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6d4d2-b627-4404-bd01-d3e0e4ee52e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:07.234651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6d4d2-b627-4404-bd01-d3e0e4ee52e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:07.236184 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6d4d2-b627-4404-bd01-d3e0e4ee52e6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:07.257799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 522/1042] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:07.259894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6afa3-1b25-480f-b7ef-f0cb18b8f1ca None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:07.374952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95426398-4c8e-46f8-9917-92be64f4ed9d None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:07.375250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95426398-4c8e-46f8-9917-92be64f4ed9d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:07.375595 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95426398-4c8e-46f8-9917-92be64f4ed9d None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:07.376940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 523/1043] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:13:07.383973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ce0a6-ddcf-48a2-81e1-17c8de1dbb26 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:07.384599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ce0a6-ddcf-48a2-81e1-17c8de1dbb26 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:07.385147 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ce0a6-ddcf-48a2-81e1-17c8de1dbb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:07.393590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6afa3-1b25-480f-b7ef-f0cb18b8f1ca None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:07.407904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-bf1ce0a6-ddcf-48a2-81e1-17c8de1dbb26 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:07.409153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bf1ce0a6-ddcf-48a2-81e1-17c8de1dbb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:07.432969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:07.433441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49ebd4-45e7-4dfe-801b-28e3fdde1815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:07.434451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49ebd4-45e7-4dfe-801b-28e3fdde1815 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:07.435031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49ebd4-45e7-4dfe-801b-28e3fdde1815 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:07.435248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49ebd4-45e7-4dfe-801b-28e3fdde1815 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:07.443049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49ebd4-45e7-4dfe-801b-28e3fdde1815 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:07.444688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49ebd4-45e7-4dfe-801b-28e3fdde1815 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9d49ebd4-45e7-4dfe-801b-28e3fdde1815 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:13:07.463806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:07.464981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:07.466015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:13:07.466015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:13:07.466015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:13:07.466015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:13:07.466015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:13:07.466015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:13:07.466015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:13:07.466015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:07.466015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 521/1044] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:07.471328 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49ebd4-45e7-4dfe-801b-28e3fdde1815 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:07.505643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 524/1045] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:07.529215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ce0a6-ddcf-48a2-81e1-17c8de1dbb26 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:07.542844 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:07.612629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49ebd4-45e7-4dfe-801b-28e3fdde1815 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:07.662778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2b8e7-ad86-4b5e-a25b-6e3955d14bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:07.663551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2b8e7-ad86-4b5e-a25b-6e3955d14bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:07.663831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2b8e7-ad86-4b5e-a25b-6e3955d14bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:07.664107 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2b8e7-ad86-4b5e-a25b-6e3955d14bb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:07.664266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ce0a6-ddcf-48a2-81e1-17c8de1dbb26 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:07.664954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2b8e7-ad86-4b5e-a25b-6e3955d14bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:07.665322 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2b8e7-ad86-4b5e-a25b-6e3955d14bb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:07.666789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2b8e7-ad86-4b5e-a25b-6e3955d14bb2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:07.688324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 522/1046] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:07.689559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2b8e7-ad86-4b5e-a25b-6e3955d14bb2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:07.718207 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b0c1a-98b8-4633-abc8-b8dc1b970b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:07.718907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0c1a-98b8-4633-abc8-b8dc1b970b70 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:07.719192 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0c1a-98b8-4633-abc8-b8dc1b970b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:07.719469 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0c1a-98b8-4633-abc8-b8dc1b970b70 None admin] PATH_INFO: `/v3/services/image` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:07.720129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b0c1a-98b8-4633-abc8-b8dc1b970b70 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:07.721569 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b0c1a-98b8-4633-abc8-b8dc1b970b70 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-547b0c1a-98b8-4633-abc8-b8dc1b970b70 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:07.734664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:07.735774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:13:07.736717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:07.741148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 525/1047] 10.222.0.64 () {56 vars in 1105 bytes} [Fri Jul 15 15:13:07 2022] GET /identity/v3/services/image => generated 86 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:13:07.742047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b0c1a-98b8-4633-abc8-b8dc1b970b70 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:07.765025 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:07.810532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2b8e7-ad86-4b5e-a25b-6e3955d14bb2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:07.823283 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:07.851524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75d39e-5454-43a7-b680-60efbf2c6a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:07.852286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75d39e-5454-43a7-b680-60efbf2c6a2f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:07.852644 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75d39e-5454-43a7-b680-60efbf2c6a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:07.852989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75d39e-5454-43a7-b680-60efbf2c6a2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:07.853931 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75d39e-5454-43a7-b680-60efbf2c6a2f None admin] RBAC: Adding query filter params (role.id=2f29372d0ad04535b7a8688fc0209d85, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=b022a37031b940c3bd67861373926e58) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:07.854314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75d39e-5454-43a7-b680-60efbf2c6a2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:07.855783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75d39e-5454-43a7-b680-60efbf2c6a2f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:07.858325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b0c1a-98b8-4633-abc8-b8dc1b970b70 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:07.861700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 523/1048] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:13:07 2022] GET /identity/v3/role_assignments?user.id=b022a37031b940c3bd67861373926e58&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=2f29372d0ad04535b7a8688fc0209d85 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:07.910763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e525b7c-36ff-4747-aa95-7398c005094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:07.911465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e525b7c-36ff-4747-aa95-7398c005094c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:07.911788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e525b7c-36ff-4747-aa95-7398c005094c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:07.912091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e525b7c-36ff-4747-aa95-7398c005094c None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:07.912829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e525b7c-36ff-4747-aa95-7398c005094c None admin] RBAC: Adding query filter params (name=image) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:07.913172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e525b7c-36ff-4747-aa95-7398c005094c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:07.914604 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e525b7c-36ff-4747-aa95-7398c005094c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:07.925364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 526/1049] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:07.927011 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75d39e-5454-43a7-b680-60efbf2c6a2f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:08.038022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75d39e-5454-43a7-b680-60efbf2c6a2f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:08.080272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dca0d1-a9b3-4540-ac65-9d2000e47652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:08.080949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dca0d1-a9b3-4540-ac65-9d2000e47652 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:08.081347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dca0d1-a9b3-4540-ac65-9d2000e47652 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:08.081628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dca0d1-a9b3-4540-ac65-9d2000e47652 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:08.082349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dca0d1-a9b3-4540-ac65-9d2000e47652 None admin] RBAC: Adding query filter params (type=image) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:08.082656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dca0d1-a9b3-4540-ac65-9d2000e47652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:08.084048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dca0d1-a9b3-4540-ac65-9d2000e47652 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:08.090044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 524/1050] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:08.095697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e525b7c-36ff-4747-aa95-7398c005094c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:08.202833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:08.228185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e525b7c-36ff-4747-aa95-7398c005094c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:08.278929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1b665-110c-4d7f-8ae2-1be570920a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:08.280554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1b665-110c-4d7f-8ae2-1be570920a05 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:08.281014 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1b665-110c-4d7f-8ae2-1be570920a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:08.281431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1b665-110c-4d7f-8ae2-1be570920a05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:08.282210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1b665-110c-4d7f-8ae2-1be570920a05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:08.283654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1b665-110c-4d7f-8ae2-1be570920a05 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:08.308722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 527/1051] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Jul 15 15:13:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:13:08.774615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d50187-75da-46b9-aa98-5940bd2b5bfd None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:08.774992 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d50187-75da-46b9-aa98-5940bd2b5bfd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:08.775198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d50187-75da-46b9-aa98-5940bd2b5bfd None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:08.776596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 525/1052] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:08.782007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebaf61-6942-4e8a-8b60-465caf098913 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:08.782313 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebaf61-6942-4e8a-8b60-465caf098913 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:08.782605 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebaf61-6942-4e8a-8b60-465caf098913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:08.799582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a5ebaf61-6942-4e8a-8b60-465caf098913 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:08.800791 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a5ebaf61-6942-4e8a-8b60-465caf098913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:08.876212 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 528/1053] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:08.899776 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d50187-75da-46b9-aa98-5940bd2b5bfd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:08.942751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:09.007475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d50187-75da-46b9-aa98-5940bd2b5bfd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:09.041480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c11906-7e61-4ec5-8a31-6338fc7afcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:09.042282 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c11906-7e61-4ec5-8a31-6338fc7afcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:09.042573 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c11906-7e61-4ec5-8a31-6338fc7afcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:09.042849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c11906-7e61-4ec5-8a31-6338fc7afcc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:09.055874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c11906-7e61-4ec5-8a31-6338fc7afcc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-02c11906-7e61-4ec5-8a31-6338fc7afcc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:13:09.064106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:09.065046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:09.065952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:09.065952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:09.065952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:09.065952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:09.065952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:13:09.065952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:13:09.065952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:13:09.065952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:13:09.065952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:13:09.065952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:13:09.065952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:09.065952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:09.069402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 526/1054] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:13:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:09.071548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebaf61-6942-4e8a-8b60-465caf098913 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:09.134734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:09.177459 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebaf61-6942-4e8a-8b60-465caf098913 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:09.212567 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7a769-4197-4d57-a29e-0fb3f8a3e6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:09.213288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7a769-4197-4d57-a29e-0fb3f8a3e6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:09.213580 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7a769-4197-4d57-a29e-0fb3f8a3e6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:09.213862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7a769-4197-4d57-a29e-0fb3f8a3e6d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:09.214639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7a769-4197-4d57-a29e-0fb3f8a3e6d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:09.214952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7a769-4197-4d57-a29e-0fb3f8a3e6d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:09.216385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7a769-4197-4d57-a29e-0fb3f8a3e6d3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:09.226881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 529/1055] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:09.232754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c11906-7e61-4ec5-8a31-6338fc7afcc2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:09.336055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:09.340869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c11906-7e61-4ec5-8a31-6338fc7afcc2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:09.375672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2b882-eca7-448f-8c97-25333b0908bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:09.376545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2b882-eca7-448f-8c97-25333b0908bd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:09.376833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2b882-eca7-448f-8c97-25333b0908bd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:09.377138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2b882-eca7-448f-8c97-25333b0908bd None admin] PATH_INFO: `/v3/users/e1c2e7b59780464788fcae00c702ef51` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:09.391899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2b882-eca7-448f-8c97-25333b0908bd None admin] RBAC: Authorizing `identity:get_user(user_id=e1c2e7b59780464788fcae00c702ef51)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:09.393855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2b882-eca7-448f-8c97-25333b0908bd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:09.401122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 527/1056] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:09 2022] GET /identity/v3/users/e1c2e7b59780464788fcae00c702ef51 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:09.403936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7a769-4197-4d57-a29e-0fb3f8a3e6d3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:09.511575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7a769-4197-4d57-a29e-0fb3f8a3e6d3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:09.535383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:09.547517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57886915-b718-41b5-9a9b-cdb4f09940f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:09.548177 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57886915-b718-41b5-9a9b-cdb4f09940f3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:09.548463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57886915-b718-41b5-9a9b-cdb4f09940f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:09.548743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57886915-b718-41b5-9a9b-cdb4f09940f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:09.620517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57886915-b718-41b5-9a9b-cdb4f09940f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:09.622330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57886915-b718-41b5-9a9b-cdb4f09940f3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:09.730443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 530/1057] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:13:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 15:13:09.736264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2b882-eca7-448f-8c97-25333b0908bd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:09.838865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2b882-eca7-448f-8c97-25333b0908bd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:09.872797 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f78e27-4984-4401-8de5-63d7a857b4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:09.873732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78e27-4984-4401-8de5-63d7a857b4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:09.874016 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78e27-4984-4401-8de5-63d7a857b4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:09.874309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78e27-4984-4401-8de5-63d7a857b4d8 None admin] PATH_INFO: `/v3/projects/9f54183ecc36487cbea9a86bbedb3427` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:09.875503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f78e27-4984-4401-8de5-63d7a857b4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=9f54183ecc36487cbea9a86bbedb3427)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:09.876941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f78e27-4984-4401-8de5-63d7a857b4d8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:09.884012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 528/1058] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:13:09 2022] GET /identity/v3/projects/9f54183ecc36487cbea9a86bbedb3427 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:09.884998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57886915-b718-41b5-9a9b-cdb4f09940f3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:09.910325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:09.993546 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57886915-b718-41b5-9a9b-cdb4f09940f3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:10.040170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9efab-963f-4270-b214-3eda9f6e0421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:10.040920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9efab-963f-4270-b214-3eda9f6e0421 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:10.041346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9efab-963f-4270-b214-3eda9f6e0421 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:10.041704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9efab-963f-4270-b214-3eda9f6e0421 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:10.042612 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9efab-963f-4270-b214-3eda9f6e0421 None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=9f54183ecc36487cbea9a86bbedb3427, user.id=e1c2e7b59780464788fcae00c702ef51) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:10.042988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9efab-963f-4270-b214-3eda9f6e0421 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:10.044496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9efab-963f-4270-b214-3eda9f6e0421 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:10.050701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 531/1059] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:13:09 2022] GET /identity/v3/role_assignments?user.id=e1c2e7b59780464788fcae00c702ef51&scope.project.id=9f54183ecc36487cbea9a86bbedb3427&role.id=87593f63c4744eac870c07b006022e77 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:10.397709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dee3e-b3b7-4f12-a618-7e0091f8a194 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:10.398256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dee3e-b3b7-4f12-a618-7e0091f8a194 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:10.398256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dee3e-b3b7-4f12-a618-7e0091f8a194 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:10.399848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 529/1060] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:10.405952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cebbe3-759e-443a-8cb9-e057767738a6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:10.406395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cebbe3-759e-443a-8cb9-e057767738a6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:10.406600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cebbe3-759e-443a-8cb9-e057767738a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:10.423199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-28cebbe3-759e-443a-8cb9-e057767738a6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:10.424409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-28cebbe3-759e-443a-8cb9-e057767738a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:10.492289 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd9b33-cc53-48b6-bec4-82d8591b8419 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:10.492670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd9b33-cc53-48b6-bec4-82d8591b8419 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:10.493021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd9b33-cc53-48b6-bec4-82d8591b8419 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:10.494515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 530/1061] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:13:10.500804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f94a7-de6a-461b-86b5-d686965076f1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:10.501114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f94a7-de6a-461b-86b5-d686965076f1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:10.501404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f94a7-de6a-461b-86b5-d686965076f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:10.517121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 532/1062] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:10.522101 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-551f94a7-de6a-461b-86b5-d686965076f1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:10.523320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-551f94a7-de6a-461b-86b5-d686965076f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:10.538172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cebbe3-759e-443a-8cb9-e057767738a6 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:10.542591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:10.564021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:10.633105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 531/1063] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:10.651719 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f94a7-de6a-461b-86b5-d686965076f1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:10.689944 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cebbe3-759e-443a-8cb9-e057767738a6 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:10.747874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52223e96-1847-4b30-89d9-d11824791fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:10.748563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52223e96-1847-4b30-89d9-d11824791fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:10.748852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52223e96-1847-4b30-89d9-d11824791fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:10.749239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52223e96-1847-4b30-89d9-d11824791fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:10.798907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f94a7-de6a-461b-86b5-d686965076f1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:10.846346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a2b02-e204-4bf6-8911-4235a32a0831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:10.847165 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a2b02-e204-4bf6-8911-4235a32a0831 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:10.847450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a2b02-e204-4bf6-8911-4235a32a0831 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:10.847732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a2b02-e204-4bf6-8911-4235a32a0831 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:10.849036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52223e96-1847-4b30-89d9-d11824791fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:10.851635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52223e96-1847-4b30-89d9-d11824791fa1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:10.859198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a2b02-e204-4bf6-8911-4235a32a0831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-506a2b02-e204-4bf6-8911-4235a32a0831 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:13:10.867351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:10.868506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:10.869471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 532/1064] 10.222.0.64 () {56 vars in 1120 bytes} [Fri Jul 15 15:13:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:13:10.878239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a2b02-e204-4bf6-8911-4235a32a0831 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:10.882422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:10.901562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:10.981959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 533/1065] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:13:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 15:13:10.989282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52223e96-1847-4b30-89d9-d11824791fa1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:11.008077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a2b02-e204-4bf6-8911-4235a32a0831 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:11.044502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de392d-e412-4d23-910b-3f63eee5ad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:11.045268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de392d-e412-4d23-910b-3f63eee5ad6d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:11.046068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de392d-e412-4d23-910b-3f63eee5ad6d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:11.046349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de392d-e412-4d23-910b-3f63eee5ad6d None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:11.047114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de392d-e412-4d23-910b-3f63eee5ad6d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:11.047453 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de392d-e412-4d23-910b-3f63eee5ad6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:11.048826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de392d-e412-4d23-910b-3f63eee5ad6d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:11.062156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 533/1066] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Jul 15 15:13:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:11.063240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de392d-e412-4d23-910b-3f63eee5ad6d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:11.110585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52223e96-1847-4b30-89d9-d11824791fa1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:11.130131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:11.147910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:11.151550 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d15ba1-7f09-46e3-aa82-4deb41c6d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:11.152394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d15ba1-7f09-46e3-aa82-4deb41c6d316 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:11.152649 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d15ba1-7f09-46e3-aa82-4deb41c6d316 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:11.152930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d15ba1-7f09-46e3-aa82-4deb41c6d316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:11.165760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d15ba1-7f09-46e3-aa82-4deb41c6d316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:11.167274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d15ba1-7f09-46e3-aa82-4deb41c6d316 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:11.174725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de392d-e412-4d23-910b-3f63eee5ad6d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-49d15ba1-7f09-46e3-aa82-4deb41c6d316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:13:11.186170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:11.187114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:11.188041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:13:11.188041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:13:11.188041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:11.188041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:11.189638 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 534/1067] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:13:11.195543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d15ba1-7f09-46e3-aa82-4deb41c6d316 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:11.211707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6109e-78ec-42da-93df-afc68b6826df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:11.212536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6109e-78ec-42da-93df-afc68b6826df None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:11.212821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6109e-78ec-42da-93df-afc68b6826df None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:11.213124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6109e-78ec-42da-93df-afc68b6826df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:11.226694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6109e-78ec-42da-93df-afc68b6826df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:11.228159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6109e-78ec-42da-93df-afc68b6826df None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-50a6109e-78ec-42da-93df-afc68b6826df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:13:11.248501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:11.249513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:11.250396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:13:11.250396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:13:11.250396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:11.250396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:11.250396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 534/1068] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:11.254603 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6109e-78ec-42da-93df-afc68b6826df None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:11.331349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d15ba1-7f09-46e3-aa82-4deb41c6d316 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:11.369412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6109e-78ec-42da-93df-afc68b6826df None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:11.370027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c3c19-443b-4cb8-becc-eb4ebdade783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:11.371085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c3c19-443b-4cb8-becc-eb4ebdade783 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:11.371701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c3c19-443b-4cb8-becc-eb4ebdade783 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:11.372051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c3c19-443b-4cb8-becc-eb4ebdade783 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:11.372883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c3c19-443b-4cb8-becc-eb4ebdade783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:11.373224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c3c19-443b-4cb8-becc-eb4ebdade783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:11.374624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c3c19-443b-4cb8-becc-eb4ebdade783 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:11.388235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 535/1069] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:11.397912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:11.407112 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d3c81-13f4-40f5-bf65-94da4e7c4598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:11.407811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d3c81-13f4-40f5-bf65-94da4e7c4598 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:11.408096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d3c81-13f4-40f5-bf65-94da4e7c4598 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:11.408374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d3c81-13f4-40f5-bf65-94da4e7c4598 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:11.409159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d3c81-13f4-40f5-bf65-94da4e7c4598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:11.409472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d3c81-13f4-40f5-bf65-94da4e7c4598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:11.410919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d3c81-13f4-40f5-bf65-94da4e7c4598 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:11.429773 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 535/1070] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:11.431569 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c3c19-443b-4cb8-becc-eb4ebdade783 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:11.468033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:11.554381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c3c19-443b-4cb8-becc-eb4ebdade783 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:11.592652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c73e5a-4d0f-4e0b-aa49-9b5b7059597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:11.593494 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73e5a-4d0f-4e0b-aa49-9b5b7059597b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:11.593777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73e5a-4d0f-4e0b-aa49-9b5b7059597b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:11.594052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73e5a-4d0f-4e0b-aa49-9b5b7059597b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:11.609231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c73e5a-4d0f-4e0b-aa49-9b5b7059597b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:11.610713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c73e5a-4d0f-4e0b-aa49-9b5b7059597b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-d7c73e5a-4d0f-4e0b-aa49-9b5b7059597b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:13:11.626509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:11.627956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:11.629039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:11.629039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:11.629039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:13:11.629039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:13:11.629039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:13:11.629039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:13:11.629039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:13:11.629039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:13:11.629039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:13:11.629039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:11.630505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 536/1071] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Jul 15 15:13:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:13:11.636731 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d3c81-13f4-40f5-bf65-94da4e7c4598 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:11.747035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d3c81-13f4-40f5-bf65-94da4e7c4598 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:11.781757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42433d2-302d-4945-a60c-f319d5d8ed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:11.782448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42433d2-302d-4945-a60c-f319d5d8ed0f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:11.782736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42433d2-302d-4945-a60c-f319d5d8ed0f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:11.783016 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42433d2-302d-4945-a60c-f319d5d8ed0f None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:11.783995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42433d2-302d-4945-a60c-f319d5d8ed0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:11.784314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42433d2-302d-4945-a60c-f319d5d8ed0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:11.785841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42433d2-302d-4945-a60c-f319d5d8ed0f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:11.812041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 536/1072] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Jul 15 15:13:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:11.817924 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c73e5a-4d0f-4e0b-aa49-9b5b7059597b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:11.916222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:11.926858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c73e5a-4d0f-4e0b-aa49-9b5b7059597b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:11.966593 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a2e1-2e31-409a-b4c4-6dce76948e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:11.967952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a2e1-2e31-409a-b4c4-6dce76948e59 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:11.968236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a2e1-2e31-409a-b4c4-6dce76948e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:11.968515 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a2e1-2e31-409a-b4c4-6dce76948e59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:11.982154 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1a2e1-2e31-409a-b4c4-6dce76948e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:11.983657 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1a2e1-2e31-409a-b4c4-6dce76948e59 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-aff1a2e1-2e31-409a-b4c4-6dce76948e59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:13:12.001941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:12.003464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:12.010349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:13:12.010349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:13:12.010349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:12.010349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:12.010349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 537/1073] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:12.013115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42433d2-302d-4945-a60c-f319d5d8ed0f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:12.064044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:12.121034 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42433d2-302d-4945-a60c-f319d5d8ed0f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:12.155365 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9e4fc-21db-403c-a437-9d6cce261633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:12.156034 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9e4fc-21db-403c-a437-9d6cce261633 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:12.156317 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9e4fc-21db-403c-a437-9d6cce261633 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:12.156594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9e4fc-21db-403c-a437-9d6cce261633 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:12.157358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9e4fc-21db-403c-a437-9d6cce261633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:12.157668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9e4fc-21db-403c-a437-9d6cce261633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:12.159050 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9e4fc-21db-403c-a437-9d6cce261633 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:12.171104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 537/1074] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:12.176956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a2e1-2e31-409a-b4c4-6dce76948e59 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:12.277920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a2e1-2e31-409a-b4c4-6dce76948e59 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:12.319037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59d77f-8732-428a-b02d-8dba99eae8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:12.319731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59d77f-8732-428a-b02d-8dba99eae8da None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:12.320014 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59d77f-8732-428a-b02d-8dba99eae8da None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:12.320290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59d77f-8732-428a-b02d-8dba99eae8da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:12.328041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59d77f-8732-428a-b02d-8dba99eae8da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:12.329542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59d77f-8732-428a-b02d-8dba99eae8da None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-1c59d77f-8732-428a-b02d-8dba99eae8da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:13:12.344044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:12.345186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:12.346287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:13:12.346287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:13:12.346287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:13:12.346287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:13:12.346287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:13:12.346287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:13:12.346287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:13:12.346287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:12.349389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 538/1075] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:12.351378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9e4fc-21db-403c-a437-9d6cce261633 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:12.435484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febb7f4-1547-40f2-a06a-c4a6364f00ac None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:12.436552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febb7f4-1547-40f2-a06a-c4a6364f00ac None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:12.436701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febb7f4-1547-40f2-a06a-c4a6364f00ac None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:12.438065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 539/1076] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:13:12.443479 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277434ec-0bf3-4cb2-a755-4b1dd2decbc9 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:12.443767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277434ec-0bf3-4cb2-a755-4b1dd2decbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:12.444048 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277434ec-0bf3-4cb2-a755-4b1dd2decbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:12.449039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:12.452712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9e4fc-21db-403c-a437-9d6cce261633 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:12.460269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:12.462744 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-277434ec-0bf3-4cb2-a755-4b1dd2decbc9 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:12.463951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-277434ec-0bf3-4cb2-a755-4b1dd2decbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:12.488503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1af2fb-e7b7-46c7-b758-4fc2c8f80386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:12.489218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1af2fb-e7b7-46c7-b758-4fc2c8f80386 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:12.489503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1af2fb-e7b7-46c7-b758-4fc2c8f80386 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:12.489860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1af2fb-e7b7-46c7-b758-4fc2c8f80386 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:12.490564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1af2fb-e7b7-46c7-b758-4fc2c8f80386 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:12.491029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1af2fb-e7b7-46c7-b758-4fc2c8f80386 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:12.492324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1af2fb-e7b7-46c7-b758-4fc2c8f80386 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:12.505885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 538/1077] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:12.511832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1af2fb-e7b7-46c7-b758-4fc2c8f80386 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:12.539680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 540/1078] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:13:12.563220 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277434ec-0bf3-4cb2-a755-4b1dd2decbc9 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:12.621745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1af2fb-e7b7-46c7-b758-4fc2c8f80386 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:12.656594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ec712-d154-4e1d-9b37-a897eee6e419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:12.657530 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ec712-d154-4e1d-9b37-a897eee6e419 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:12.657818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ec712-d154-4e1d-9b37-a897eee6e419 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:12.658099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ec712-d154-4e1d-9b37-a897eee6e419 None admin] PATH_INFO: `/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/b022a37031b940c3bd67861373926e58/roles/2f29372d0ad04535b7a8688fc0209d85` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:12.660350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ec712-d154-4e1d-9b37-a897eee6e419 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0acc3e7b64dbab9113284b46f38ff, user_id=b022a37031b940c3bd67861373926e58, role_id=2f29372d0ad04535b7a8688fc0209d85)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:12.661823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ec712-d154-4e1d-9b37-a897eee6e419 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:12.663094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277434ec-0bf3-4cb2-a755-4b1dd2decbc9 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:12.676113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 539/1079] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:13:12 2022] PUT /identity/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/b022a37031b940c3bd67861373926e58/roles/2f29372d0ad04535b7a8688fc0209d85 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:13:12.697008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:12.703297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca741bb-da6a-4d75-b32c-7866ebdffe6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:12.704127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca741bb-da6a-4d75-b32c-7866ebdffe6b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:12.704414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca741bb-da6a-4d75-b32c-7866ebdffe6b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:12.704693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca741bb-da6a-4d75-b32c-7866ebdffe6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:12.716688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca741bb-da6a-4d75-b32c-7866ebdffe6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-8ca741bb-da6a-4d75-b32c-7866ebdffe6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:13:12.724855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:12.725947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:12.726819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 541/1080] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:13:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:13:12.733341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ec712-d154-4e1d-9b37-a897eee6e419 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:12.763807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:12.844116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ec712-d154-4e1d-9b37-a897eee6e419 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:12.880811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fda8e1-5bf9-4cd2-baed-86ff002e3eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:12.881440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fda8e1-5bf9-4cd2-baed-86ff002e3eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:12.881730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fda8e1-5bf9-4cd2-baed-86ff002e3eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:12.882012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fda8e1-5bf9-4cd2-baed-86ff002e3eb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:12.882771 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fda8e1-5bf9-4cd2-baed-86ff002e3eb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:12.883084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fda8e1-5bf9-4cd2-baed-86ff002e3eb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:12.884472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fda8e1-5bf9-4cd2-baed-86ff002e3eb2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:12.892805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 540/1081] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:13:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:12.898769 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca741bb-da6a-4d75-b32c-7866ebdffe6b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:12.997570 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca741bb-da6a-4d75-b32c-7866ebdffe6b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:13.031157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc6116-65aa-468e-90f0-64a41a4d49e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:13.032033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc6116-65aa-468e-90f0-64a41a4d49e9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:13.032368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc6116-65aa-468e-90f0-64a41a4d49e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:13.032592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc6116-65aa-468e-90f0-64a41a4d49e9 None admin] PATH_INFO: `/v3/users/e1c2e7b59780464788fcae00c702ef51` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:13.033819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc6116-65aa-468e-90f0-64a41a4d49e9 None admin] RBAC: Authorizing `identity:get_user(user_id=e1c2e7b59780464788fcae00c702ef51)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:13.035266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc6116-65aa-468e-90f0-64a41a4d49e9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:13.037099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 542/1082] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:12 2022] GET /identity/v3/users/e1c2e7b59780464788fcae00c702ef51 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:13.042627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fda8e1-5bf9-4cd2-baed-86ff002e3eb2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:13.129598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:13.141907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fda8e1-5bf9-4cd2-baed-86ff002e3eb2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:13.175696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f9687-d203-4a38-a5fd-db408cf3fa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:13.176559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9687-d203-4a38-a5fd-db408cf3fa83 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:13.176843 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9687-d203-4a38-a5fd-db408cf3fa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:13.177146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9687-d203-4a38-a5fd-db408cf3fa83 None admin] PATH_INFO: `/v3/projects/9f54183ecc36487cbea9a86bbedb3427` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:13.178336 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f9687-d203-4a38-a5fd-db408cf3fa83 None admin] RBAC: Authorizing `identity:get_project(project_id=9f54183ecc36487cbea9a86bbedb3427)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:13.179779 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f9687-d203-4a38-a5fd-db408cf3fa83 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:13.181522 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 541/1083] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:13:13 2022] GET /identity/v3/projects/9f54183ecc36487cbea9a86bbedb3427 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:13.187398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc6116-65aa-468e-90f0-64a41a4d49e9 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:13.245685 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:13.288497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc6116-65aa-468e-90f0-64a41a4d49e9 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:13.322403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58fba5-5854-43aa-a785-f75922b162c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:13.323338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58fba5-5854-43aa-a785-f75922b162c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:13.323618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58fba5-5854-43aa-a785-f75922b162c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:13.323895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58fba5-5854-43aa-a785-f75922b162c2 None admin] PATH_INFO: `/v3/projects/9f54183ecc36487cbea9a86bbedb3427/users/e1c2e7b59780464788fcae00c702ef51/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:13.325887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58fba5-5854-43aa-a785-f75922b162c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f54183ecc36487cbea9a86bbedb3427, user_id=e1c2e7b59780464788fcae00c702ef51, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:13.327929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58fba5-5854-43aa-a785-f75922b162c2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:13.341473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 543/1084] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:13:13 2022] PUT /identity/v3/projects/9f54183ecc36487cbea9a86bbedb3427/users/e1c2e7b59780464788fcae00c702ef51/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:13:14.689425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b13fc5-9733-437e-b475-23dc56699f2d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:14.689961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b13fc5-9733-437e-b475-23dc56699f2d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:14.689961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b13fc5-9733-437e-b475-23dc56699f2d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:14.691347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 542/1085] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:14.697747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151b325-6ca2-4232-be77-db1e41dd7b10 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:14.698252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151b325-6ca2-4232-be77-db1e41dd7b10 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:14.698453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151b325-6ca2-4232-be77-db1e41dd7b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:14.716855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9151b325-6ca2-4232-be77-db1e41dd7b10 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:14.718076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9151b325-6ca2-4232-be77-db1e41dd7b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:14.786250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 544/1086] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:14.808911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b13fc5-9733-437e-b475-23dc56699f2d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:14.913684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b13fc5-9733-437e-b475-23dc56699f2d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:14.947469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779bead-6266-4356-9700-c6830a815e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:14.948272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779bead-6266-4356-9700-c6830a815e0b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:14.948553 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779bead-6266-4356-9700-c6830a815e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:14.948824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779bead-6266-4356-9700-c6830a815e0b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:14.959602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779bead-6266-4356-9700-c6830a815e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c779bead-6266-4356-9700-c6830a815e0b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:13:14.967693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:14.968824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:14.969745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 543/1087] 10.222.0.64 () {56 vars in 1120 bytes} [Fri Jul 15 15:13:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:14.975503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151b325-6ca2-4232-be77-db1e41dd7b10 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:15.026652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:15.078252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151b325-6ca2-4232-be77-db1e41dd7b10 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:15.112017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82995be-ab3d-494d-a1d3-39dca639da64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:15.112694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82995be-ab3d-494d-a1d3-39dca639da64 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:15.112977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82995be-ab3d-494d-a1d3-39dca639da64 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:15.113280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82995be-ab3d-494d-a1d3-39dca639da64 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:15.114034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82995be-ab3d-494d-a1d3-39dca639da64 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:15.114348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82995be-ab3d-494d-a1d3-39dca639da64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:15.115732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82995be-ab3d-494d-a1d3-39dca639da64 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:15.129540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 545/1088] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Jul 15 15:13:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:15.131162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779bead-6266-4356-9700-c6830a815e0b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:15.149378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:15.239385 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779bead-6266-4356-9700-c6830a815e0b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:15.273839 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4d5e0-235b-4e84-b9c6-a1d4d8e07fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:15.274657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4d5e0-235b-4e84-b9c6-a1d4d8e07fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:15.274949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4d5e0-235b-4e84-b9c6-a1d4d8e07fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:15.275232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4d5e0-235b-4e84-b9c6-a1d4d8e07fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:15.288153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4d5e0-235b-4e84-b9c6-a1d4d8e07fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:15.290116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4d5e0-235b-4e84-b9c6-a1d4d8e07fa9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-dba4d5e0-235b-4e84-b9c6-a1d4d8e07fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:13:15.309131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:15.310350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:15.311312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:13:15.311312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:13:15.311312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:15.311312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:15.311312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 544/1089] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:15.316411 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82995be-ab3d-494d-a1d3-39dca639da64 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:15.350435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e4870-c1f7-4545-a566-1a7c32e9556f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:15.350718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e4870-c1f7-4545-a566-1a7c32e9556f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:15.351028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e4870-c1f7-4545-a566-1a7c32e9556f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:15.352409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 545/1090] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:13:15.358419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586af718-d290-4e2b-8a13-7eb488747408 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:15.358705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586af718-d290-4e2b-8a13-7eb488747408 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:15.358980 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586af718-d290-4e2b-8a13-7eb488747408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:15.382577 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-586af718-d290-4e2b-8a13-7eb488747408 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:15.384382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-586af718-d290-4e2b-8a13-7eb488747408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:15.422797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82995be-ab3d-494d-a1d3-39dca639da64 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:15.435970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:15.451329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:15.457147 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308455f4-3874-4c8c-8f18-5ed6f0344f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:15.457450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 546/1091] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:13:15.457833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308455f4-3874-4c8c-8f18-5ed6f0344f8a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:15.458119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308455f4-3874-4c8c-8f18-5ed6f0344f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:15.458397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308455f4-3874-4c8c-8f18-5ed6f0344f8a None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:15.459211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308455f4-3874-4c8c-8f18-5ed6f0344f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:15.459526 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308455f4-3874-4c8c-8f18-5ed6f0344f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:15.460910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308455f4-3874-4c8c-8f18-5ed6f0344f8a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:15.473776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 546/1092] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:15.479566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586af718-d290-4e2b-8a13-7eb488747408 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:15.481739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308455f4-3874-4c8c-8f18-5ed6f0344f8a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:15.583785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586af718-d290-4e2b-8a13-7eb488747408 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:15.584954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308455f4-3874-4c8c-8f18-5ed6f0344f8a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:15.624069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09517575-c716-4fd6-a82c-c622968e8ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:15.624945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09517575-c716-4fd6-a82c-c622968e8ddb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:15.625204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09517575-c716-4fd6-a82c-c622968e8ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:15.625491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09517575-c716-4fd6-a82c-c622968e8ddb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:15.628631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a327cb5-fc05-4f95-94f6-50df22fc3044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:15.629468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a327cb5-fc05-4f95-94f6-50df22fc3044 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:15.629760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a327cb5-fc05-4f95-94f6-50df22fc3044 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:15.630242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a327cb5-fc05-4f95-94f6-50df22fc3044 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:15.633323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09517575-c716-4fd6-a82c-c622968e8ddb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:15.634962 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09517575-c716-4fd6-a82c-c622968e8ddb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:15.641421 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a327cb5-fc05-4f95-94f6-50df22fc3044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-6a327cb5-fc05-4f95-94f6-50df22fc3044 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:13:15.649106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:15.650245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:15.656254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:15.656254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:15.656254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:15.656254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:15.656254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:13:15.656254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:13:15.656254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:13:15.656254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:13:15.656254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:13:15.656254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:13:15.656254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:15.656254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-09517575-c716-4fd6-a82c-c622968e8ddb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:13:15.656926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:15.658076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:15.659111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:15.659111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:15.659111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:13:15.659111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:13:15.659111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:13:15.659111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:13:15.659111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:13:15.659111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:13:15.659111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:13:15.659111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:15.659664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 547/1093] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:13:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:13:15.659737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 547/1094] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Jul 15 15:13:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:15.659805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a327cb5-fc05-4f95-94f6-50df22fc3044 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:15.659883 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09517575-c716-4fd6-a82c-c622968e8ddb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:15.695938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:15.718876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:15.761995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09517575-c716-4fd6-a82c-c622968e8ddb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:15.768381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a327cb5-fc05-4f95-94f6-50df22fc3044 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:15.797732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd5a6e-8f1d-4787-a5cb-eeb6c2f3d3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:15.798409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5a6e-8f1d-4787-a5cb-eeb6c2f3d3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:15.798698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5a6e-8f1d-4787-a5cb-eeb6c2f3d3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:15.798983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5a6e-8f1d-4787-a5cb-eeb6c2f3d3e7 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:15.799826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd5a6e-8f1d-4787-a5cb-eeb6c2f3d3e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:15.800137 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd5a6e-8f1d-4787-a5cb-eeb6c2f3d3e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:15.801628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd5a6e-8f1d-4787-a5cb-eeb6c2f3d3e7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:15.802867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583476-9be1-477d-bc55-b7230e16c296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:15.803545 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583476-9be1-477d-bc55-b7230e16c296 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:15.803831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583476-9be1-477d-bc55-b7230e16c296 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:15.804825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583476-9be1-477d-bc55-b7230e16c296 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:15.804825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f583476-9be1-477d-bc55-b7230e16c296 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:15.805186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f583476-9be1-477d-bc55-b7230e16c296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:15.806566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f583476-9be1-477d-bc55-b7230e16c296 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:15.816376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 548/1095] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:13:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:15.820272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 548/1096] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Jul 15 15:13:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:15.822294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583476-9be1-477d-bc55-b7230e16c296 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:15.826159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd5a6e-8f1d-4787-a5cb-eeb6c2f3d3e7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:15.917613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:15.925521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583476-9be1-477d-bc55-b7230e16c296 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:15.926046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd5a6e-8f1d-4787-a5cb-eeb6c2f3d3e7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:15.944892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:15.961623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca6779-a4cf-4803-adcf-73e8833854e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:15.962516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca6779-a4cf-4803-adcf-73e8833854e7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:15.962807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca6779-a4cf-4803-adcf-73e8833854e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:15.963086 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca6779-a4cf-4803-adcf-73e8833854e7 None admin] PATH_INFO: `/v3/users/e1c2e7b59780464788fcae00c702ef51` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:15.963349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c49a0e-dcc6-4274-9eb0-96055137e30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:15.964004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c49a0e-dcc6-4274-9eb0-96055137e30e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:15.964292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c49a0e-dcc6-4274-9eb0-96055137e30e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:15.964381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca6779-a4cf-4803-adcf-73e8833854e7 None admin] RBAC: Authorizing `identity:get_user(user_id=e1c2e7b59780464788fcae00c702ef51)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:15.964577 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c49a0e-dcc6-4274-9eb0-96055137e30e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:15.965790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca6779-a4cf-4803-adcf-73e8833854e7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:15.967969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 549/1097] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:15 2022] GET /identity/v3/users/e1c2e7b59780464788fcae00c702ef51 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:15.973706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca6779-a4cf-4803-adcf-73e8833854e7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:16.035099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c49a0e-dcc6-4274-9eb0-96055137e30e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:16.036615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c49a0e-dcc6-4274-9eb0-96055137e30e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:16.087087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca6779-a4cf-4803-adcf-73e8833854e7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:16.131065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbf1a2-b7cc-450a-a9f8-7235e70ccd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:16.131737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbf1a2-b7cc-450a-a9f8-7235e70ccd57 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:16.132024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbf1a2-b7cc-450a-a9f8-7235e70ccd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:16.132304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbf1a2-b7cc-450a-a9f8-7235e70ccd57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:16.152885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 549/1098] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:13:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 15:13:16.159442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c49a0e-dcc6-4274-9eb0-96055137e30e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:16.166394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:16.178594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:16.213623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbf1a2-b7cc-450a-a9f8-7235e70ccd57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:16.215145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbf1a2-b7cc-450a-a9f8-7235e70ccd57 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:16.268822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c49a0e-dcc6-4274-9eb0-96055137e30e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:16.306301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292826c5-a551-4eac-8b03-a0e1169ae378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:16.307234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292826c5-a551-4eac-8b03-a0e1169ae378 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:16.307526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292826c5-a551-4eac-8b03-a0e1169ae378 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:16.307809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292826c5-a551-4eac-8b03-a0e1169ae378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:16.318717 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292826c5-a551-4eac-8b03-a0e1169ae378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:16.320215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292826c5-a551-4eac-8b03-a0e1169ae378 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:16.322697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 550/1099] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:13:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 15:13:16.329340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbf1a2-b7cc-450a-a9f8-7235e70ccd57 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-292826c5-a551-4eac-8b03-a0e1169ae378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:13:16.340092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:16.341410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:16.343196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:13:16.343196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:13:16.343196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:13:16.343196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:16.343196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 550/1100] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:16.347924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292826c5-a551-4eac-8b03-a0e1169ae378 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:16.402270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:16.427874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:16.446986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbf1a2-b7cc-450a-a9f8-7235e70ccd57 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:16.469845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292826c5-a551-4eac-8b03-a0e1169ae378 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:16.483471 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de79d4-7cad-496a-b63b-6eefb592ff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:16.484341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de79d4-7cad-496a-b63b-6eefb592ff08 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:16.484622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de79d4-7cad-496a-b63b-6eefb592ff08 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:16.484967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de79d4-7cad-496a-b63b-6eefb592ff08 None admin] PATH_INFO: `/v3/projects/9f54183ecc36487cbea9a86bbedb3427` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:16.486128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de79d4-7cad-496a-b63b-6eefb592ff08 None admin] RBAC: Authorizing `identity:get_project(project_id=9f54183ecc36487cbea9a86bbedb3427)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:16.487603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de79d4-7cad-496a-b63b-6eefb592ff08 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:16.489746 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 551/1101] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:13:16 2022] GET /identity/v3/projects/9f54183ecc36487cbea9a86bbedb3427 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:16.496444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de79d4-7cad-496a-b63b-6eefb592ff08 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:16.505878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b83b05-c1f6-47c0-9d5d-92c25f81acb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:16.506554 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b83b05-c1f6-47c0-9d5d-92c25f81acb5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:16.506838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b83b05-c1f6-47c0-9d5d-92c25f81acb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:16.507117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b83b05-c1f6-47c0-9d5d-92c25f81acb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:16.507855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b83b05-c1f6-47c0-9d5d-92c25f81acb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:16.508161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b83b05-c1f6-47c0-9d5d-92c25f81acb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:16.509722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b83b05-c1f6-47c0-9d5d-92c25f81acb5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:16.523200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 551/1102] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:16.528684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b83b05-c1f6-47c0-9d5d-92c25f81acb5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:16.616915 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de79d4-7cad-496a-b63b-6eefb592ff08 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:16.639075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b83b05-c1f6-47c0-9d5d-92c25f81acb5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:16.647773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:16.654999 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1ef87-c574-44ca-b425-384934ce7bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:16.655671 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1ef87-c574-44ca-b425-384934ce7bce None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:16.655961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1ef87-c574-44ca-b425-384934ce7bce None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:16.656244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1ef87-c574-44ca-b425-384934ce7bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:16.657102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1ef87-c574-44ca-b425-384934ce7bce None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=9f54183ecc36487cbea9a86bbedb3427, user.id=e1c2e7b59780464788fcae00c702ef51) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:16.657423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1ef87-c574-44ca-b425-384934ce7bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:16.658872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1ef87-c574-44ca-b425-384934ce7bce None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:16.664943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 552/1103] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:13:16 2022] GET /identity/v3/role_assignments?user.id=e1c2e7b59780464788fcae00c702ef51&scope.project.id=9f54183ecc36487cbea9a86bbedb3427&role.id=87593f63c4744eac870c07b006022e77 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:16.666404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:16.675333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22049304-9169-4ebc-8170-266694e7b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:16.676294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22049304-9169-4ebc-8170-266694e7b75a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:16.676732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22049304-9169-4ebc-8170-266694e7b75a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:16.677102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22049304-9169-4ebc-8170-266694e7b75a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:16.685300 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22049304-9169-4ebc-8170-266694e7b75a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:16.686940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22049304-9169-4ebc-8170-266694e7b75a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-22049304-9169-4ebc-8170-266694e7b75a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:13:16.703933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:16.705023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:16.707245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:13:16.707245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:13:16.707245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:13:16.707245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:13:16.707245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:13:16.707245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:13:16.707245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:13:16.707245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:16.707245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 552/1104] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:13:16.711628 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1ef87-c574-44ca-b425-384934ce7bce None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:16.838869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1ef87-c574-44ca-b425-384934ce7bce None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:16.873736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f56100-bfcb-4976-a203-cd84652c5e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:16.874450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f56100-bfcb-4976-a203-cd84652c5e0c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:16.874740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f56100-bfcb-4976-a203-cd84652c5e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:16.875023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f56100-bfcb-4976-a203-cd84652c5e0c None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:16.875829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f56100-bfcb-4976-a203-cd84652c5e0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:16.876141 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f56100-bfcb-4976-a203-cd84652c5e0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:16.877886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f56100-bfcb-4976-a203-cd84652c5e0c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:16.890408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 553/1105] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:13:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:16.896588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22049304-9169-4ebc-8170-266694e7b75a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:16.997258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22049304-9169-4ebc-8170-266694e7b75a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:17.031860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdfbb9-3f73-476f-8ad0-f21d89520bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:17.032520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdfbb9-3f73-476f-8ad0-f21d89520bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:17.032809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdfbb9-3f73-476f-8ad0-f21d89520bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:17.033110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdfbb9-3f73-476f-8ad0-f21d89520bf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:17.033953 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdfbb9-3f73-476f-8ad0-f21d89520bf4 None admin] RBAC: Adding query filter params (role.id=2f29372d0ad04535b7a8688fc0209d85, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=b022a37031b940c3bd67861373926e58) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:17.034266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdfbb9-3f73-476f-8ad0-f21d89520bf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:17.035710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdfbb9-3f73-476f-8ad0-f21d89520bf4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:17.041893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 553/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:13:16 2022] GET /identity/v3/role_assignments?user.id=b022a37031b940c3bd67861373926e58&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=2f29372d0ad04535b7a8688fc0209d85 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:18.765548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd9f85-9338-4c2d-91be-704fa101484f None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:18.766079 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd9f85-9338-4c2d-91be-704fa101484f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:18.766169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd9f85-9338-4c2d-91be-704fa101484f None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:18.767613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 554/1107] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:18.773201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e856564-c072-4000-986f-fc8cf1aa7b88 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:18.773707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e856564-c072-4000-986f-fc8cf1aa7b88 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:18.773856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e856564-c072-4000-986f-fc8cf1aa7b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:18.791953 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8e856564-c072-4000-986f-fc8cf1aa7b88 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:18.793204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8e856564-c072-4000-986f-fc8cf1aa7b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:18.851667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:18.879083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 554/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:13:18.904054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd9f85-9338-4c2d-91be-704fa101484f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:18.979529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:19.037959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd9f85-9338-4c2d-91be-704fa101484f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:19.072231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9b363-01c7-4351-9761-22ec8e734c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:19.073032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9b363-01c7-4351-9761-22ec8e734c0f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:19.073346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9b363-01c7-4351-9761-22ec8e734c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:19.073623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9b363-01c7-4351-9761-22ec8e734c0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:19.074809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9b363-01c7-4351-9761-22ec8e734c0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:19.076833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9b363-01c7-4351-9761-22ec8e734c0f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:19.078511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 555/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:19.084540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e856564-c072-4000-986f-fc8cf1aa7b88 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:19.202126 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e856564-c072-4000-986f-fc8cf1aa7b88 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:19.238928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c2b9-a302-448e-a0ac-2c73b3fe5fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:19.239608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c2b9-a302-448e-a0ac-2c73b3fe5fb6 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:19.239895 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c2b9-a302-448e-a0ac-2c73b3fe5fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:19.240174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c2b9-a302-448e-a0ac-2c73b3fe5fb6 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:19.240909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9c2b9-a302-448e-a0ac-2c73b3fe5fb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:19.243460 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9c2b9-a302-448e-a0ac-2c73b3fe5fb6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:19.265003 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 555/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:13:19 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:13:21.421886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f54fc-ff38-4a72-8abb-c2c397338212 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:21.422454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f54fc-ff38-4a72-8abb-c2c397338212 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:21.422454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f54fc-ff38-4a72-8abb-c2c397338212 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:21.423838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 556/1111] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:21.429501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669ebbc-83ea-4a33-bdbc-b566a5769140 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:21.430648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669ebbc-83ea-4a33-bdbc-b566a5769140 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:21.430648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669ebbc-83ea-4a33-bdbc-b566a5769140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:21.447785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5669ebbc-83ea-4a33-bdbc-b566a5769140 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:21.449021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5669ebbc-83ea-4a33-bdbc-b566a5769140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:21.483054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:21.523142 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 556/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:21.546804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f54fc-ff38-4a72-8abb-c2c397338212 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:21.662222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f54fc-ff38-4a72-8abb-c2c397338212 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:21.686968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:21.699439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2c055-2282-4fda-872d-9874e511e5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:21.700305 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2c055-2282-4fda-872d-9874e511e5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:21.700590 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2c055-2282-4fda-872d-9874e511e5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:21.701088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2c055-2282-4fda-872d-9874e511e5c8 None admin] PATH_INFO: `/v3/roles/f5fb67c95c834bc9b359a5141ae0f60c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:21.702420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2c055-2282-4fda-872d-9874e511e5c8 None admin] RBAC: Authorizing `identity:get_role(role_id=f5fb67c95c834bc9b359a5141ae0f60c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:21.703788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2c055-2282-4fda-872d-9874e511e5c8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:21.705192 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 557/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:21 2022] GET /identity/v3/roles/f5fb67c95c834bc9b359a5141ae0f60c => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:21.711344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669ebbc-83ea-4a33-bdbc-b566a5769140 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:21.808278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669ebbc-83ea-4a33-bdbc-b566a5769140 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:21.842434 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274efc-48fe-4505-9c14-205490c3a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:21.843379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274efc-48fe-4505-9c14-205490c3a6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:21.843662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274efc-48fe-4505-9c14-205490c3a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:21.843937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274efc-48fe-4505-9c14-205490c3a6e9 None admin] PATH_INFO: `/v3/users/2bd2ace6c78b46ab95cf843e46ed1fb4` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:21.857693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f274efc-48fe-4505-9c14-205490c3a6e9 None admin] RBAC: Authorizing `identity:get_user(user_id=2bd2ace6c78b46ab95cf843e46ed1fb4)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:21.859149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f274efc-48fe-4505-9c14-205490c3a6e9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:21.860813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 557/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:21 2022] GET /identity/v3/users/2bd2ace6c78b46ab95cf843e46ed1fb4 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:21.866930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2c055-2282-4fda-872d-9874e511e5c8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:21.970516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2c055-2282-4fda-872d-9874e511e5c8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:22.004628 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1491c-1b4f-4410-b08b-b225bb835b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:22.005309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1491c-1b4f-4410-b08b-b225bb835b21 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:22.005599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1491c-1b4f-4410-b08b-b225bb835b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:22.005882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1491c-1b4f-4410-b08b-b225bb835b21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:22.061305 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:22.071773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1491c-1b4f-4410-b08b-b225bb835b21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:22.073259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1491c-1b4f-4410-b08b-b225bb835b21 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:22.168923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 558/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:13:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:13:22.174862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274efc-48fe-4505-9c14-205490c3a6e9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:22.202190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:22.273931 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274efc-48fe-4505-9c14-205490c3a6e9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:22.307427 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c3571-b342-449c-b056-035618f47a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:22.308275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c3571-b342-449c-b056-035618f47a58 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:22.308557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c3571-b342-449c-b056-035618f47a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:22.308831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c3571-b342-449c-b056-035618f47a58 None admin] PATH_INFO: `/v3/projects/9f54183ecc36487cbea9a86bbedb3427` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:22.310029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c3571-b342-449c-b056-035618f47a58 None admin] RBAC: Authorizing `identity:get_project(project_id=9f54183ecc36487cbea9a86bbedb3427)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:22.311604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c3571-b342-449c-b056-035618f47a58 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:22.313331 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 558/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:13:22 2022] GET /identity/v3/projects/9f54183ecc36487cbea9a86bbedb3427 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:22.319579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1491c-1b4f-4410-b08b-b225bb835b21 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:22.411709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:22.421204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1491c-1b4f-4410-b08b-b225bb835b21 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:22.455761 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9814cb-c1e1-4378-9de4-5b87c90fb7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:22.456416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9814cb-c1e1-4378-9de4-5b87c90fb7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:22.456691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9814cb-c1e1-4378-9de4-5b87c90fb7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:22.456969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9814cb-c1e1-4378-9de4-5b87c90fb7c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:22.457914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9814cb-c1e1-4378-9de4-5b87c90fb7c1 None admin] RBAC: Adding query filter params (role.id=f5fb67c95c834bc9b359a5141ae0f60c, scope.project.id=9f54183ecc36487cbea9a86bbedb3427, user.id=2bd2ace6c78b46ab95cf843e46ed1fb4) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:22.458231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9814cb-c1e1-4378-9de4-5b87c90fb7c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:22.459680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9814cb-c1e1-4378-9de4-5b87c90fb7c1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:22.465320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 559/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:13:22 2022] GET /identity/v3/role_assignments?user.id=2bd2ace6c78b46ab95cf843e46ed1fb4&scope.project.id=9f54183ecc36487cbea9a86bbedb3427&role.id=f5fb67c95c834bc9b359a5141ae0f60c => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:24.461147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959f12-1c3f-47a2-bd6d-63a823a7a58c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:24.461690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959f12-1c3f-47a2-bd6d-63a823a7a58c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:24.461690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959f12-1c3f-47a2-bd6d-63a823a7a58c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:24.463066 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 559/1118] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:24.468854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539446-0a80-4fb2-92e6-098c72b363b1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:24.469375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539446-0a80-4fb2-92e6-098c72b363b1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:24.469483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539446-0a80-4fb2-92e6-098c72b363b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:24.489502 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b9539446-0a80-4fb2-92e6-098c72b363b1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:24.490704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b9539446-0a80-4fb2-92e6-098c72b363b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:24.556982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 560/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:24.580216 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1959f12-1c3f-47a2-bd6d-63a823a7a58c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:24.676019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:24.684678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1959f12-1c3f-47a2-bd6d-63a823a7a58c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:24.719457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16866-2da9-4f8e-bed6-5e1a94e7ac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:24.720234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16866-2da9-4f8e-bed6-5e1a94e7ac76 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:24.720515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16866-2da9-4f8e-bed6-5e1a94e7ac76 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:24.720793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16866-2da9-4f8e-bed6-5e1a94e7ac76 None admin] PATH_INFO: `/v3/roles/f5fb67c95c834bc9b359a5141ae0f60c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:24.722327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c16866-2da9-4f8e-bed6-5e1a94e7ac76 None admin] RBAC: Authorizing `identity:get_role(role_id=f5fb67c95c834bc9b359a5141ae0f60c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:24.723871 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c16866-2da9-4f8e-bed6-5e1a94e7ac76 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:24.725316 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 560/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:24 2022] GET /identity/v3/roles/f5fb67c95c834bc9b359a5141ae0f60c => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:24.731360 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9539446-0a80-4fb2-92e6-098c72b363b1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:24.818787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:24.835407 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9539446-0a80-4fb2-92e6-098c72b363b1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:24.876355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d007a-01d3-4530-ad0b-85eee3e90a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:24.877523 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d007a-01d3-4530-ad0b-85eee3e90a60 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:24.877809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d007a-01d3-4530-ad0b-85eee3e90a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:24.878086 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d007a-01d3-4530-ad0b-85eee3e90a60 None admin] PATH_INFO: `/v3/users/2bd2ace6c78b46ab95cf843e46ed1fb4` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:24.879292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d007a-01d3-4530-ad0b-85eee3e90a60 None admin] RBAC: Authorizing `identity:get_user(user_id=2bd2ace6c78b46ab95cf843e46ed1fb4)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:24.880751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d007a-01d3-4530-ad0b-85eee3e90a60 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:24.882435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 561/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:24 2022] GET /identity/v3/users/2bd2ace6c78b46ab95cf843e46ed1fb4 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:24.888559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16866-2da9-4f8e-bed6-5e1a94e7ac76 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:24.993037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16866-2da9-4f8e-bed6-5e1a94e7ac76 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:25.026508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e832f8-eb3c-4264-980e-c419de8758c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:25.027367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e832f8-eb3c-4264-980e-c419de8758c7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:25.027651 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e832f8-eb3c-4264-980e-c419de8758c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:25.027927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e832f8-eb3c-4264-980e-c419de8758c7 None admin] PATH_INFO: `/v3/projects/9f54183ecc36487cbea9a86bbedb3427` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:25.029663 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e832f8-eb3c-4264-980e-c419de8758c7 None admin] RBAC: Authorizing `identity:get_project(project_id=9f54183ecc36487cbea9a86bbedb3427)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:25.031116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e832f8-eb3c-4264-980e-c419de8758c7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:25.032831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 561/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:13:24 2022] GET /identity/v3/projects/9f54183ecc36487cbea9a86bbedb3427 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:25.038898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d007a-01d3-4530-ad0b-85eee3e90a60 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:25.137438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d007a-01d3-4530-ad0b-85eee3e90a60 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:25.172465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fabc18-7d9e-461d-b201-753fa9d637e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:25.173447 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fabc18-7d9e-461d-b201-753fa9d637e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:25.173725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fabc18-7d9e-461d-b201-753fa9d637e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:25.173999 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fabc18-7d9e-461d-b201-753fa9d637e2 None admin] PATH_INFO: `/v3/projects/9f54183ecc36487cbea9a86bbedb3427/users/2bd2ace6c78b46ab95cf843e46ed1fb4/roles/f5fb67c95c834bc9b359a5141ae0f60c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:25.176228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fabc18-7d9e-461d-b201-753fa9d637e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f54183ecc36487cbea9a86bbedb3427, user_id=2bd2ace6c78b46ab95cf843e46ed1fb4, role_id=f5fb67c95c834bc9b359a5141ae0f60c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:25.177725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fabc18-7d9e-461d-b201-753fa9d637e2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:25.191053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 562/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:13:25 2022] PUT /identity/v3/projects/9f54183ecc36487cbea9a86bbedb3427/users/2bd2ace6c78b46ab95cf843e46ed1fb4/roles/f5fb67c95c834bc9b359a5141ae0f60c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:13:27.220014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdab86-85b5-483e-8dee-886e40ee1e5c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:27.220552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdab86-85b5-483e-8dee-886e40ee1e5c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:27.220552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdab86-85b5-483e-8dee-886e40ee1e5c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:27.221958 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 562/1124] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:27.227243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672348b-ebd9-46f3-9889-4d8b36c35749 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:27.227675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672348b-ebd9-46f3-9889-4d8b36c35749 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:27.227810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672348b-ebd9-46f3-9889-4d8b36c35749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:27.244531 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8672348b-ebd9-46f3-9889-4d8b36c35749 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:27.245763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8672348b-ebd9-46f3-9889-4d8b36c35749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:27.254058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:27.314189 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 563/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:27.337305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdab86-85b5-483e-8dee-886e40ee1e5c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:27.368478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:27.447528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdab86-85b5-483e-8dee-886e40ee1e5c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:27.496925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be1f40-38f8-4e68-aea6-e2957df339b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:27.498296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be1f40-38f8-4e68-aea6-e2957df339b1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:27.498769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be1f40-38f8-4e68-aea6-e2957df339b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:27.499229 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be1f40-38f8-4e68-aea6-e2957df339b1 None admin] PATH_INFO: `/v3/roles/f5fb67c95c834bc9b359a5141ae0f60c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:27.501775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be1f40-38f8-4e68-aea6-e2957df339b1 None admin] RBAC: Authorizing `identity:get_role(role_id=f5fb67c95c834bc9b359a5141ae0f60c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:27.504453 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be1f40-38f8-4e68-aea6-e2957df339b1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:27.507045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 563/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:27 2022] GET /identity/v3/roles/f5fb67c95c834bc9b359a5141ae0f60c => generated 223 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:27.513053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672348b-ebd9-46f3-9889-4d8b36c35749 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:27.617983 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672348b-ebd9-46f3-9889-4d8b36c35749 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:27.650894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f0b2e-a9b6-46d7-a71f-9d3ad061bec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:27.651755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f0b2e-a9b6-46d7-a71f-9d3ad061bec8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:27.652039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f0b2e-a9b6-46d7-a71f-9d3ad061bec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:27.652315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f0b2e-a9b6-46d7-a71f-9d3ad061bec8 None admin] PATH_INFO: `/v3/users/2bd2ace6c78b46ab95cf843e46ed1fb4` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:27.653510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f0b2e-a9b6-46d7-a71f-9d3ad061bec8 None admin] RBAC: Authorizing `identity:get_user(user_id=2bd2ace6c78b46ab95cf843e46ed1fb4)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:27.654941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f0b2e-a9b6-46d7-a71f-9d3ad061bec8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:27.656558 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 564/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:27 2022] GET /identity/v3/users/2bd2ace6c78b46ab95cf843e46ed1fb4 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:27.662464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be1f40-38f8-4e68-aea6-e2957df339b1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:27.755961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:27.760155 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be1f40-38f8-4e68-aea6-e2957df339b1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:27.792338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7730eb2-65f8-4ad5-9018-9628260d0446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:27.792974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7730eb2-65f8-4ad5-9018-9628260d0446 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:27.793284 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7730eb2-65f8-4ad5-9018-9628260d0446 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:27.793563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7730eb2-65f8-4ad5-9018-9628260d0446 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:27.858616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7730eb2-65f8-4ad5-9018-9628260d0446 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:27.860105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7730eb2-65f8-4ad5-9018-9628260d0446 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:27.950380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:27.959967 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 564/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:13:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:13:27.961789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f0b2e-a9b6-46d7-a71f-9d3ad061bec8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:27.974258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:28.061383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f0b2e-a9b6-46d7-a71f-9d3ad061bec8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:28.097888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8040b5-d3a1-4068-8051-80dd852c12c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:28.098617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8040b5-d3a1-4068-8051-80dd852c12c1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:28.098892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8040b5-d3a1-4068-8051-80dd852c12c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:28.099160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8040b5-d3a1-4068-8051-80dd852c12c1 None admin] PATH_INFO: `/v3/projects/9f54183ecc36487cbea9a86bbedb3427` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:28.100364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8040b5-d3a1-4068-8051-80dd852c12c1 None admin] RBAC: Authorizing `identity:get_project(project_id=9f54183ecc36487cbea9a86bbedb3427)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:28.101832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8040b5-d3a1-4068-8051-80dd852c12c1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:28.103547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 565/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:13:27 2022] GET /identity/v3/projects/9f54183ecc36487cbea9a86bbedb3427 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:28.111681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7730eb2-65f8-4ad5-9018-9628260d0446 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:28.215970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7730eb2-65f8-4ad5-9018-9628260d0446 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:28.256084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7681cf-5019-4b79-a3b6-dd7667141b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:28.256785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7681cf-5019-4b79-a3b6-dd7667141b4f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:28.257020 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7681cf-5019-4b79-a3b6-dd7667141b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:28.257328 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7681cf-5019-4b79-a3b6-dd7667141b4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:28.258166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7681cf-5019-4b79-a3b6-dd7667141b4f None admin] RBAC: Adding query filter params (role.id=f5fb67c95c834bc9b359a5141ae0f60c, scope.project.id=9f54183ecc36487cbea9a86bbedb3427, user.id=2bd2ace6c78b46ab95cf843e46ed1fb4) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:28.258480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7681cf-5019-4b79-a3b6-dd7667141b4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:28.259924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7681cf-5019-4b79-a3b6-dd7667141b4f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:28.271464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 565/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:13:28 2022] GET /identity/v3/role_assignments?user.id=2bd2ace6c78b46ab95cf843e46ed1fb4&scope.project.id=9f54183ecc36487cbea9a86bbedb3427&role.id=f5fb67c95c834bc9b359a5141ae0f60c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:30.315975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad15a-ff52-4583-81c2-56de6d1f8674 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:30.316583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad15a-ff52-4583-81c2-56de6d1f8674 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:30.316583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad15a-ff52-4583-81c2-56de6d1f8674 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:30.317848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 566/1131] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:30.323751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801265e-5954-49b8-b428-88aa69935ad8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:30.323751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801265e-5954-49b8-b428-88aa69935ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:30.323751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801265e-5954-49b8-b428-88aa69935ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:30.340605 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3801265e-5954-49b8-b428-88aa69935ad8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:30.341883 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3801265e-5954-49b8-b428-88aa69935ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:30.405565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:30.423851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 566/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:30.465304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ad15a-ff52-4583-81c2-56de6d1f8674 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:30.545655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:30.568411 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ad15a-ff52-4583-81c2-56de6d1f8674 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:30.602188 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e921b-8021-4202-9497-49069b035cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:30.603000 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e921b-8021-4202-9497-49069b035cfa None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:30.603285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e921b-8021-4202-9497-49069b035cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:30.603561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e921b-8021-4202-9497-49069b035cfa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:30.604768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e921b-8021-4202-9497-49069b035cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:30.606255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e921b-8021-4202-9497-49069b035cfa None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:30.608393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 567/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:30.614386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801265e-5954-49b8-b428-88aa69935ad8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:30.713908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801265e-5954-49b8-b428-88aa69935ad8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:30.749419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c042edb-e7af-4244-8c0f-a997eeec9014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:30.750093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c042edb-e7af-4244-8c0f-a997eeec9014 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:30.750379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c042edb-e7af-4244-8c0f-a997eeec9014 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:30.750657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c042edb-e7af-4244-8c0f-a997eeec9014 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:30.751379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c042edb-e7af-4244-8c0f-a997eeec9014 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:30.753112 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c042edb-e7af-4244-8c0f-a997eeec9014 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:30.779598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 567/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:13:30 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:13:32.853033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7836d-8102-4024-b1b0-73334fb828da None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:32.853722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7836d-8102-4024-b1b0-73334fb828da None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:32.853722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7836d-8102-4024-b1b0-73334fb828da None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:32.854929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 568/1135] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:32.860440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d4890-337a-4e30-9e23-55d8ce28303b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:32.860900 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d4890-337a-4e30-9e23-55d8ce28303b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:32.861007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d4890-337a-4e30-9e23-55d8ce28303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:32.877937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-589d4890-337a-4e30-9e23-55d8ce28303b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:32.879150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-589d4890-337a-4e30-9e23-55d8ce28303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:32.921193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:32.949435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 568/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:32.974737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7836d-8102-4024-b1b0-73334fb828da None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:33.075833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7836d-8102-4024-b1b0-73334fb828da None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:33.113862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54ed87-a128-43ca-b8d5-91ca4a4ac283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:33.114748 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54ed87-a128-43ca-b8d5-91ca4a4ac283 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:33.115032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54ed87-a128-43ca-b8d5-91ca4a4ac283 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:33.115735 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54ed87-a128-43ca-b8d5-91ca4a4ac283 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:33.116994 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54ed87-a128-43ca-b8d5-91ca4a4ac283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:33.118607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54ed87-a128-43ca-b8d5-91ca4a4ac283 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:33.120265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 569/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:13:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:33.126399 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d4890-337a-4e30-9e23-55d8ce28303b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:33.237720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d4890-337a-4e30-9e23-55d8ce28303b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:33.275108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52830c7b-5dda-4b6d-96b5-9e28570a5f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:33.275785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52830c7b-5dda-4b6d-96b5-9e28570a5f79 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:33.276067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52830c7b-5dda-4b6d-96b5-9e28570a5f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:33.276337 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52830c7b-5dda-4b6d-96b5-9e28570a5f79 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:33.277089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52830c7b-5dda-4b6d-96b5-9e28570a5f79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:33.278579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52830c7b-5dda-4b6d-96b5-9e28570a5f79 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:33.301022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 569/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:13:33 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:13:35.422809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d003-bd4c-4043-8013-bb1d2e303619 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:35.423379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d003-bd4c-4043-8013-bb1d2e303619 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:35.423379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d003-bd4c-4043-8013-bb1d2e303619 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:35.424776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 570/1139] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:35.430282 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41da0ec-c7d0-466b-960a-a9ae8a1a22ec None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:35.430704 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41da0ec-c7d0-466b-960a-a9ae8a1a22ec None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:35.430853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41da0ec-c7d0-466b-960a-a9ae8a1a22ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:35.447613 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f41da0ec-c7d0-466b-960a-a9ae8a1a22ec None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:35.448812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f41da0ec-c7d0-466b-960a-a9ae8a1a22ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:35.474121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:35.519506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 570/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:13:35.543070 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d003-bd4c-4043-8013-bb1d2e303619 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:35.560907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:35.666049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d003-bd4c-4043-8013-bb1d2e303619 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:35.701772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71216643-ab46-4ee1-8f90-fa0602eb36ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:35.702495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71216643-ab46-4ee1-8f90-fa0602eb36ab None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:35.702782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71216643-ab46-4ee1-8f90-fa0602eb36ab None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:35.703059 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71216643-ab46-4ee1-8f90-fa0602eb36ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:35.713747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71216643-ab46-4ee1-8f90-fa0602eb36ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-71216643-ab46-4ee1-8f90-fa0602eb36ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:13:35.722042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:35.723236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:35.724274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 571/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:35.729465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41da0ec-c7d0-466b-960a-a9ae8a1a22ec None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:35.826990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41da0ec-c7d0-466b-960a-a9ae8a1a22ec None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:35.860800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f205ce-f747-4b5d-baf0-13c78b84612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:35.861498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f205ce-f747-4b5d-baf0-13c78b84612a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:35.861780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f205ce-f747-4b5d-baf0-13c78b84612a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:35.862055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f205ce-f747-4b5d-baf0-13c78b84612a None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:35.862799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f205ce-f747-4b5d-baf0-13c78b84612a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:35.863106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f205ce-f747-4b5d-baf0-13c78b84612a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:35.864492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f205ce-f747-4b5d-baf0-13c78b84612a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:35.872652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 571/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:35.878959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71216643-ab46-4ee1-8f90-fa0602eb36ab None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:35.956244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:35.981094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71216643-ab46-4ee1-8f90-fa0602eb36ab None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:36.014396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cbc00-9162-4ad1-b779-07be7239c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:36.015290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cbc00-9162-4ad1-b779-07be7239c280 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:36.015572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cbc00-9162-4ad1-b779-07be7239c280 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:36.015845 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cbc00-9162-4ad1-b779-07be7239c280 None admin] PATH_INFO: `/v3/users/05ddd848b72d461fa1ab2781546048ed` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:36.029999 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cbc00-9162-4ad1-b779-07be7239c280 None admin] RBAC: Authorizing `identity:get_user(user_id=05ddd848b72d461fa1ab2781546048ed)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:36.031478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cbc00-9162-4ad1-b779-07be7239c280 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:36.033242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 572/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:35 2022] GET /identity/v3/users/05ddd848b72d461fa1ab2781546048ed => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:36.039227 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f205ce-f747-4b5d-baf0-13c78b84612a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:36.064155 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:36.143072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f205ce-f747-4b5d-baf0-13c78b84612a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:36.179607 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ea83c-5a52-4a23-be84-9ef7080839b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:36.180260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ea83c-5a52-4a23-be84-9ef7080839b3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:36.180545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ea83c-5a52-4a23-be84-9ef7080839b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:36.181449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ea83c-5a52-4a23-be84-9ef7080839b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:36.255081 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ea83c-5a52-4a23-be84-9ef7080839b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:36.256470 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ea83c-5a52-4a23-be84-9ef7080839b3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:36.281105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:36.358656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 572/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:13:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:13:36.364771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cbc00-9162-4ad1-b779-07be7239c280 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:36.472465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cbc00-9162-4ad1-b779-07be7239c280 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:36.502174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:36.507801 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54ea4f-b87d-4d23-8707-a565755ef2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:36.508615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54ea4f-b87d-4d23-8707-a565755ef2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:36.508904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54ea4f-b87d-4d23-8707-a565755ef2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:36.509220 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54ea4f-b87d-4d23-8707-a565755ef2e4 None admin] PATH_INFO: `/v3/projects/c1fa0590d48949c2a37064d2c3d157ad` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:36.510413 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54ea4f-b87d-4d23-8707-a565755ef2e4 None admin] RBAC: Authorizing `identity:get_project(project_id=c1fa0590d48949c2a37064d2c3d157ad)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:36.511870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54ea4f-b87d-4d23-8707-a565755ef2e4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:36.514266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 573/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:13:36 2022] GET /identity/v3/projects/c1fa0590d48949c2a37064d2c3d157ad => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:36.520416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ea83c-5a52-4a23-be84-9ef7080839b3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:36.623977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ea83c-5a52-4a23-be84-9ef7080839b3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:36.657383 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:36.669610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1da65-029f-4b36-92b2-a7d644affacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:36.670268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1da65-029f-4b36-92b2-a7d644affacf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:36.670550 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1da65-029f-4b36-92b2-a7d644affacf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:36.670826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1da65-029f-4b36-92b2-a7d644affacf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:36.671663 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1da65-029f-4b36-92b2-a7d644affacf None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=c1fa0590d48949c2a37064d2c3d157ad, user.id=05ddd848b72d461fa1ab2781546048ed) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:36.672996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1da65-029f-4b36-92b2-a7d644affacf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:36.674631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1da65-029f-4b36-92b2-a7d644affacf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:36.681561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 573/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:13:36 2022] GET /identity/v3/role_assignments?user.id=05ddd848b72d461fa1ab2781546048ed&scope.project.id=c1fa0590d48949c2a37064d2c3d157ad&role.id=87593f63c4744eac870c07b006022e77 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:38.679939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644989b-1f72-4e86-a06a-85944ce28be5 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:38.680495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644989b-1f72-4e86-a06a-85944ce28be5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:38.680495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644989b-1f72-4e86-a06a-85944ce28be5 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:38.681915 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 574/1147] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:38.687612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b5d7e-39c8-4629-a078-d380c5e98b8f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:38.688046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b5d7e-39c8-4629-a078-d380c5e98b8f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:38.688176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b5d7e-39c8-4629-a078-d380c5e98b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:38.705887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-513b5d7e-39c8-4629-a078-d380c5e98b8f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:38.707068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-513b5d7e-39c8-4629-a078-d380c5e98b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:38.772124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 574/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:38.793997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644989b-1f72-4e86-a06a-85944ce28be5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:38.897412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644989b-1f72-4e86-a06a-85944ce28be5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:38.931160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4e09c-3564-4425-b629-c3814fd8dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:38.931958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4e09c-3564-4425-b629-c3814fd8dbdb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:38.932245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4e09c-3564-4425-b629-c3814fd8dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:38.932524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4e09c-3564-4425-b629-c3814fd8dbdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:38.943266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4e09c-3564-4425-b629-c3814fd8dbdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-3ef4e09c-3564-4425-b629-c3814fd8dbdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:13:38.951368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:38.952452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:38.953355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 575/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:38.958906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b5d7e-39c8-4629-a078-d380c5e98b8f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:39.062331 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b5d7e-39c8-4629-a078-d380c5e98b8f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:39.080048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:39.099501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b49d8a-de88-4294-a40a-efe7a26fca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:39.100209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b49d8a-de88-4294-a40a-efe7a26fca7a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:39.100519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b49d8a-de88-4294-a40a-efe7a26fca7a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:39.100819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b49d8a-de88-4294-a40a-efe7a26fca7a None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:39.101657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b49d8a-de88-4294-a40a-efe7a26fca7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:39.101968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b49d8a-de88-4294-a40a-efe7a26fca7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:39.103441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b49d8a-de88-4294-a40a-efe7a26fca7a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:39.111961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 575/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:13:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:39.117944 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4e09c-3564-4425-b629-c3814fd8dbdb None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:39.179851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:39.222817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4e09c-3564-4425-b629-c3814fd8dbdb None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:39.257207 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36c1ae-8c10-4dbb-b8a4-9254d1c8d0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:39.258076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36c1ae-8c10-4dbb-b8a4-9254d1c8d0dd None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:39.258356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36c1ae-8c10-4dbb-b8a4-9254d1c8d0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:39.258631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36c1ae-8c10-4dbb-b8a4-9254d1c8d0dd None admin] PATH_INFO: `/v3/users/05ddd848b72d461fa1ab2781546048ed` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:39.259818 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36c1ae-8c10-4dbb-b8a4-9254d1c8d0dd None admin] RBAC: Authorizing `identity:get_user(user_id=05ddd848b72d461fa1ab2781546048ed)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:39.261316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36c1ae-8c10-4dbb-b8a4-9254d1c8d0dd None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:39.263029 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 576/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:39 2022] GET /identity/v3/users/05ddd848b72d461fa1ab2781546048ed => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:39.269432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b49d8a-de88-4294-a40a-efe7a26fca7a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:39.371167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b49d8a-de88-4294-a40a-efe7a26fca7a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:39.406380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9561122-1902-482b-9216-c95882ef9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:39.407245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9561122-1902-482b-9216-c95882ef9744 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:39.407531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9561122-1902-482b-9216-c95882ef9744 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:39.407815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9561122-1902-482b-9216-c95882ef9744 None admin] PATH_INFO: `/v3/projects/c1fa0590d48949c2a37064d2c3d157ad` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:39.408997 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9561122-1902-482b-9216-c95882ef9744 None admin] RBAC: Authorizing `identity:get_project(project_id=c1fa0590d48949c2a37064d2c3d157ad)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:39.410594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9561122-1902-482b-9216-c95882ef9744 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:39.412316 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 576/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:13:39 2022] GET /identity/v3/projects/c1fa0590d48949c2a37064d2c3d157ad => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:39.418354 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36c1ae-8c10-4dbb-b8a4-9254d1c8d0dd None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:39.526295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36c1ae-8c10-4dbb-b8a4-9254d1c8d0dd None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:39.554250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:39.563345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b014fa-9ef6-4e6c-923d-3d90784a2720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:39.564253 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b014fa-9ef6-4e6c-923d-3d90784a2720 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:39.564553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b014fa-9ef6-4e6c-923d-3d90784a2720 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:39.564823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b014fa-9ef6-4e6c-923d-3d90784a2720 None admin] PATH_INFO: `/v3/projects/c1fa0590d48949c2a37064d2c3d157ad/users/05ddd848b72d461fa1ab2781546048ed/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:39.566895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b014fa-9ef6-4e6c-923d-3d90784a2720 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1fa0590d48949c2a37064d2c3d157ad, user_id=05ddd848b72d461fa1ab2781546048ed, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:39.568347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b014fa-9ef6-4e6c-923d-3d90784a2720 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:39.582915 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 577/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:13:39 2022] PUT /identity/v3/projects/c1fa0590d48949c2a37064d2c3d157ad/users/05ddd848b72d461fa1ab2781546048ed/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:13:41.820094 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f01df1-be88-47a6-b190-28d7298a9655 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:41.820643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f01df1-be88-47a6-b190-28d7298a9655 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:41.820643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f01df1-be88-47a6-b190-28d7298a9655 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:41.822926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 577/1154] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:41.828998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c152f0b-fa4e-467a-8a32-aa0939adf0d4 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:41.829510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c152f0b-fa4e-467a-8a32-aa0939adf0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:41.829613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c152f0b-fa4e-467a-8a32-aa0939adf0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:41.852718 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8c152f0b-fa4e-467a-8a32-aa0939adf0d4 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:41.853864 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8c152f0b-fa4e-467a-8a32-aa0939adf0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:41.922978 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 578/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:41.946464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f01df1-be88-47a6-b190-28d7298a9655 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:41.994927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:42.054736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f01df1-be88-47a6-b190-28d7298a9655 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:42.095721 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a31234-1fbb-4fce-8cd6-163349b76e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:42.096670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a31234-1fbb-4fce-8cd6-163349b76e3a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:42.096982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a31234-1fbb-4fce-8cd6-163349b76e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:42.097336 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a31234-1fbb-4fce-8cd6-163349b76e3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:42.111029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a31234-1fbb-4fce-8cd6-163349b76e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d9a31234-1fbb-4fce-8cd6-163349b76e3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:13:42.119925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:42.121193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:42.122938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 578/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:13:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:42.128641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c152f0b-fa4e-467a-8a32-aa0939adf0d4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:42.235853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c152f0b-fa4e-467a-8a32-aa0939adf0d4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:42.252678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:42.271730 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d08d0-b2d1-47aa-a618-cffcbeae13cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:42.272490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d08d0-b2d1-47aa-a618-cffcbeae13cb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:42.273007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d08d0-b2d1-47aa-a618-cffcbeae13cb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:42.273335 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d08d0-b2d1-47aa-a618-cffcbeae13cb None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:42.274177 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d08d0-b2d1-47aa-a618-cffcbeae13cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:42.274502 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d08d0-b2d1-47aa-a618-cffcbeae13cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:42.276779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d08d0-b2d1-47aa-a618-cffcbeae13cb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:42.288191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 579/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:13:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:42.295752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a31234-1fbb-4fce-8cd6-163349b76e3a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:42.395223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a31234-1fbb-4fce-8cd6-163349b76e3a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:42.403589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:42.433638 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8408b5-59ba-4e59-9bbc-2f5e90d6453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:42.434544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8408b5-59ba-4e59-9bbc-2f5e90d6453b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:42.434827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8408b5-59ba-4e59-9bbc-2f5e90d6453b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:42.435101 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8408b5-59ba-4e59-9bbc-2f5e90d6453b None admin] PATH_INFO: `/v3/users/05ddd848b72d461fa1ab2781546048ed` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:42.436326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8408b5-59ba-4e59-9bbc-2f5e90d6453b None admin] RBAC: Authorizing `identity:get_user(user_id=05ddd848b72d461fa1ab2781546048ed)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:42.437809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8408b5-59ba-4e59-9bbc-2f5e90d6453b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:42.439468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 579/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:42 2022] GET /identity/v3/users/05ddd848b72d461fa1ab2781546048ed => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:42.446045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d08d0-b2d1-47aa-a618-cffcbeae13cb None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:42.572376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d08d0-b2d1-47aa-a618-cffcbeae13cb None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:42.612285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf499612-3cf6-47f5-aa2e-cf990b2e2707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:42.612945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf499612-3cf6-47f5-aa2e-cf990b2e2707 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:42.613269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf499612-3cf6-47f5-aa2e-cf990b2e2707 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:42.613550 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf499612-3cf6-47f5-aa2e-cf990b2e2707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:42.665184 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:42.685181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf499612-3cf6-47f5-aa2e-cf990b2e2707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:42.686653 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf499612-3cf6-47f5-aa2e-cf990b2e2707 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:42.789841 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 580/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:13:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 15:13:42.795856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8408b5-59ba-4e59-9bbc-2f5e90d6453b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:42.903527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8408b5-59ba-4e59-9bbc-2f5e90d6453b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:42.940187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3208420-f171-4cc9-b2b5-28a1138910a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:42.940970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3208420-f171-4cc9-b2b5-28a1138910a9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:42.941286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3208420-f171-4cc9-b2b5-28a1138910a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:42.941570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3208420-f171-4cc9-b2b5-28a1138910a9 None admin] PATH_INFO: `/v3/projects/c1fa0590d48949c2a37064d2c3d157ad` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:42.942779 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3208420-f171-4cc9-b2b5-28a1138910a9 None admin] RBAC: Authorizing `identity:get_project(project_id=c1fa0590d48949c2a37064d2c3d157ad)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:42.944236 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3208420-f171-4cc9-b2b5-28a1138910a9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:42.945978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 580/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:13:42 2022] GET /identity/v3/projects/c1fa0590d48949c2a37064d2c3d157ad => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:42.952817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf499612-3cf6-47f5-aa2e-cf990b2e2707 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:43.047634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:43.071722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf499612-3cf6-47f5-aa2e-cf990b2e2707 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:43.110068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1cf1a-561f-468b-96fc-c9c25e489409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:43.110727 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1cf1a-561f-468b-96fc-c9c25e489409 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:43.111016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1cf1a-561f-468b-96fc-c9c25e489409 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:43.111297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1cf1a-561f-468b-96fc-c9c25e489409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:43.112133 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1cf1a-561f-468b-96fc-c9c25e489409 None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=c1fa0590d48949c2a37064d2c3d157ad, user.id=05ddd848b72d461fa1ab2781546048ed) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:43.112456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1cf1a-561f-468b-96fc-c9c25e489409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:43.114080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1cf1a-561f-468b-96fc-c9c25e489409 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:43.122705 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 581/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:13:42 2022] GET /identity/v3/role_assignments?user.id=05ddd848b72d461fa1ab2781546048ed&scope.project.id=c1fa0590d48949c2a37064d2c3d157ad&role.id=87593f63c4744eac870c07b006022e77 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:45.180389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c679-bb4f-4beb-8d15-c612e6e7d2a9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:45.181006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c679-bb4f-4beb-8d15-c612e6e7d2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:45.181006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c679-bb4f-4beb-8d15-c612e6e7d2a9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:45.182323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 581/1162] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:45.188670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1250704-efab-4937-b4cb-106a95b6c993 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:45.189194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1250704-efab-4937-b4cb-106a95b6c993 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:45.189461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1250704-efab-4937-b4cb-106a95b6c993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:45.208034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a1250704-efab-4937-b4cb-106a95b6c993 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:45.209364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a1250704-efab-4937-b4cb-106a95b6c993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:45.280504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 582/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:45.303573 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c679-bb4f-4beb-8d15-c612e6e7d2a9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:45.354433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:45.421975 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c679-bb4f-4beb-8d15-c612e6e7d2a9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:45.460746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de160-0227-4acd-9a9d-7ed5a4755a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:45.461349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de160-0227-4acd-9a9d-7ed5a4755a58 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:45.461657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de160-0227-4acd-9a9d-7ed5a4755a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:45.461938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de160-0227-4acd-9a9d-7ed5a4755a58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:45.534710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2de160-0227-4acd-9a9d-7ed5a4755a58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:45.536686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2de160-0227-4acd-9a9d-7ed5a4755a58 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:45.586497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:45.665818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 582/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:13:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:13:45.675901 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1250704-efab-4937-b4cb-106a95b6c993 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:45.782398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:45.811607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1250704-efab-4937-b4cb-106a95b6c993 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:45.846324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcc506-57c5-4f51-bcf9-20c853b2a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:45.847129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcc506-57c5-4f51-bcf9-20c853b2a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:45.847409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcc506-57c5-4f51-bcf9-20c853b2a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:45.847688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcc506-57c5-4f51-bcf9-20c853b2a9c0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:45.854506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcc506-57c5-4f51-bcf9-20c853b2a9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:45.856491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcc506-57c5-4f51-bcf9-20c853b2a9c0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-5cdcc506-57c5-4f51-bcf9-20c853b2a9c0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:45.870594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:45.872524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 15 15:13:45.873656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:13:45.877218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 583/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Jul 15 15:13:45 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:45.878884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de160-0227-4acd-9a9d-7ed5a4755a58 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:45.984114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de160-0227-4acd-9a9d-7ed5a4755a58 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:46.028833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e606e1e-f48c-4e79-9f01-b39e4d3fff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:46.029542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e606e1e-f48c-4e79-9f01-b39e4d3fff57 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:46.029906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e606e1e-f48c-4e79-9f01-b39e4d3fff57 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:46.030099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e606e1e-f48c-4e79-9f01-b39e4d3fff57 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:46.030982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e606e1e-f48c-4e79-9f01-b39e4d3fff57 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:46.031140 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e606e1e-f48c-4e79-9f01-b39e4d3fff57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:46.032596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e606e1e-f48c-4e79-9f01-b39e4d3fff57 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:46.040223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 583/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Jul 15 15:13:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:48.160986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a89436-ea0a-4c02-971e-6c9ebb741a62 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:48.161610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a89436-ea0a-4c02-971e-6c9ebb741a62 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:48.161610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a89436-ea0a-4c02-971e-6c9ebb741a62 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:48.162988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 584/1167] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:48.170012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd14cb8-72a6-4271-bfe8-180680ec1bf6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:48.170460 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd14cb8-72a6-4271-bfe8-180680ec1bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:48.170580 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd14cb8-72a6-4271-bfe8-180680ec1bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:48.182264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:48.188552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4fd14cb8-72a6-4271-bfe8-180680ec1bf6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:48.189789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4fd14cb8-72a6-4271-bfe8-180680ec1bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:48.257675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 584/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:48.282765 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a89436-ea0a-4c02-971e-6c9ebb741a62 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:48.393228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a89436-ea0a-4c02-971e-6c9ebb741a62 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:48.427317 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98976157-1edc-4f12-b29c-6b9dd87dc512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:48.427902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98976157-1edc-4f12-b29c-6b9dd87dc512 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:48.428184 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98976157-1edc-4f12-b29c-6b9dd87dc512 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:48.428461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98976157-1edc-4f12-b29c-6b9dd87dc512 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:48.429286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98976157-1edc-4f12-b29c-6b9dd87dc512 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:48.430676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98976157-1edc-4f12-b29c-6b9dd87dc512 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:48.433276 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:48.445871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 585/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Fri Jul 15 15:13:48 2022] POST /identity/v3/domains => generated 267 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:13:50.547571 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30316550-78e7-4519-8df6-7b3bb74b3cca None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:50.548193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30316550-78e7-4519-8df6-7b3bb74b3cca None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:50.548193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30316550-78e7-4519-8df6-7b3bb74b3cca None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:50.549692 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 585/1170] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:50.556668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855972c-46aa-4fb5-8743-bdac753a921f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:50.557311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855972c-46aa-4fb5-8743-bdac753a921f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:50.557707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855972c-46aa-4fb5-8743-bdac753a921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:50.588261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1855972c-46aa-4fb5-8743-bdac753a921f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:50.590286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1855972c-46aa-4fb5-8743-bdac753a921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:50.671736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 586/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:50.695269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30316550-78e7-4519-8df6-7b3bb74b3cca None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:50.799706 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30316550-78e7-4519-8df6-7b3bb74b3cca None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:50.835617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b054828-ce33-43af-a7c2-d6c7ffff39c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:50.836684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b054828-ce33-43af-a7c2-d6c7ffff39c8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:50.836970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b054828-ce33-43af-a7c2-d6c7ffff39c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:50.837270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b054828-ce33-43af-a7c2-d6c7ffff39c8 None admin] PATH_INFO: `/v3/domains/00a0f3089335461095641c2a317b40f5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:50.840974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:50.850074 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b054828-ce33-43af-a7c2-d6c7ffff39c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=00a0f3089335461095641c2a317b40f5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:50.851868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b054828-ce33-43af-a7c2-d6c7ffff39c8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:50.853644 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 586/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Fri Jul 15 15:13:50 2022] GET /identity/v3/domains/00a0f3089335461095641c2a317b40f5 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:50.861506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855972c-46aa-4fb5-8743-bdac753a921f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:50.982542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855972c-46aa-4fb5-8743-bdac753a921f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:51.007679 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:51.020404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29d3e-ce94-4a62-ad38-42f0bf103996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:51.021108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29d3e-ce94-4a62-ad38-42f0bf103996 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:51.021405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29d3e-ce94-4a62-ad38-42f0bf103996 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:51.021686 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29d3e-ce94-4a62-ad38-42f0bf103996 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:51.022412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d29d3e-ce94-4a62-ad38-42f0bf103996 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:51.023881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d29d3e-ce94-4a62-ad38-42f0bf103996 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:51.051669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 587/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:13:50 2022] POST /identity/v3/projects => generated 361 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:13:53.132042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aef9e8-8ed9-4621-97e9-5cb35d1f90b1 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:53.132604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aef9e8-8ed9-4621-97e9-5cb35d1f90b1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:53.132699 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aef9e8-8ed9-4621-97e9-5cb35d1f90b1 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:53.134059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 587/1174] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:53.139666 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f2da8-b363-48da-b118-eea48e5b6a26 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:53.140122 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f2da8-b363-48da-b118-eea48e5b6a26 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:53.140246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f2da8-b363-48da-b118-eea48e5b6a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:53.157338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-573f2da8-b363-48da-b118-eea48e5b6a26 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:53.158565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-573f2da8-b363-48da-b118-eea48e5b6a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:53.234112 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 588/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:53.259734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aef9e8-8ed9-4621-97e9-5cb35d1f90b1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:53.384519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aef9e8-8ed9-4621-97e9-5cb35d1f90b1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:53.440502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c71980-1c92-4ded-944f-cd57211180c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:53.442064 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c71980-1c92-4ded-944f-cd57211180c9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:53.442542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c71980-1c92-4ded-944f-cd57211180c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:53.443019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c71980-1c92-4ded-944f-cd57211180c9 None admin] PATH_INFO: `/v3/domains/00a0f3089335461095641c2a317b40f5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:53.445042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c71980-1c92-4ded-944f-cd57211180c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=00a0f3089335461095641c2a317b40f5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:53.447670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c71980-1c92-4ded-944f-cd57211180c9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:53.451204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 588/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Fri Jul 15 15:13:53 2022] GET /identity/v3/domains/00a0f3089335461095641c2a317b40f5 => generated 267 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:53.457233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f2da8-b363-48da-b118-eea48e5b6a26 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:53.563393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f2da8-b363-48da-b118-eea48e5b6a26 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:53.571016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:53.610805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e6f89-5590-44a6-a13a-7227e627bf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:53.611496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e6f89-5590-44a6-a13a-7227e627bf87 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:53.611783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e6f89-5590-44a6-a13a-7227e627bf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:53.612061 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e6f89-5590-44a6-a13a-7227e627bf87 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:53.612783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e6f89-5590-44a6-a13a-7227e627bf87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:53.614274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e6f89-5590-44a6-a13a-7227e627bf87 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:53.636314 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 589/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:13:53 2022] POST /identity/v3/users => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:13:55.773091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40696fa-55d1-4b83-af96-19b6d64062ce None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:55.773624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40696fa-55d1-4b83-af96-19b6d64062ce None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:55.773749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40696fa-55d1-4b83-af96-19b6d64062ce None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:55.775046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 589/1178] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:55.781033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63554-df29-4ac5-b693-3e8f6429f2e4 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:55.781654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63554-df29-4ac5-b693-3e8f6429f2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:55.781654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63554-df29-4ac5-b693-3e8f6429f2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:55.798758 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c6f63554-df29-4ac5-b693-3e8f6429f2e4 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:55.799963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c6f63554-df29-4ac5-b693-3e8f6429f2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:55.866554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 590/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:55.889946 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40696fa-55d1-4b83-af96-19b6d64062ce None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:55.961832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:56.003934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40696fa-55d1-4b83-af96-19b6d64062ce None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:56.037747 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb2cd3-b221-4a15-b9b6-c903fc122729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:56.038543 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb2cd3-b221-4a15-b9b6-c903fc122729 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:56.038829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb2cd3-b221-4a15-b9b6-c903fc122729 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:56.039106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb2cd3-b221-4a15-b9b6-c903fc122729 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:56.050299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb2cd3-b221-4a15-b9b6-c903fc122729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-89fb2cd3-b221-4a15-b9b6-c903fc122729 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:13:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:56.059049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:56.059925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 590/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:56.065424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63554-df29-4ac5-b693-3e8f6429f2e4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:56.167870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:56.177291 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63554-df29-4ac5-b693-3e8f6429f2e4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:56.210969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165d8fc-a56c-4eaf-9b23-8452780dbb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:56.211640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165d8fc-a56c-4eaf-9b23-8452780dbb44 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:56.211926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165d8fc-a56c-4eaf-9b23-8452780dbb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:56.212202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165d8fc-a56c-4eaf-9b23-8452780dbb44 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:56.213038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165d8fc-a56c-4eaf-9b23-8452780dbb44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:56.213379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165d8fc-a56c-4eaf-9b23-8452780dbb44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:56.215303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165d8fc-a56c-4eaf-9b23-8452780dbb44 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:56.224011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 591/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:13:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:56.230237 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb2cd3-b221-4a15-b9b6-c903fc122729 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:56.328822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb2cd3-b221-4a15-b9b6-c903fc122729 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:56.351843 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:56.363039 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569d05d-5a12-4218-8c46-d0732b165ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:56.363913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569d05d-5a12-4218-8c46-d0732b165ceb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:56.364191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569d05d-5a12-4218-8c46-d0732b165ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:56.364460 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569d05d-5a12-4218-8c46-d0732b165ceb None admin] PATH_INFO: `/v3/users/61e29ed214c741309901d49b96cb1bcf` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:56.377809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569d05d-5a12-4218-8c46-d0732b165ceb None admin] RBAC: Authorizing `identity:get_user(user_id=61e29ed214c741309901d49b96cb1bcf)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:56.379259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569d05d-5a12-4218-8c46-d0732b165ceb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:56.380944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 591/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:56 2022] GET /identity/v3/users/61e29ed214c741309901d49b96cb1bcf => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:56.387345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165d8fc-a56c-4eaf-9b23-8452780dbb44 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:56.489543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165d8fc-a56c-4eaf-9b23-8452780dbb44 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:56.524613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa57b82-c6af-4deb-b7d5-843d0a4a7120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:56.525309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa57b82-c6af-4deb-b7d5-843d0a4a7120 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:56.525600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa57b82-c6af-4deb-b7d5-843d0a4a7120 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:56.525881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa57b82-c6af-4deb-b7d5-843d0a4a7120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:56.549772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:56.598993 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa57b82-c6af-4deb-b7d5-843d0a4a7120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:56.600521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa57b82-c6af-4deb-b7d5-843d0a4a7120 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:56.697778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 592/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:13:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:13:56.704363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569d05d-5a12-4218-8c46-d0732b165ceb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:56.812951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569d05d-5a12-4218-8c46-d0732b165ceb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:56.846548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c0961-3b24-4c62-b56b-84fae676aedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:56.847409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c0961-3b24-4c62-b56b-84fae676aedb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:56.847695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c0961-3b24-4c62-b56b-84fae676aedb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:56.847974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c0961-3b24-4c62-b56b-84fae676aedb None admin] PATH_INFO: `/v3/projects/5a3a9d91619e4986ae49e2c45f922501` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:56.849170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c0961-3b24-4c62-b56b-84fae676aedb None admin] RBAC: Authorizing `identity:get_project(project_id=5a3a9d91619e4986ae49e2c45f922501)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:56.850620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c0961-3b24-4c62-b56b-84fae676aedb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:56.852311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 592/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:13:56 2022] GET /identity/v3/projects/5a3a9d91619e4986ae49e2c45f922501 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:56.858994 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa57b82-c6af-4deb-b7d5-843d0a4a7120 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:56.913150 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:56.960639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa57b82-c6af-4deb-b7d5-843d0a4a7120 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:56.994540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1a057-f118-4677-8850-82cc11d4ca1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:56.995197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1a057-f118-4677-8850-82cc11d4ca1d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:56.995486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1a057-f118-4677-8850-82cc11d4ca1d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:56.995844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1a057-f118-4677-8850-82cc11d4ca1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:56.997381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1a057-f118-4677-8850-82cc11d4ca1d None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=5a3a9d91619e4986ae49e2c45f922501, user.id=61e29ed214c741309901d49b96cb1bcf) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:56.997701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1a057-f118-4677-8850-82cc11d4ca1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:56.999154 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1a057-f118-4677-8850-82cc11d4ca1d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:57.005132 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 593/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:13:56 2022] GET /identity/v3/role_assignments?user.id=61e29ed214c741309901d49b96cb1bcf&scope.project.id=5a3a9d91619e4986ae49e2c45f922501&role.id=87593f63c4744eac870c07b006022e77 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:59.007645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67f95d-d959-47a2-9836-619793cb7eed None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:59.008147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67f95d-d959-47a2-9836-619793cb7eed None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:59.008147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67f95d-d959-47a2-9836-619793cb7eed None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:59.009524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 593/1186] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:13:59.014927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229399af-657a-42e1-8424-4274a83f472c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:59.015375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229399af-657a-42e1-8424-4274a83f472c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:59.015493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229399af-657a-42e1-8424-4274a83f472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:59.032674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-229399af-657a-42e1-8424-4274a83f472c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:13:59.033920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-229399af-657a-42e1-8424-4274a83f472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:13:59.102386 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 594/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:13:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:13:59.125045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67f95d-d959-47a2-9836-619793cb7eed None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:59.184226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:59.238298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67f95d-d959-47a2-9836-619793cb7eed None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:59.271543 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92c4dd-ef8b-4535-8618-8f8813a191cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:59.272256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92c4dd-ef8b-4535-8618-8f8813a191cd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:59.272537 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92c4dd-ef8b-4535-8618-8f8813a191cd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:59.272811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92c4dd-ef8b-4535-8618-8f8813a191cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:59.283207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92c4dd-ef8b-4535-8618-8f8813a191cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-df92c4dd-ef8b-4535-8618-8f8813a191cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:13:59.290739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:13:59.291841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:13:59.292972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 594/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:13:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:13:59.298173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229399af-657a-42e1-8424-4274a83f472c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:59.345752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:59.395822 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229399af-657a-42e1-8424-4274a83f472c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:59.432432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0299b-0a37-4484-b1d8-1aa9778f1214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:59.433162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0299b-0a37-4484-b1d8-1aa9778f1214 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:59.433453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0299b-0a37-4484-b1d8-1aa9778f1214 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:59.433734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0299b-0a37-4484-b1d8-1aa9778f1214 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:59.434495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0299b-0a37-4484-b1d8-1aa9778f1214 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:13:59.434808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0299b-0a37-4484-b1d8-1aa9778f1214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:59.436200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0299b-0a37-4484-b1d8-1aa9778f1214 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:59.444601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 595/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:13:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:13:59.451442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92c4dd-ef8b-4535-8618-8f8813a191cd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:59.582820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92c4dd-ef8b-4535-8618-8f8813a191cd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:59.593304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:59.622361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59108a9-e2e8-430d-b06d-d5152844970a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:59.623237 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59108a9-e2e8-430d-b06d-d5152844970a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:59.623520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59108a9-e2e8-430d-b06d-d5152844970a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:59.623794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59108a9-e2e8-430d-b06d-d5152844970a None admin] PATH_INFO: `/v3/users/61e29ed214c741309901d49b96cb1bcf` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:59.624975 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59108a9-e2e8-430d-b06d-d5152844970a None admin] RBAC: Authorizing `identity:get_user(user_id=61e29ed214c741309901d49b96cb1bcf)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:59.626724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59108a9-e2e8-430d-b06d-d5152844970a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:59.628341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 595/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:13:59 2022] GET /identity/v3/users/61e29ed214c741309901d49b96cb1bcf => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:59.634197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0299b-0a37-4484-b1d8-1aa9778f1214 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:59.743231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0299b-0a37-4484-b1d8-1aa9778f1214 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:59.753892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:13:59.778886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02297c-5d00-45c3-a725-15777a73cf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:59.779815 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02297c-5d00-45c3-a725-15777a73cf05 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:59.780050 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02297c-5d00-45c3-a725-15777a73cf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:59.780332 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02297c-5d00-45c3-a725-15777a73cf05 None admin] PATH_INFO: `/v3/projects/5a3a9d91619e4986ae49e2c45f922501` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:59.781777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02297c-5d00-45c3-a725-15777a73cf05 None admin] RBAC: Authorizing `identity:get_project(project_id=5a3a9d91619e4986ae49e2c45f922501)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:59.783465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02297c-5d00-45c3-a725-15777a73cf05 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:59.785356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 596/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:13:59 2022] GET /identity/v3/projects/5a3a9d91619e4986ae49e2c45f922501 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:13:59.791496 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59108a9-e2e8-430d-b06d-d5152844970a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:13:59.903545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59108a9-e2e8-430d-b06d-d5152844970a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:13:59.937687 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b8dbf-0635-410f-97a5-372cc7453968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:13:59.938572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b8dbf-0635-410f-97a5-372cc7453968 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:13:59.938854 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b8dbf-0635-410f-97a5-372cc7453968 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:13:59.939178 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b8dbf-0635-410f-97a5-372cc7453968 None admin] PATH_INFO: `/v3/projects/5a3a9d91619e4986ae49e2c45f922501/users/61e29ed214c741309901d49b96cb1bcf/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:13:59.941631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b8dbf-0635-410f-97a5-372cc7453968 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a3a9d91619e4986ae49e2c45f922501, user_id=61e29ed214c741309901d49b96cb1bcf, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:13:59.943088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b8dbf-0635-410f-97a5-372cc7453968 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:13:59.963054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 596/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:13:59 2022] PUT /identity/v3/projects/5a3a9d91619e4986ae49e2c45f922501/users/61e29ed214c741309901d49b96cb1bcf/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:14:02.011629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f066-2a98-4ce3-8ea1-7841e4e2151a None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:14:02.012465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f066-2a98-4ce3-8ea1-7841e4e2151a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:14:02.012465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f066-2a98-4ce3-8ea1-7841e4e2151a None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:14:02.013800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 597/1193] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:14:02.023232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca04f-9ce0-4d0c-9132-8f61a1eac4d3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:14:02.023812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca04f-9ce0-4d0c-9132-8f61a1eac4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:14:02.024321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca04f-9ce0-4d0c-9132-8f61a1eac4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:14:02.044508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cf5ca04f-9ce0-4d0c-9132-8f61a1eac4d3 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:14:02.045769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cf5ca04f-9ce0-4d0c-9132-8f61a1eac4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:14:02.078285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:14:02.118189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 597/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:14:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:14:02.142609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f066-2a98-4ce3-8ea1-7841e4e2151a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:14:02.246558 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f066-2a98-4ce3-8ea1-7841e4e2151a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:14:02.280920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4c0b4-400c-4eb2-aa27-7c3ee1f9e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:14:02.281666 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4c0b4-400c-4eb2-aa27-7c3ee1f9e17b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:14:02.281956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4c0b4-400c-4eb2-aa27-7c3ee1f9e17b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:14:02.282231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4c0b4-400c-4eb2-aa27-7c3ee1f9e17b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:14:02.293288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4c0b4-400c-4eb2-aa27-7c3ee1f9e17b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-14e4c0b4-400c-4eb2-aa27-7c3ee1f9e17b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:14:02.300976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:14:02.302425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:14:02.303529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 598/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:14:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:14:02.309269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca04f-9ce0-4d0c-9132-8f61a1eac4d3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:14:02.423642 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca04f-9ce0-4d0c-9132-8f61a1eac4d3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:14:02.463914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4336b-a421-4148-93f3-4aa5aa13a513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:14:02.465143 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4336b-a421-4148-93f3-4aa5aa13a513 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:14:02.465432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4336b-a421-4148-93f3-4aa5aa13a513 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:14:02.465705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4336b-a421-4148-93f3-4aa5aa13a513 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:14:02.466461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4336b-a421-4148-93f3-4aa5aa13a513 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:14:02.466769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4336b-a421-4148-93f3-4aa5aa13a513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:14:02.468165 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4336b-a421-4148-93f3-4aa5aa13a513 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:14:02.476813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 598/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:14:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:14:02.483707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4c0b4-400c-4eb2-aa27-7c3ee1f9e17b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:14:02.525913 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:14:02.590883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4c0b4-400c-4eb2-aa27-7c3ee1f9e17b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:14:02.629630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaba9a-064c-4cae-aa3f-25a58fbdcdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:14:02.630574 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaba9a-064c-4cae-aa3f-25a58fbdcdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:14:02.630903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaba9a-064c-4cae-aa3f-25a58fbdcdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:14:02.631228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaba9a-064c-4cae-aa3f-25a58fbdcdf4 None admin] PATH_INFO: `/v3/users/61e29ed214c741309901d49b96cb1bcf` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:14:02.632547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaba9a-064c-4cae-aa3f-25a58fbdcdf4 None admin] RBAC: Authorizing `identity:get_user(user_id=61e29ed214c741309901d49b96cb1bcf)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:14:02.634102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaba9a-064c-4cae-aa3f-25a58fbdcdf4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:14:02.635797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 599/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Jul 15 15:14:02 2022] GET /identity/v3/users/61e29ed214c741309901d49b96cb1bcf => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:14:02.641942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4336b-a421-4148-93f3-4aa5aa13a513 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:14:02.675429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:14:02.749887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4336b-a421-4148-93f3-4aa5aa13a513 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:14:02.784707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5daf-ab01-4850-b85b-2a3636135e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:14:02.785396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5daf-ab01-4850-b85b-2a3636135e09 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:14:02.785681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5daf-ab01-4850-b85b-2a3636135e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:14:02.785959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5daf-ab01-4850-b85b-2a3636135e09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:14:02.856467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5daf-ab01-4850-b85b-2a3636135e09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:14:02.857895 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5daf-ab01-4850-b85b-2a3636135e09 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:14:02.889836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:14:02.971381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 599/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:14:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:14:02.977483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaba9a-064c-4cae-aa3f-25a58fbdcdf4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:14:03.089816 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaba9a-064c-4cae-aa3f-25a58fbdcdf4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:14:03.098011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:14:03.131286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0798588-ee7a-4d73-9471-f298f6c24373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:14:03.132085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0798588-ee7a-4d73-9471-f298f6c24373 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:14:03.132372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0798588-ee7a-4d73-9471-f298f6c24373 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:14:03.132654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0798588-ee7a-4d73-9471-f298f6c24373 None admin] PATH_INFO: `/v3/projects/5a3a9d91619e4986ae49e2c45f922501` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:14:03.134034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0798588-ee7a-4d73-9471-f298f6c24373 None admin] RBAC: Authorizing `identity:get_project(project_id=5a3a9d91619e4986ae49e2c45f922501)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:14:03.135514 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0798588-ee7a-4d73-9471-f298f6c24373 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:14:03.137415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 600/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Jul 15 15:14:02 2022] GET /identity/v3/projects/5a3a9d91619e4986ae49e2c45f922501 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:14:03.144743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5daf-ab01-4850-b85b-2a3636135e09 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:14:03.247981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5daf-ab01-4850-b85b-2a3636135e09 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:14:03.286267 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:14:03.293381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46189d-4289-49c7-b9b5-fb31907812a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:14:03.294053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46189d-4289-49c7-b9b5-fb31907812a2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:14:03.294332 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46189d-4289-49c7-b9b5-fb31907812a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:14:03.294609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46189d-4289-49c7-b9b5-fb31907812a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:14:03.295459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46189d-4289-49c7-b9b5-fb31907812a2 None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=5a3a9d91619e4986ae49e2c45f922501, user.id=61e29ed214c741309901d49b96cb1bcf) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:14:03.295773 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46189d-4289-49c7-b9b5-fb31907812a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:14:03.297279 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46189d-4289-49c7-b9b5-fb31907812a2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:14:03.303798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 600/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:14:03 2022] GET /identity/v3/role_assignments?user.id=61e29ed214c741309901d49b96cb1bcf&scope.project.id=5a3a9d91619e4986ae49e2c45f922501&role.id=87593f63c4744eac870c07b006022e77 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:14:13.126768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=13 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:14:13.300812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:02.014528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d8cc6-c3ab-47d0-9662-2331252d06d5 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:02.015246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d8cc6-c3ab-47d0-9662-2331252d06d5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:02.015760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d8cc6-c3ab-47d0-9662-2331252d06d5 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:02.018595 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 601/1201] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:15:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:15:02.025878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b60589-2ff0-4dea-9d3c-944ff2168890 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:02.025878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b60589-2ff0-4dea-9d3c-944ff2168890 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:02.026539 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b60589-2ff0-4dea-9d3c-944ff2168890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:02.045656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f9b60589-2ff0-4dea-9d3c-944ff2168890 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:15:02.047151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f9b60589-2ff0-4dea-9d3c-944ff2168890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:15:02.150444 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 601/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:15:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:15:02.179517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d8cc6-c3ab-47d0-9662-2331252d06d5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:02.351402 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d8cc6-c3ab-47d0-9662-2331252d06d5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:02.403376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f71f5-bdef-49c1-ac0f-7bd087468879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:02.404185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f71f5-bdef-49c1-ac0f-7bd087468879 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:02.404496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f71f5-bdef-49c1-ac0f-7bd087468879 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:02.404829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f71f5-bdef-49c1-ac0f-7bd087468879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:02.417882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f71f5-bdef-49c1-ac0f-7bd087468879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:02.419371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f71f5-bdef-49c1-ac0f-7bd087468879 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-bf7f71f5-bdef-49c1-ac0f-7bd087468879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:02.440692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:02.442405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:02.443505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:02.443505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:02.443505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:02.443505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:02.443505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 602/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:02.450870 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b60589-2ff0-4dea-9d3c-944ff2168890 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:02.662981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b60589-2ff0-4dea-9d3c-944ff2168890 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:02.706645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:02.723132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087254c-f4ac-42a1-8f9b-716d8d1b2279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:02.724254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087254c-f4ac-42a1-8f9b-716d8d1b2279 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:02.724705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087254c-f4ac-42a1-8f9b-716d8d1b2279 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:02.725206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087254c-f4ac-42a1-8f9b-716d8d1b2279 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:02.726411 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087254c-f4ac-42a1-8f9b-716d8d1b2279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:02.726972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087254c-f4ac-42a1-8f9b-716d8d1b2279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:02.729396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087254c-f4ac-42a1-8f9b-716d8d1b2279 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:02.750972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 602/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:02.757348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f71f5-bdef-49c1-ac0f-7bd087468879 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:02.843145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:02.919111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f71f5-bdef-49c1-ac0f-7bd087468879 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:02.979913 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08d941-d8ed-4c40-b88a-d47e0a1719de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:02.981091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08d941-d8ed-4c40-b88a-d47e0a1719de None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:02.981602 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08d941-d8ed-4c40-b88a-d47e0a1719de None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:02.982078 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08d941-d8ed-4c40-b88a-d47e0a1719de None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:02.986957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08d941-d8ed-4c40-b88a-d47e0a1719de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:02.986957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08d941-d8ed-4c40-b88a-d47e0a1719de None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:03.020211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 603/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Jul 15 15:15:02 2022] POST /identity/v3/users => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:15:05.446611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e686c-8ad9-44c2-ad58-7a03f7f911a6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:05.447228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e686c-8ad9-44c2-ad58-7a03f7f911a6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:05.447228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e686c-8ad9-44c2-ad58-7a03f7f911a6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:05.449710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 603/1206] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:15:05.455092 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6fbca-e00c-41c9-a544-7ea1f1fb447b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:05.455628 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6fbca-e00c-41c9-a544-7ea1f1fb447b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:05.455884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6fbca-e00c-41c9-a544-7ea1f1fb447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:05.493408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b4b6fbca-e00c-41c9-a544-7ea1f1fb447b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:15:05.495067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b4b6fbca-e00c-41c9-a544-7ea1f1fb447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:15:05.605987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 604/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:15:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:15:05.634151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e686c-8ad9-44c2-ad58-7a03f7f911a6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:05.812812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e686c-8ad9-44c2-ad58-7a03f7f911a6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:05.870592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a191-6485-4c8b-aadb-eaf44b245513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:05.871425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a191-6485-4c8b-aadb-eaf44b245513 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:05.871712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a191-6485-4c8b-aadb-eaf44b245513 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:05.872081 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a191-6485-4c8b-aadb-eaf44b245513 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:05.891832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91a191-6485-4c8b-aadb-eaf44b245513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8e91a191-6485-4c8b-aadb-eaf44b245513 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:15:05.905700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:05.906786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:05.907648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:05.907648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:05.907648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:05.907648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:05.907648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:15:05.907648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:15:05.907648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:15:05.907648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:15:05.907648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:15:05.907648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:15:05.907648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:15:05.907648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:05.913116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 604/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:15:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:05.917023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6fbca-e00c-41c9-a544-7ea1f1fb447b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:05.972184 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:06.060967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6fbca-e00c-41c9-a544-7ea1f1fb447b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:06.107875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79876451-0f76-40f3-835f-d8ef604d329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:06.108648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79876451-0f76-40f3-835f-d8ef604d329f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:06.108936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79876451-0f76-40f3-835f-d8ef604d329f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:06.109248 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79876451-0f76-40f3-835f-d8ef604d329f None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:06.110106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79876451-0f76-40f3-835f-d8ef604d329f None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:06.110501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79876451-0f76-40f3-835f-d8ef604d329f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:06.112539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79876451-0f76-40f3-835f-d8ef604d329f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:06.130949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 605/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:15:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:06.133411 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a191-6485-4c8b-aadb-eaf44b245513 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:06.203255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:06.282392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a191-6485-4c8b-aadb-eaf44b245513 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:06.345031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9cef2-e8f8-406e-aece-bf4b99bd65de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:06.346130 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9cef2-e8f8-406e-aece-bf4b99bd65de None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:06.346419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9cef2-e8f8-406e-aece-bf4b99bd65de None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:06.346743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9cef2-e8f8-406e-aece-bf4b99bd65de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:06.366390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9cef2-e8f8-406e-aece-bf4b99bd65de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:06.368367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9cef2-e8f8-406e-aece-bf4b99bd65de None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-bee9cef2-e8f8-406e-aece-bf4b99bd65de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:06.391595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:06.392579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:06.397965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:06.397965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:06.397965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:06.397965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:06.397965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 605/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:06.399327 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79876451-0f76-40f3-835f-d8ef604d329f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:06.556523 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:06.560272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79876451-0f76-40f3-835f-d8ef604d329f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:06.609795 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f743f29-9682-428b-b7a1-c4ea53eb66f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:06.609795 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f743f29-9682-428b-b7a1-c4ea53eb66f6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:06.610050 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f743f29-9682-428b-b7a1-c4ea53eb66f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:06.610392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f743f29-9682-428b-b7a1-c4ea53eb66f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:06.611153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f743f29-9682-428b-b7a1-c4ea53eb66f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:06.611512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f743f29-9682-428b-b7a1-c4ea53eb66f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:06.613025 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f743f29-9682-428b-b7a1-c4ea53eb66f6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:06.628813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 606/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:06.635914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9cef2-e8f8-406e-aece-bf4b99bd65de None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:06.801673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9cef2-e8f8-406e-aece-bf4b99bd65de None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:06.805423 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:06.858951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188066a-53ed-4408-ad14-ada04ddff85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:06.859861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188066a-53ed-4408-ad14-ada04ddff85f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:06.860151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188066a-53ed-4408-ad14-ada04ddff85f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:06.860447 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188066a-53ed-4408-ad14-ada04ddff85f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:06.869520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188066a-53ed-4408-ad14-ada04ddff85f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:06.871028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188066a-53ed-4408-ad14-ada04ddff85f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4188066a-53ed-4408-ad14-ada04ddff85f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:15:06.892893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:06.895024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:06.897000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:06.897000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:06.897000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:15:06.897000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:15:06.897000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:15:06.897000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:15:06.897000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:15:06.897000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:15:06.897000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:15:06.897000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:06.899936 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 606/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:06.901455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f743f29-9682-428b-b7a1-c4ea53eb66f6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:07.043294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f743f29-9682-428b-b7a1-c4ea53eb66f6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:07.096781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baebbe-49a6-406b-bbe0-b8cef507bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:07.096781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baebbe-49a6-406b-bbe0-b8cef507bb82 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:07.096781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baebbe-49a6-406b-bbe0-b8cef507bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:07.096781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baebbe-49a6-406b-bbe0-b8cef507bb82 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:07.097444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baebbe-49a6-406b-bbe0-b8cef507bb82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:07.097444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baebbe-49a6-406b-bbe0-b8cef507bb82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:07.097444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baebbe-49a6-406b-bbe0-b8cef507bb82 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:07.119635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 607/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Fri Jul 15 15:15:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:07.126136 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188066a-53ed-4408-ad14-ada04ddff85f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:07.285351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188066a-53ed-4408-ad14-ada04ddff85f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:07.336240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b110fea-ec53-4d32-9166-6b53691b6c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:07.336929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b110fea-ec53-4d32-9166-6b53691b6c04 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:07.337252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b110fea-ec53-4d32-9166-6b53691b6c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:07.337546 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b110fea-ec53-4d32-9166-6b53691b6c04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:07.379015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:07.451394 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b110fea-ec53-4d32-9166-6b53691b6c04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:07.453516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b110fea-ec53-4d32-9166-6b53691b6c04 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:07.618652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 607/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:15:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:15:07.624933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baebbe-49a6-406b-bbe0-b8cef507bb82 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:07.649096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:07.770532 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baebbe-49a6-406b-bbe0-b8cef507bb82 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:07.827600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebf593-c0e2-4ae7-b80d-0f4535ddc751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:07.829218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebf593-c0e2-4ae7-b80d-0f4535ddc751 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:07.829726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebf593-c0e2-4ae7-b80d-0f4535ddc751 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:07.830187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebf593-c0e2-4ae7-b80d-0f4535ddc751 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:07.854270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebf593-c0e2-4ae7-b80d-0f4535ddc751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:07.855720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebf593-c0e2-4ae7-b80d-0f4535ddc751 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c1ebf593-c0e2-4ae7-b80d-0f4535ddc751 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:07.890021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:07.891285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:07.892329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:07.892329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:07.892329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:07.892329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:07.892329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 608/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:07.898475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b110fea-ec53-4d32-9166-6b53691b6c04 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:07.996253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:08.055091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b110fea-ec53-4d32-9166-6b53691b6c04 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:08.099709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82672e-96b6-4227-948a-42ba46156b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:08.100731 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82672e-96b6-4227-948a-42ba46156b0a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:08.101214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82672e-96b6-4227-948a-42ba46156b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:08.101716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82672e-96b6-4227-948a-42ba46156b0a None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:08.102656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82672e-96b6-4227-948a-42ba46156b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:08.103191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82672e-96b6-4227-948a-42ba46156b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:08.104707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82672e-96b6-4227-948a-42ba46156b0a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:08.122738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 608/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:15:08.123946 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebf593-c0e2-4ae7-b80d-0f4535ddc751 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:08.233299 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:08.290398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebf593-c0e2-4ae7-b80d-0f4535ddc751 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:08.346572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a30306-1168-48ee-b919-4e40f79abdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:08.347401 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a30306-1168-48ee-b919-4e40f79abdfc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:08.347698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a30306-1168-48ee-b919-4e40f79abdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:08.347983 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a30306-1168-48ee-b919-4e40f79abdfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:08.360149 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a30306-1168-48ee-b919-4e40f79abdfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:08.361648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a30306-1168-48ee-b919-4e40f79abdfc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-a8a30306-1168-48ee-b919-4e40f79abdfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:15:08.380403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:08.381493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:08.387665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:15:08.387665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:15:08.387665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:15:08.387665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:15:08.387665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:15:08.387665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:15:08.387665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:15:08.387665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:08.387665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 609/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:15:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:08.388181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82672e-96b6-4227-948a-42ba46156b0a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:08.536141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82672e-96b6-4227-948a-42ba46156b0a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:08.563416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:08.578669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac18251-91c6-4b35-98c7-6c0cb3f5554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:08.579412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac18251-91c6-4b35-98c7-6c0cb3f5554c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:08.579726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac18251-91c6-4b35-98c7-6c0cb3f5554c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:08.579899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac18251-91c6-4b35-98c7-6c0cb3f5554c None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:08.580822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac18251-91c6-4b35-98c7-6c0cb3f5554c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:08.581180 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac18251-91c6-4b35-98c7-6c0cb3f5554c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:08.582948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac18251-91c6-4b35-98c7-6c0cb3f5554c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:08.605814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 609/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:15:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:08.607874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a30306-1168-48ee-b919-4e40f79abdfc None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:08.777441 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a30306-1168-48ee-b919-4e40f79abdfc None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:08.822839 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:08.829849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bff58-25e9-4e10-9569-2386290ef6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:08.830582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bff58-25e9-4e10-9569-2386290ef6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:08.830826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bff58-25e9-4e10-9569-2386290ef6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:08.831093 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bff58-25e9-4e10-9569-2386290ef6a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:08.831953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bff58-25e9-4e10-9569-2386290ef6a8 None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=3ba61318896f43e5a68e80f38ae5f3a8) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:08.832336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bff58-25e9-4e10-9569-2386290ef6a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:08.833865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bff58-25e9-4e10-9569-2386290ef6a8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:08.849387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 610/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:15:08 2022] GET /identity/v3/role_assignments?user.id=3ba61318896f43e5a68e80f38ae5f3a8&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:11.114628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d47efd-06f2-4931-ab95-7e28062b23b7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:11.115243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d47efd-06f2-4931-ab95-7e28062b23b7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:11.115243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d47efd-06f2-4931-ab95-7e28062b23b7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:11.116531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 610/1220] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:15:11.123210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aeaf1a-910c-4780-b25c-584a05110d58 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:11.123964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aeaf1a-910c-4780-b25c-584a05110d58 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:11.123964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aeaf1a-910c-4780-b25c-584a05110d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:11.146997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a9aeaf1a-910c-4780-b25c-584a05110d58 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:15:11.148790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a9aeaf1a-910c-4780-b25c-584a05110d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:15:11.238813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 611/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:15:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:15:11.263889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d47efd-06f2-4931-ab95-7e28062b23b7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:11.416226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d47efd-06f2-4931-ab95-7e28062b23b7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:11.456646 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17dbe-8c7d-4123-af13-12273c36e07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:11.457479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17dbe-8c7d-4123-af13-12273c36e07b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:11.457761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17dbe-8c7d-4123-af13-12273c36e07b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:11.458037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17dbe-8c7d-4123-af13-12273c36e07b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:11.474596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17dbe-8c7d-4123-af13-12273c36e07b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-24a17dbe-8c7d-4123-af13-12273c36e07b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:15:11.482836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:11.484071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:11.485338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 611/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:15:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:11.490427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aeaf1a-910c-4780-b25c-584a05110d58 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:11.617804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aeaf1a-910c-4780-b25c-584a05110d58 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:11.646901 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:11.662318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1390-f5c7-4065-8d7b-8d6bedb4fdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:11.663055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1390-f5c7-4065-8d7b-8d6bedb4fdcb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:11.663379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1390-f5c7-4065-8d7b-8d6bedb4fdcb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:11.663736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1390-f5c7-4065-8d7b-8d6bedb4fdcb None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:11.664585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d1390-f5c7-4065-8d7b-8d6bedb4fdcb None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:11.664949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d1390-f5c7-4065-8d7b-8d6bedb4fdcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:11.666677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d1390-f5c7-4065-8d7b-8d6bedb4fdcb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:11.676961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 612/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:15:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:11.684307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17dbe-8c7d-4123-af13-12273c36e07b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:11.740204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:11.823649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17dbe-8c7d-4123-af13-12273c36e07b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:11.872081 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8471e-f770-406b-96dd-a0402705cdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:11.872930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8471e-f770-406b-96dd-a0402705cdbf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:11.873283 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8471e-f770-406b-96dd-a0402705cdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:11.873701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8471e-f770-406b-96dd-a0402705cdbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:11.889042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8471e-f770-406b-96dd-a0402705cdbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:11.892312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8471e-f770-406b-96dd-a0402705cdbf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a8b8471e-f770-406b-96dd-a0402705cdbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:11.917115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:11.918270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:11.919422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:11.919422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:11.919422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:11.919422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:11.919422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 612/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:11.926641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1390-f5c7-4065-8d7b-8d6bedb4fdcb None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:12.068989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1390-f5c7-4065-8d7b-8d6bedb4fdcb None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:12.110037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3624d6f-0d41-4432-9de9-29ebee08cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:12.110724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3624d6f-0d41-4432-9de9-29ebee08cf98 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:12.111011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3624d6f-0d41-4432-9de9-29ebee08cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:12.114938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3624d6f-0d41-4432-9de9-29ebee08cf98 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:12.114938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3624d6f-0d41-4432-9de9-29ebee08cf98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:12.114938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3624d6f-0d41-4432-9de9-29ebee08cf98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:12.114938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3624d6f-0d41-4432-9de9-29ebee08cf98 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:12.128674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 613/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:12.137507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8471e-f770-406b-96dd-a0402705cdbf None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:12.287022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:12.296632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8471e-f770-406b-96dd-a0402705cdbf None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:12.343531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3264b4-2827-4ca9-b0fa-df4f60b89dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:12.344452 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3264b4-2827-4ca9-b0fa-df4f60b89dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:12.344820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3264b4-2827-4ca9-b0fa-df4f60b89dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:12.345224 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3264b4-2827-4ca9-b0fa-df4f60b89dc4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:12.356373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3264b4-2827-4ca9-b0fa-df4f60b89dc4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:12.358062 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3264b4-2827-4ca9-b0fa-df4f60b89dc4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1b3264b4-2827-4ca9-b0fa-df4f60b89dc4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:15:12.377010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:12.378127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:12.379106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:12.379106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:12.379106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:15:12.379106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:15:12.379106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:15:12.379106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:15:12.379106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:15:12.379106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:15:12.379106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:15:12.379106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:12.379106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 613/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:12.387218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3624d6f-0d41-4432-9de9-29ebee08cf98 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:12.441840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:12.519982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3624d6f-0d41-4432-9de9-29ebee08cf98 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:12.561708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5770a-f003-4160-b9c3-d2ebc4e85171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:12.562301 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5770a-f003-4160-b9c3-d2ebc4e85171 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:12.562582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5770a-f003-4160-b9c3-d2ebc4e85171 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:12.562855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5770a-f003-4160-b9c3-d2ebc4e85171 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:12.563699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5770a-f003-4160-b9c3-d2ebc4e85171 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:12.564032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5770a-f003-4160-b9c3-d2ebc4e85171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:12.565593 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5770a-f003-4160-b9c3-d2ebc4e85171 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:12.587049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 614/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Fri Jul 15 15:15:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:12.593049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3264b4-2827-4ca9-b0fa-df4f60b89dc4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:12.732935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3264b4-2827-4ca9-b0fa-df4f60b89dc4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:12.778590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702b88f-f32b-46da-9623-6efc0d0221d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:12.779441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702b88f-f32b-46da-9623-6efc0d0221d1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:12.779730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702b88f-f32b-46da-9623-6efc0d0221d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:12.780007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702b88f-f32b-46da-9623-6efc0d0221d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:12.799451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702b88f-f32b-46da-9623-6efc0d0221d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:12.802217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702b88f-f32b-46da-9623-6efc0d0221d1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f702b88f-f32b-46da-9623-6efc0d0221d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:12.836433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:12.837619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:12.838558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:12.838558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:12.838558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:12.838558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:12.838796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 614/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:12.847982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5770a-f003-4160-b9c3-d2ebc4e85171 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:13.001420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5770a-f003-4160-b9c3-d2ebc4e85171 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:13.004679 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:13.047073 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad076c9-b036-4ea0-a2a7-1e0d4e83088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:13.047942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad076c9-b036-4ea0-a2a7-1e0d4e83088d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:13.048319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad076c9-b036-4ea0-a2a7-1e0d4e83088d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:13.048707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad076c9-b036-4ea0-a2a7-1e0d4e83088d None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:13.049628 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad076c9-b036-4ea0-a2a7-1e0d4e83088d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:13.049998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad076c9-b036-4ea0-a2a7-1e0d4e83088d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:13.051495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad076c9-b036-4ea0-a2a7-1e0d4e83088d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:13.073971 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 615/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:13.075535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702b88f-f32b-46da-9623-6efc0d0221d1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:13.086206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:13.231369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702b88f-f32b-46da-9623-6efc0d0221d1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:13.279484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd934a-20be-499a-9028-afc2e9882539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:13.280430 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd934a-20be-499a-9028-afc2e9882539 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:13.280720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd934a-20be-499a-9028-afc2e9882539 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:13.281033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd934a-20be-499a-9028-afc2e9882539 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:13.290480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd934a-20be-499a-9028-afc2e9882539 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:13.292262 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd934a-20be-499a-9028-afc2e9882539 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-81fd934a-20be-499a-9028-afc2e9882539 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:15:13.324189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:13.325369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:13.326484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:15:13.326484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:15:13.326484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:15:13.326484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:15:13.326484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:15:13.326484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:15:13.326484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:15:13.326484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:13.326927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 615/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:13.333626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad076c9-b036-4ea0-a2a7-1e0d4e83088d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:13.455341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad076c9-b036-4ea0-a2a7-1e0d4e83088d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:13.506732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63c687-82f4-4aed-84f7-9f5f17ee7f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:13.507956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63c687-82f4-4aed-84f7-9f5f17ee7f62 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:13.508246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63c687-82f4-4aed-84f7-9f5f17ee7f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:13.508522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63c687-82f4-4aed-84f7-9f5f17ee7f62 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:13.509619 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63c687-82f4-4aed-84f7-9f5f17ee7f62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:13.509959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63c687-82f4-4aed-84f7-9f5f17ee7f62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:13.511767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63c687-82f4-4aed-84f7-9f5f17ee7f62 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:13.527927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 616/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:13.535015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd934a-20be-499a-9028-afc2e9882539 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:13.640199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:13.689503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd934a-20be-499a-9028-afc2e9882539 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:13.742927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02842b-c82e-4922-aa09-28713505d5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:13.742927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02842b-c82e-4922-aa09-28713505d5b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:13.742927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02842b-c82e-4922-aa09-28713505d5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:13.742927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02842b-c82e-4922-aa09-28713505d5b6 None admin] PATH_INFO: `/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/3ba61318896f43e5a68e80f38ae5f3a8/roles/0ea33b1c5ba54280862c8470178e2732` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:13.762063 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02842b-c82e-4922-aa09-28713505d5b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0acc3e7b64dbab9113284b46f38ff, user_id=3ba61318896f43e5a68e80f38ae5f3a8, role_id=0ea33b1c5ba54280862c8470178e2732)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:13.763915 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02842b-c82e-4922-aa09-28713505d5b6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:13.781945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 616/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:15:13 2022] PUT /identity/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/3ba61318896f43e5a68e80f38ae5f3a8/roles/0ea33b1c5ba54280862c8470178e2732 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:15:16.044896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd62ce-fa6e-4121-9797-d23a1697bc9b None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:16.045737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd62ce-fa6e-4121-9797-d23a1697bc9b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:16.045737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd62ce-fa6e-4121-9797-d23a1697bc9b None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:16.046889 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 617/1233] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:15:16.054165 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11fab6-7741-4181-91b2-d2af29414751 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:16.054783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11fab6-7741-4181-91b2-d2af29414751 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:16.054984 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11fab6-7741-4181-91b2-d2af29414751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:16.072277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ad11fab6-7741-4181-91b2-d2af29414751 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:15:16.073540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ad11fab6-7741-4181-91b2-d2af29414751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:15:16.162799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 617/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:15:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:15:16.189997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd62ce-fa6e-4121-9797-d23a1697bc9b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:16.229354 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:16.336126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd62ce-fa6e-4121-9797-d23a1697bc9b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:16.387263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87820d-4a4f-4a91-868a-9f297453be59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:16.388091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87820d-4a4f-4a91-868a-9f297453be59 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:16.388449 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87820d-4a4f-4a91-868a-9f297453be59 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:16.388662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87820d-4a4f-4a91-868a-9f297453be59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:16.401001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87820d-4a4f-4a91-868a-9f297453be59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-6d87820d-4a4f-4a91-868a-9f297453be59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:15:16.409280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:16.410325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:16.412454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 618/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Jul 15 15:15:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:15:16.417491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11fab6-7741-4181-91b2-d2af29414751 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:16.476606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:16.556170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11fab6-7741-4181-91b2-d2af29414751 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:16.607626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2aa12-8446-42e6-ae6c-36f6e6907529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:16.608338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2aa12-8446-42e6-ae6c-36f6e6907529 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:16.608622 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2aa12-8446-42e6-ae6c-36f6e6907529 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:16.608901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2aa12-8446-42e6-ae6c-36f6e6907529 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:16.609734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2aa12-8446-42e6-ae6c-36f6e6907529 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:16.610041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2aa12-8446-42e6-ae6c-36f6e6907529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:16.611472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2aa12-8446-42e6-ae6c-36f6e6907529 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:16.623970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 618/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Jul 15 15:15:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:16.630194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87820d-4a4f-4a91-868a-9f297453be59 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:16.760539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:16.783920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87820d-4a4f-4a91-868a-9f297453be59 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:16.828442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ef0d0-6e6b-4ecb-b00a-e4a12bc58078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:16.829405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef0d0-6e6b-4ecb-b00a-e4a12bc58078 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:16.829689 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef0d0-6e6b-4ecb-b00a-e4a12bc58078 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:16.829985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef0d0-6e6b-4ecb-b00a-e4a12bc58078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:16.842043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ef0d0-6e6b-4ecb-b00a-e4a12bc58078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:16.843670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ef0d0-6e6b-4ecb-b00a-e4a12bc58078 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-086ef0d0-6e6b-4ecb-b00a-e4a12bc58078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:16.862811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:16.863964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:16.865118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:16.865118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:16.865118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:16.865118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:16.865118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 619/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:16.872163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2aa12-8446-42e6-ae6c-36f6e6907529 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:17.028366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2aa12-8446-42e6-ae6c-36f6e6907529 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:17.042535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:17.085006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e59982-e9db-4f13-9723-7aafb490133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:17.085806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e59982-e9db-4f13-9723-7aafb490133c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:17.086085 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e59982-e9db-4f13-9723-7aafb490133c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:17.086366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e59982-e9db-4f13-9723-7aafb490133c None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:17.087131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e59982-e9db-4f13-9723-7aafb490133c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:17.087442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e59982-e9db-4f13-9723-7aafb490133c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:17.088850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e59982-e9db-4f13-9723-7aafb490133c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:17.112145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 619/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:15:17.113879 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ef0d0-6e6b-4ecb-b00a-e4a12bc58078 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:17.238844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ef0d0-6e6b-4ecb-b00a-e4a12bc58078 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:17.281516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddb69f-626f-46ef-a89b-897b3ad2f6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:17.282336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddb69f-626f-46ef-a89b-897b3ad2f6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:17.282620 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddb69f-626f-46ef-a89b-897b3ad2f6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:17.282894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddb69f-626f-46ef-a89b-897b3ad2f6d1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:17.285999 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:17.296124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddb69f-626f-46ef-a89b-897b3ad2f6d1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:17.298731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddb69f-626f-46ef-a89b-897b3ad2f6d1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-b0ddb69f-626f-46ef-a89b-897b3ad2f6d1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:15:17.317117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:17.318160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:17.319104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:17.319104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:17.319104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:15:17.319104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:15:17.319104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:15:17.319104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:15:17.319104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:15:17.319104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:15:17.319104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:15:17.319104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:17.319104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 620/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:17.325269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e59982-e9db-4f13-9723-7aafb490133c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:17.468788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e59982-e9db-4f13-9723-7aafb490133c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:17.528054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576c5e1-ef2c-491b-9574-1f4ec664e060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:17.529695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c5e1-ef2c-491b-9574-1f4ec664e060 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:17.529799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c5e1-ef2c-491b-9574-1f4ec664e060 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:17.530218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c5e1-ef2c-491b-9574-1f4ec664e060 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:17.531786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576c5e1-ef2c-491b-9574-1f4ec664e060 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:17.532281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576c5e1-ef2c-491b-9574-1f4ec664e060 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:17.534781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576c5e1-ef2c-491b-9574-1f4ec664e060 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:17.568083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 620/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Fri Jul 15 15:15:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:17.576467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddb69f-626f-46ef-a89b-897b3ad2f6d1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:17.717606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddb69f-626f-46ef-a89b-897b3ad2f6d1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:17.764090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f8a36-53f2-47ad-b024-2dfbcf01c702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:17.764693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f8a36-53f2-47ad-b024-2dfbcf01c702 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:17.764975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f8a36-53f2-47ad-b024-2dfbcf01c702 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:17.765286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f8a36-53f2-47ad-b024-2dfbcf01c702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:17.841532 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:17.849353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f8a36-53f2-47ad-b024-2dfbcf01c702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:17.851571 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f8a36-53f2-47ad-b024-2dfbcf01c702 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:17.978769 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 621/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:15:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:15:17.985726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576c5e1-ef2c-491b-9574-1f4ec664e060 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:18.018817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:18.110960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576c5e1-ef2c-491b-9574-1f4ec664e060 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:18.152083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d03910-c8fc-4533-b921-4cfcec3279a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:18.153041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d03910-c8fc-4533-b921-4cfcec3279a1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:18.153442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d03910-c8fc-4533-b921-4cfcec3279a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:18.153844 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d03910-c8fc-4533-b921-4cfcec3279a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:18.167341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d03910-c8fc-4533-b921-4cfcec3279a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:18.169482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d03910-c8fc-4533-b921-4cfcec3279a1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c7d03910-c8fc-4533-b921-4cfcec3279a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:18.200818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:18.202075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:18.203209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:18.203209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:18.203209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:18.203209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:18.203209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 621/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:18.210143 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f8a36-53f2-47ad-b024-2dfbcf01c702 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:18.328656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:18.340657 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f8a36-53f2-47ad-b024-2dfbcf01c702 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:18.383554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12ac62-66bb-45db-961b-af3ad872c8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:18.384434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12ac62-66bb-45db-961b-af3ad872c8da None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:18.384811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12ac62-66bb-45db-961b-af3ad872c8da None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:18.385141 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12ac62-66bb-45db-961b-af3ad872c8da None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:18.386110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12ac62-66bb-45db-961b-af3ad872c8da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:18.386575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12ac62-66bb-45db-961b-af3ad872c8da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:18.388089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12ac62-66bb-45db-961b-af3ad872c8da None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:18.400639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 622/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:15:18.406502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d03910-c8fc-4533-b921-4cfcec3279a1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:18.509801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:18.537901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d03910-c8fc-4533-b921-4cfcec3279a1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:18.582941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6f7c5-a5df-40f7-9fba-27913d034dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:18.583665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6f7c5-a5df-40f7-9fba-27913d034dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:18.583948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6f7c5-a5df-40f7-9fba-27913d034dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:18.584224 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6f7c5-a5df-40f7-9fba-27913d034dd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:18.602555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6f7c5-a5df-40f7-9fba-27913d034dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:18.602812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6f7c5-a5df-40f7-9fba-27913d034dd6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-cdd6f7c5-a5df-40f7-9fba-27913d034dd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:15:18.621032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:18.623087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:18.624937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:15:18.624937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:15:18.624937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:15:18.624937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:15:18.624937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:15:18.624937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:15:18.624937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:15:18.624937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:18.624937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 622/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:18.635828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12ac62-66bb-45db-961b-af3ad872c8da None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:18.754346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12ac62-66bb-45db-961b-af3ad872c8da None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:18.801965 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531ac9c-68b5-4636-b49a-cb1dc3b85333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:18.802709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531ac9c-68b5-4636-b49a-cb1dc3b85333 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:18.803072 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531ac9c-68b5-4636-b49a-cb1dc3b85333 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:18.803404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531ac9c-68b5-4636-b49a-cb1dc3b85333 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:18.804295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531ac9c-68b5-4636-b49a-cb1dc3b85333 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:18.804652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531ac9c-68b5-4636-b49a-cb1dc3b85333 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:18.806336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531ac9c-68b5-4636-b49a-cb1dc3b85333 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:18.823105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 623/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:15:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:18.832782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6f7c5-a5df-40f7-9fba-27913d034dd6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:18.956253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6f7c5-a5df-40f7-9fba-27913d034dd6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:19.002321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f1ed8-1d6b-482c-ab51-4eec636e7f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:19.003098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f1ed8-1d6b-482c-ab51-4eec636e7f2b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:19.003384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f1ed8-1d6b-482c-ab51-4eec636e7f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:19.003662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f1ed8-1d6b-482c-ab51-4eec636e7f2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:19.006602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f1ed8-1d6b-482c-ab51-4eec636e7f2b None admin] RBAC: Adding query filter params (role.id=0ea33b1c5ba54280862c8470178e2732, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=3ba61318896f43e5a68e80f38ae5f3a8) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:19.006602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f1ed8-1d6b-482c-ab51-4eec636e7f2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:19.006602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f1ed8-1d6b-482c-ab51-4eec636e7f2b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:19.016881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 623/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:15:18 2022] GET /identity/v3/role_assignments?user.id=3ba61318896f43e5a68e80f38ae5f3a8&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=0ea33b1c5ba54280862c8470178e2732 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:21.306190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77e4c2-4df3-4105-8e70-47703da86561 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:21.306864 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77e4c2-4df3-4105-8e70-47703da86561 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:21.306864 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77e4c2-4df3-4105-8e70-47703da86561 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:21.308267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 624/1247] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:15:21.314682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b53c0-9c9b-4ba9-9d42-11e6207268f8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:21.315255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b53c0-9c9b-4ba9-9d42-11e6207268f8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:21.315458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b53c0-9c9b-4ba9-9d42-11e6207268f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:21.321540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:21.337243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-da0b53c0-9c9b-4ba9-9d42-11e6207268f8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:15:21.338520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-da0b53c0-9c9b-4ba9-9d42-11e6207268f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:15:21.451779 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 624/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:15:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:15:21.482232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77e4c2-4df3-4105-8e70-47703da86561 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:21.513699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:21.643695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77e4c2-4df3-4105-8e70-47703da86561 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:21.695733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727063c-4dd3-4cb2-89e0-56b8ea739b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:21.696600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727063c-4dd3-4cb2-89e0-56b8ea739b03 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:21.696970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727063c-4dd3-4cb2-89e0-56b8ea739b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:21.697362 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727063c-4dd3-4cb2-89e0-56b8ea739b03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:21.709941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727063c-4dd3-4cb2-89e0-56b8ea739b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-7727063c-4dd3-4cb2-89e0-56b8ea739b03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:15:21.719908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:21.721968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:21.723180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 625/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:15:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:15:21.729910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b53c0-9c9b-4ba9-9d42-11e6207268f8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:21.891652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b53c0-9c9b-4ba9-9d42-11e6207268f8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:21.927953 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:21.932850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad61325-5675-4bbf-a6cd-9efd5d65f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:21.933647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad61325-5675-4bbf-a6cd-9efd5d65f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:21.933960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad61325-5675-4bbf-a6cd-9efd5d65f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:21.934248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad61325-5675-4bbf-a6cd-9efd5d65f6f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:21.935059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad61325-5675-4bbf-a6cd-9efd5d65f6f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:21.935383 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad61325-5675-4bbf-a6cd-9efd5d65f6f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:21.936795 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad61325-5675-4bbf-a6cd-9efd5d65f6f0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:21.947426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 625/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:15:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:21.953453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727063c-4dd3-4cb2-89e0-56b8ea739b03 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:22.052144 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:22.081297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727063c-4dd3-4cb2-89e0-56b8ea739b03 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:22.127807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3ca81-bbcd-49b1-9078-e4fae3a80ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:22.128945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3ca81-bbcd-49b1-9078-e4fae3a80ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:22.129268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3ca81-bbcd-49b1-9078-e4fae3a80ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:22.129540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3ca81-bbcd-49b1-9078-e4fae3a80ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:22.145773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3ca81-bbcd-49b1-9078-e4fae3a80ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:22.148571 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3ca81-bbcd-49b1-9078-e4fae3a80ad4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-15f3ca81-bbcd-49b1-9078-e4fae3a80ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:22.180683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:22.181939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:22.182980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:22.182980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:22.182980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:22.182980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:22.189937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad61325-5675-4bbf-a6cd-9efd5d65f6f0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:22.190480 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 626/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:22.321680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad61325-5675-4bbf-a6cd-9efd5d65f6f0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:22.371168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f311662-4c1e-4d90-afc8-6e23a0bf81ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:22.371868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f311662-4c1e-4d90-afc8-6e23a0bf81ad None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:22.372159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f311662-4c1e-4d90-afc8-6e23a0bf81ad None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:22.372445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f311662-4c1e-4d90-afc8-6e23a0bf81ad None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:22.373241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f311662-4c1e-4d90-afc8-6e23a0bf81ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:22.373558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f311662-4c1e-4d90-afc8-6e23a0bf81ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:22.375351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f311662-4c1e-4d90-afc8-6e23a0bf81ad None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:22.396067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 626/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:15:22.399832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3ca81-bbcd-49b1-9078-e4fae3a80ad4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:22.532971 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3ca81-bbcd-49b1-9078-e4fae3a80ad4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:22.570537 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:22.580021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efee330-bfe1-4ca1-81d0-da1c401b48e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:22.580819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efee330-bfe1-4ca1-81d0-da1c401b48e6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:22.581151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efee330-bfe1-4ca1-81d0-da1c401b48e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:22.581437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efee330-bfe1-4ca1-81d0-da1c401b48e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:22.590359 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efee330-bfe1-4ca1-81d0-da1c401b48e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:22.591880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efee330-bfe1-4ca1-81d0-da1c401b48e6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-5efee330-bfe1-4ca1-81d0-da1c401b48e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:15:22.612566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:22.613832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:22.614984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:22.614984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:22.614984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:15:22.614984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:15:22.614984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:15:22.614984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:15:22.614984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:15:22.614984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:15:22.614984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:15:22.614984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:22.614984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 627/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:22.621631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f311662-4c1e-4d90-afc8-6e23a0bf81ad None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:22.694517 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:22.754058 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f311662-4c1e-4d90-afc8-6e23a0bf81ad None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:22.794718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4045253-1762-44a8-bd35-9ccd7ae1176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:22.795436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4045253-1762-44a8-bd35-9ccd7ae1176b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:22.795730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4045253-1762-44a8-bd35-9ccd7ae1176b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:22.799655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4045253-1762-44a8-bd35-9ccd7ae1176b None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:22.799655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4045253-1762-44a8-bd35-9ccd7ae1176b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:22.799655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4045253-1762-44a8-bd35-9ccd7ae1176b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:22.799655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4045253-1762-44a8-bd35-9ccd7ae1176b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:22.819298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 627/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Fri Jul 15 15:15:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:15:22.825408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efee330-bfe1-4ca1-81d0-da1c401b48e6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:22.942869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efee330-bfe1-4ca1-81d0-da1c401b48e6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:22.989676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5727-8dbb-4c3c-ae11-8222e3784532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:22.990346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5727-8dbb-4c3c-ae11-8222e3784532 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:22.990554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5727-8dbb-4c3c-ae11-8222e3784532 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:22.990837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5727-8dbb-4c3c-ae11-8222e3784532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:23.066241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:23.082337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd5727-8dbb-4c3c-ae11-8222e3784532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:23.085611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd5727-8dbb-4c3c-ae11-8222e3784532 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:23.227817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 628/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:15:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:15:23.237075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4045253-1762-44a8-bd35-9ccd7ae1176b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:23.364399 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4045253-1762-44a8-bd35-9ccd7ae1176b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:23.386457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:23.414536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15b7e6-637b-4f9f-884b-17742004fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:23.415742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15b7e6-637b-4f9f-884b-17742004fb23 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:23.416029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15b7e6-637b-4f9f-884b-17742004fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:23.416939 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15b7e6-637b-4f9f-884b-17742004fb23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:23.430100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15b7e6-637b-4f9f-884b-17742004fb23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:23.431881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15b7e6-637b-4f9f-884b-17742004fb23 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3f15b7e6-637b-4f9f-884b-17742004fb23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:23.453785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:23.455258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:23.456395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:23.456395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:23.456395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:23.456395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:23.456395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 628/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:23.464710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5727-8dbb-4c3c-ae11-8222e3784532 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:23.588903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:23.605838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5727-8dbb-4c3c-ae11-8222e3784532 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:23.653934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec4558-24be-4def-83ad-4bf0fa2902d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:23.654678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec4558-24be-4def-83ad-4bf0fa2902d7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:23.654965 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec4558-24be-4def-83ad-4bf0fa2902d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:23.655297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec4558-24be-4def-83ad-4bf0fa2902d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:23.656176 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec4558-24be-4def-83ad-4bf0fa2902d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:23.656503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec4558-24be-4def-83ad-4bf0fa2902d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:23.658063 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec4558-24be-4def-83ad-4bf0fa2902d7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:23.671650 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 629/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:23.677835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15b7e6-637b-4f9f-884b-17742004fb23 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:23.813071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15b7e6-637b-4f9f-884b-17742004fb23 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:23.863752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e9002-1a35-4291-86ff-0cce5c83de43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:23.864557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e9002-1a35-4291-86ff-0cce5c83de43 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:23.864838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e9002-1a35-4291-86ff-0cce5c83de43 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:23.865138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e9002-1a35-4291-86ff-0cce5c83de43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:23.872644 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e9002-1a35-4291-86ff-0cce5c83de43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:23.874441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e9002-1a35-4291-86ff-0cce5c83de43 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2b8e9002-1a35-4291-86ff-0cce5c83de43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:15:23.902969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:23.904301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:23.905502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:15:23.905502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:15:23.905502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:15:23.905502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:15:23.905502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:15:23.905502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:15:23.905502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:15:23.905502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:23.905502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 629/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:15:23.913207 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec4558-24be-4def-83ad-4bf0fa2902d7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:24.035545 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec4558-24be-4def-83ad-4bf0fa2902d7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:24.085551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3542e-637a-46bb-a378-8c399a86cebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:24.086649 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3542e-637a-46bb-a378-8c399a86cebc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:24.087116 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3542e-637a-46bb-a378-8c399a86cebc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:24.087658 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3542e-637a-46bb-a378-8c399a86cebc None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:24.088677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3542e-637a-46bb-a378-8c399a86cebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:24.089050 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3542e-637a-46bb-a378-8c399a86cebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:24.090713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3542e-637a-46bb-a378-8c399a86cebc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:24.108077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 630/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:24.118059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e9002-1a35-4291-86ff-0cce5c83de43 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:24.153015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:24.259502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e9002-1a35-4291-86ff-0cce5c83de43 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:24.305130 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe66cd-b45d-43a9-81a4-1d79ba323b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:24.305813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe66cd-b45d-43a9-81a4-1d79ba323b94 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:24.306118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe66cd-b45d-43a9-81a4-1d79ba323b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:24.306433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe66cd-b45d-43a9-81a4-1d79ba323b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:24.307278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe66cd-b45d-43a9-81a4-1d79ba323b94 None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=3ba61318896f43e5a68e80f38ae5f3a8) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:24.307596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe66cd-b45d-43a9-81a4-1d79ba323b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:24.309102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe66cd-b45d-43a9-81a4-1d79ba323b94 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:24.316217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 630/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:15:24 2022] GET /identity/v3/role_assignments?user.id=3ba61318896f43e5a68e80f38ae5f3a8&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=87593f63c4744eac870c07b006022e77 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:26.455243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e99c2-4688-4f8e-84b6-f1c773c374cb None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:26.456001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e99c2-4688-4f8e-84b6-f1c773c374cb None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:26.456001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e99c2-4688-4f8e-84b6-f1c773c374cb None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:26.457313 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 631/1261] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:15:26.463457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39886959-eb1e-4868-8e4c-13c37e2158e6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:26.463988 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39886959-eb1e-4868-8e4c-13c37e2158e6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:26.463988 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39886959-eb1e-4868-8e4c-13c37e2158e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:26.484737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-39886959-eb1e-4868-8e4c-13c37e2158e6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:15:26.486019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-39886959-eb1e-4868-8e4c-13c37e2158e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:15:26.574876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 631/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:15:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:15:26.600232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e99c2-4688-4f8e-84b6-f1c773c374cb None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:26.614939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:26.729610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e99c2-4688-4f8e-84b6-f1c773c374cb None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:26.774966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54668f2-7c8d-4ede-9f81-5ebff7d043b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:26.775787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54668f2-7c8d-4ede-9f81-5ebff7d043b9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:26.776069 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54668f2-7c8d-4ede-9f81-5ebff7d043b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:26.776347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54668f2-7c8d-4ede-9f81-5ebff7d043b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:26.789650 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54668f2-7c8d-4ede-9f81-5ebff7d043b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-a54668f2-7c8d-4ede-9f81-5ebff7d043b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:15:26.797609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:26.798861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:26.799909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:26.799909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:26.799909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:26.799909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:26.799909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:15:26.799909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:15:26.799909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:15:26.799909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:15:26.799909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:15:26.799909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:15:26.799909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:15:26.799909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:26.801261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 632/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:15:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:26.805909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39886959-eb1e-4868-8e4c-13c37e2158e6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:26.832077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:26.930529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39886959-eb1e-4868-8e4c-13c37e2158e6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:26.977901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00368ee0-778e-46a9-83d1-02623e149565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:26.978593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00368ee0-778e-46a9-83d1-02623e149565 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:26.978869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00368ee0-778e-46a9-83d1-02623e149565 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:26.979139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00368ee0-778e-46a9-83d1-02623e149565 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:26.979952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00368ee0-778e-46a9-83d1-02623e149565 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:26.980209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00368ee0-778e-46a9-83d1-02623e149565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:26.981764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00368ee0-778e-46a9-83d1-02623e149565 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:26.991128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 632/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:15:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:26.997356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54668f2-7c8d-4ede-9f81-5ebff7d043b9 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:27.092259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:27.133240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54668f2-7c8d-4ede-9f81-5ebff7d043b9 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:27.171549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b2e4-31bb-498b-9227-640fcc519eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:27.172363 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b2e4-31bb-498b-9227-640fcc519eeb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:27.172649 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b2e4-31bb-498b-9227-640fcc519eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:27.172926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b2e4-31bb-498b-9227-640fcc519eeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:27.188077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7b2e4-31bb-498b-9227-640fcc519eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:27.189815 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7b2e4-31bb-498b-9227-640fcc519eeb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ecd7b2e4-31bb-498b-9227-640fcc519eeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:27.212844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:27.213894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:27.214808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:27.214808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:27.214808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:27.214808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:27.214808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 633/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:27.223684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00368ee0-778e-46a9-83d1-02623e149565 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:27.311017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:27.332200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00368ee0-778e-46a9-83d1-02623e149565 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:27.368849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d4a7b-7c87-4db2-924c-84d623e6345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:27.369593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4a7b-7c87-4db2-924c-84d623e6345e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:27.369885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4a7b-7c87-4db2-924c-84d623e6345e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:27.370168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4a7b-7c87-4db2-924c-84d623e6345e None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:27.370903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d4a7b-7c87-4db2-924c-84d623e6345e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:27.371216 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d4a7b-7c87-4db2-924c-84d623e6345e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:27.372656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d4a7b-7c87-4db2-924c-84d623e6345e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:27.386283 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 633/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:27.392072 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b2e4-31bb-498b-9227-640fcc519eeb None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:27.499966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b2e4-31bb-498b-9227-640fcc519eeb None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:27.521734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:27.537527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e3bd8-d512-4d4b-aa23-442627607c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:27.538391 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e3bd8-d512-4d4b-aa23-442627607c4c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:27.538676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e3bd8-d512-4d4b-aa23-442627607c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:27.538960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e3bd8-d512-4d4b-aa23-442627607c4c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:27.547341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e3bd8-d512-4d4b-aa23-442627607c4c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:27.548819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e3bd8-d512-4d4b-aa23-442627607c4c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ff4e3bd8-d512-4d4b-aa23-442627607c4c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:15:27.565400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:27.567296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:27.569937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:27.569937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:27.569937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:15:27.569937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:15:27.569937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:15:27.569937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:15:27.569937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:15:27.569937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:15:27.569937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:15:27.569937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:27.569937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 634/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:27.573548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d4a7b-7c87-4db2-924c-84d623e6345e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:27.685206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d4a7b-7c87-4db2-924c-84d623e6345e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:27.724003 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcac10e-2672-4502-9837-c9f18226e085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:27.724689 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcac10e-2672-4502-9837-c9f18226e085 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:27.724971 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcac10e-2672-4502-9837-c9f18226e085 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:27.725787 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcac10e-2672-4502-9837-c9f18226e085 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:27.726637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcac10e-2672-4502-9837-c9f18226e085 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:27.726943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcac10e-2672-4502-9837-c9f18226e085 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:27.728397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcac10e-2672-4502-9837-c9f18226e085 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:27.740634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:27.756940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 634/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Fri Jul 15 15:15:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:15:27.762918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e3bd8-d512-4d4b-aa23-442627607c4c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:27.880155 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e3bd8-d512-4d4b-aa23-442627607c4c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:27.915271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11107f26-c40c-4991-b743-4560fa955424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:27.916088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11107f26-c40c-4991-b743-4560fa955424 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:27.916377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11107f26-c40c-4991-b743-4560fa955424 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:27.916657 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11107f26-c40c-4991-b743-4560fa955424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:27.928285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11107f26-c40c-4991-b743-4560fa955424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:27.930535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11107f26-c40c-4991-b743-4560fa955424 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-11107f26-c40c-4991-b743-4560fa955424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:27.948521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:27.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:27.950871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:27.950871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:27.950871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:27.950871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:27.950871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 635/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:27.955978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcac10e-2672-4502-9837-c9f18226e085 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:28.067686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcac10e-2672-4502-9837-c9f18226e085 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:28.106979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a247f-300d-4b9e-a0dd-a3ce7d4efca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:28.107650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a247f-300d-4b9e-a0dd-a3ce7d4efca1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:28.107935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a247f-300d-4b9e-a0dd-a3ce7d4efca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:28.108211 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a247f-300d-4b9e-a0dd-a3ce7d4efca1 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:28.108944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a247f-300d-4b9e-a0dd-a3ce7d4efca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:28.109355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a247f-300d-4b9e-a0dd-a3ce7d4efca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:28.110828 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a247f-300d-4b9e-a0dd-a3ce7d4efca1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:28.128392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 635/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:28.134375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11107f26-c40c-4991-b743-4560fa955424 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:28.168581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:28.261812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11107f26-c40c-4991-b743-4560fa955424 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:28.306920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a640db-eac9-44a2-a7a3-7d6a867108fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:28.307734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a640db-eac9-44a2-a7a3-7d6a867108fc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:28.308022 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a640db-eac9-44a2-a7a3-7d6a867108fc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:28.308302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a640db-eac9-44a2-a7a3-7d6a867108fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:28.315850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a640db-eac9-44a2-a7a3-7d6a867108fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:28.317365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a640db-eac9-44a2-a7a3-7d6a867108fc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-94a640db-eac9-44a2-a7a3-7d6a867108fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:15:28.332252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:28.333488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:28.334508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:15:28.334508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:15:28.334508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:15:28.334508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:15:28.334508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:15:28.334508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:15:28.334508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:15:28.334508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:28.334508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 636/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:15:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:28.340151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a247f-300d-4b9e-a0dd-a3ce7d4efca1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:28.422515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:28.474321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a247f-300d-4b9e-a0dd-a3ce7d4efca1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:28.509577 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea16b5-db93-443d-9c84-c763694c2576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:28.510299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea16b5-db93-443d-9c84-c763694c2576 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:28.510532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea16b5-db93-443d-9c84-c763694c2576 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:28.510810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea16b5-db93-443d-9c84-c763694c2576 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:28.511610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea16b5-db93-443d-9c84-c763694c2576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:28.511921 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea16b5-db93-443d-9c84-c763694c2576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:28.513400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea16b5-db93-443d-9c84-c763694c2576 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:28.533691 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 636/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:28.539870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a640db-eac9-44a2-a7a3-7d6a867108fc None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:28.638156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:28.653631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a640db-eac9-44a2-a7a3-7d6a867108fc None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:28.712646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1824b39-430d-4bb8-92d3-90a1b885eb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:28.714098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1824b39-430d-4bb8-92d3-90a1b885eb13 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:28.714586 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1824b39-430d-4bb8-92d3-90a1b885eb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:28.715070 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1824b39-430d-4bb8-92d3-90a1b885eb13 None admin] PATH_INFO: `/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/3ba61318896f43e5a68e80f38ae5f3a8/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:28.718536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1824b39-430d-4bb8-92d3-90a1b885eb13 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0acc3e7b64dbab9113284b46f38ff, user_id=3ba61318896f43e5a68e80f38ae5f3a8, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:28.721233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1824b39-430d-4bb8-92d3-90a1b885eb13 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:28.743123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 637/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Jul 15 15:15:28 2022] PUT /identity/v3/projects/1ee0acc3e7b64dbab9113284b46f38ff/users/3ba61318896f43e5a68e80f38ae5f3a8/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:15:30.785908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b61a4-9dd7-4e63-ac25-b32e29d6771f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:30.786445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b61a4-9dd7-4e63-ac25-b32e29d6771f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:30.786445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b61a4-9dd7-4e63-ac25-b32e29d6771f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:30.787882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 637/1274] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:15:30.793584 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e68ca7-a3eb-4687-aae9-6a7462a199d5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:30.794102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e68ca7-a3eb-4687-aae9-6a7462a199d5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:30.794227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e68ca7-a3eb-4687-aae9-6a7462a199d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:30.811788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-63e68ca7-a3eb-4687-aae9-6a7462a199d5 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:15:30.813012 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-63e68ca7-a3eb-4687-aae9-6a7462a199d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:15:30.896657 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 638/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:15:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:15:30.920324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b61a4-9dd7-4e63-ac25-b32e29d6771f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:31.031309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b61a4-9dd7-4e63-ac25-b32e29d6771f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:31.049133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:31.066601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9230bc-5864-48f8-860b-007708faea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:31.067521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9230bc-5864-48f8-860b-007708faea47 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:31.067861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9230bc-5864-48f8-860b-007708faea47 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:31.068226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9230bc-5864-48f8-860b-007708faea47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:31.079645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9230bc-5864-48f8-860b-007708faea47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-df9230bc-5864-48f8-860b-007708faea47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:15:31.087558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:31.088709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:31.089656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 638/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Jul 15 15:15:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:31.095258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e68ca7-a3eb-4687-aae9-6a7462a199d5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:31.184128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:31.210841 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e68ca7-a3eb-4687-aae9-6a7462a199d5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:31.278444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f79548-5ac7-4b6c-8204-f22ac26b0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:31.279250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f79548-5ac7-4b6c-8204-f22ac26b0053 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:31.279676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f79548-5ac7-4b6c-8204-f22ac26b0053 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:31.279984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f79548-5ac7-4b6c-8204-f22ac26b0053 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:31.280774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f79548-5ac7-4b6c-8204-f22ac26b0053 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:31.281126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f79548-5ac7-4b6c-8204-f22ac26b0053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:31.282715 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f79548-5ac7-4b6c-8204-f22ac26b0053 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:31.292017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 639/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Jul 15 15:15:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:31.298197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9230bc-5864-48f8-860b-007708faea47 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:31.410143 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9230bc-5864-48f8-860b-007708faea47 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:31.451214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764df9b-1ebb-42b4-90c4-60912c98612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:31.451919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764df9b-1ebb-42b4-90c4-60912c98612a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:31.452204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764df9b-1ebb-42b4-90c4-60912c98612a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:31.452482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764df9b-1ebb-42b4-90c4-60912c98612a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:31.463471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764df9b-1ebb-42b4-90c4-60912c98612a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:31.464940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764df9b-1ebb-42b4-90c4-60912c98612a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-6764df9b-1ebb-42b4-90c4-60912c98612a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:31.483040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:31.484792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:31.486599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:31.486599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:31.486599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:31.486599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:31.489192 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 639/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:31.490343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f79548-5ac7-4b6c-8204-f22ac26b0053 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:31.612002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f79548-5ac7-4b6c-8204-f22ac26b0053 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:31.646861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4b4d-cab9-44ac-8219-900214894a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:31.647520 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4b4d-cab9-44ac-8219-900214894a6c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:31.647811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4b4d-cab9-44ac-8219-900214894a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:31.648090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4b4d-cab9-44ac-8219-900214894a6c None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:31.648826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe4b4d-cab9-44ac-8219-900214894a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:31.649180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe4b4d-cab9-44ac-8219-900214894a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:31.650572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe4b4d-cab9-44ac-8219-900214894a6c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:31.663518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 640/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:31.669360 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764df9b-1ebb-42b4-90c4-60912c98612a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:31.702090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:31.786762 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764df9b-1ebb-42b4-90c4-60912c98612a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:31.831473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754c836-7e1a-4613-b5c6-4f28807b8e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:31.832299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754c836-7e1a-4613-b5c6-4f28807b8e83 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:31.832584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754c836-7e1a-4613-b5c6-4f28807b8e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:31.832862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754c836-7e1a-4613-b5c6-4f28807b8e83 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:31.842382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754c836-7e1a-4613-b5c6-4f28807b8e83 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:31.843855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754c836-7e1a-4613-b5c6-4f28807b8e83 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1754c836-7e1a-4613-b5c6-4f28807b8e83 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:15:31.859640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:31.861491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:31.863228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:31.863228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:31.863228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:15:31.863228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:15:31.863228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:15:31.863228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:15:31.863228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:15:31.863228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:15:31.863228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:15:31.863228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:31.863228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 640/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:31.868055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4b4d-cab9-44ac-8219-900214894a6c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:31.871953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:31.986722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4b4d-cab9-44ac-8219-900214894a6c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:32.022483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe3e49-b827-4f11-b1c7-ba54e2faa604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:32.023162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe3e49-b827-4f11-b1c7-ba54e2faa604 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:32.023451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe3e49-b827-4f11-b1c7-ba54e2faa604 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:32.023731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe3e49-b827-4f11-b1c7-ba54e2faa604 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:32.024578 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe3e49-b827-4f11-b1c7-ba54e2faa604 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:32.024891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe3e49-b827-4f11-b1c7-ba54e2faa604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:32.026375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe3e49-b827-4f11-b1c7-ba54e2faa604 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:32.046793 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 641/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Fri Jul 15 15:15:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:32.052924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754c836-7e1a-4613-b5c6-4f28807b8e83 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:32.150048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:32.161993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754c836-7e1a-4613-b5c6-4f28807b8e83 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:32.205149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641e191-e979-4a42-8ec0-bc59ce7a0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:32.205801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641e191-e979-4a42-8ec0-bc59ce7a0504 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:32.206084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641e191-e979-4a42-8ec0-bc59ce7a0504 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:32.206361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641e191-e979-4a42-8ec0-bc59ce7a0504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:32.294981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641e191-e979-4a42-8ec0-bc59ce7a0504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:32.296354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641e191-e979-4a42-8ec0-bc59ce7a0504 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:32.387132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:32.398701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 641/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Jul 15 15:15:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:15:32.404539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe3e49-b827-4f11-b1c7-ba54e2faa604 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:32.467648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:32.507929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe3e49-b827-4f11-b1c7-ba54e2faa604 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:32.547642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5427f-99de-44eb-9417-17fc92fd1953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:32.548348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5427f-99de-44eb-9417-17fc92fd1953 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:32.548629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5427f-99de-44eb-9417-17fc92fd1953 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:32.548905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5427f-99de-44eb-9417-17fc92fd1953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:32.560046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5427f-99de-44eb-9417-17fc92fd1953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:32.561531 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5427f-99de-44eb-9417-17fc92fd1953 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-93c5427f-99de-44eb-9417-17fc92fd1953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:15:32.579333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:32.580548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:32.581781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:15:32.581781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:15:32.581781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:15:32.581781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:32.581781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 642/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:32.586321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641e191-e979-4a42-8ec0-bc59ce7a0504 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:32.693722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641e191-e979-4a42-8ec0-bc59ce7a0504 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:32.732692 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f78022-be46-4cd4-b777-5a3aff168954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:32.733424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f78022-be46-4cd4-b777-5a3aff168954 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:32.733862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f78022-be46-4cd4-b777-5a3aff168954 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:32.734326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f78022-be46-4cd4-b777-5a3aff168954 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:32.735220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f78022-be46-4cd4-b777-5a3aff168954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:32.735583 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f78022-be46-4cd4-b777-5a3aff168954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:32.736984 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f78022-be46-4cd4-b777-5a3aff168954 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:32.749711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 642/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Jul 15 15:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:32.755457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5427f-99de-44eb-9417-17fc92fd1953 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:32.856488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5427f-99de-44eb-9417-17fc92fd1953 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:32.871733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:32.893481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fad9a-3422-44da-9ad0-f83b02850578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:32.895059 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fad9a-3422-44da-9ad0-f83b02850578 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:32.895059 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fad9a-3422-44da-9ad0-f83b02850578 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:32.895059 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fad9a-3422-44da-9ad0-f83b02850578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:32.901952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fad9a-3422-44da-9ad0-f83b02850578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:32.903431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fad9a-3422-44da-9ad0-f83b02850578 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-da7fad9a-3422-44da-9ad0-f83b02850578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:15:32.920917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:32.922100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:32.923066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:15:32.923066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:15:32.923066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:15:32.923066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:15:32.923066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:15:32.923066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:15:32.923066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:15:32.923066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 15 15:15:32.923066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 643/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Jul 15 15:15:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:32.928191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f78022-be46-4cd4-b777-5a3aff168954 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:32.981083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:33.032323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f78022-be46-4cd4-b777-5a3aff168954 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:33.067461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87754-df21-4d57-a7f5-b599a3b8220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:33.068135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87754-df21-4d57-a7f5-b599a3b8220f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:33.068423 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87754-df21-4d57-a7f5-b599a3b8220f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:33.068736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87754-df21-4d57-a7f5-b599a3b8220f None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:33.069565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87754-df21-4d57-a7f5-b599a3b8220f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:33.069882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87754-df21-4d57-a7f5-b599a3b8220f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:33.071355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87754-df21-4d57-a7f5-b599a3b8220f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:33.084680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 643/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Jul 15 15:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:33.090797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fad9a-3422-44da-9ad0-f83b02850578 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:33.199327 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fad9a-3422-44da-9ad0-f83b02850578 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:33.234183 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535140d-82f3-4944-9272-473f8cbf0459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:33.234847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535140d-82f3-4944-9272-473f8cbf0459 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:33.235138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535140d-82f3-4944-9272-473f8cbf0459 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:33.235417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535140d-82f3-4944-9272-473f8cbf0459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:33.236250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535140d-82f3-4944-9272-473f8cbf0459 None admin] RBAC: Adding query filter params (role.id=87593f63c4744eac870c07b006022e77, scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff, user.id=3ba61318896f43e5a68e80f38ae5f3a8) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:33.236564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535140d-82f3-4944-9272-473f8cbf0459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:33.238044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535140d-82f3-4944-9272-473f8cbf0459 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:33.244584 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 644/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Jul 15 15:15:33 2022] GET /identity/v3/role_assignments?user.id=3ba61318896f43e5a68e80f38ae5f3a8&scope.project.id=1ee0acc3e7b64dbab9113284b46f38ff&role.id=87593f63c4744eac870c07b006022e77 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:35.313520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfced3-c85e-47cf-b0ff-363cb7c0cff1 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:35.315141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfced3-c85e-47cf-b0ff-363cb7c0cff1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:35.315141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfced3-c85e-47cf-b0ff-363cb7c0cff1 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:35.315438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 644/1288] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:15:35.321196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e868-6551-441c-9113-b99bb4b71ef2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:35.321649 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e868-6551-441c-9113-b99bb4b71ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:35.321649 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e868-6551-441c-9113-b99bb4b71ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:35.338953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5e78e868-6551-441c-9113-b99bb4b71ef2 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:15:35.340162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5e78e868-6551-441c-9113-b99bb4b71ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:15:35.369132 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:35.408244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 645/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:15:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:15:35.430737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfced3-c85e-47cf-b0ff-363cb7c0cff1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:35.529717 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfced3-c85e-47cf-b0ff-363cb7c0cff1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:35.540135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:35.564156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0de522-8b92-44bc-97d4-e89afdc436a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:35.564873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0de522-8b92-44bc-97d4-e89afdc436a2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:35.565183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0de522-8b92-44bc-97d4-e89afdc436a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:35.565460 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0de522-8b92-44bc-97d4-e89afdc436a2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:35.566108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0de522-8b92-44bc-97d4-e89afdc436a2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:35.567477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0de522-8b92-44bc-97d4-e89afdc436a2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-7f0de522-8b92-44bc-97d4-e89afdc436a2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:35.579545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:35.580785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:35.582045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 645/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Jul 15 15:15:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:35.586876 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78e868-6551-441c-9113-b99bb4b71ef2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:35.686217 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78e868-6551-441c-9113-b99bb4b71ef2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:35.719096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f995efb-0f1c-45b7-a3d1-2c123fe2ddab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:35.719760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f995efb-0f1c-45b7-a3d1-2c123fe2ddab None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:35.720052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f995efb-0f1c-45b7-a3d1-2c123fe2ddab None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:35.720333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f995efb-0f1c-45b7-a3d1-2c123fe2ddab None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:35.721045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f995efb-0f1c-45b7-a3d1-2c123fe2ddab None admin] RBAC: Adding query filter params (name=placement) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:35.721387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f995efb-0f1c-45b7-a3d1-2c123fe2ddab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:35.722765 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f995efb-0f1c-45b7-a3d1-2c123fe2ddab None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:35.728108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 646/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Fri Jul 15 15:15:35 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:35.733862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0de522-8b92-44bc-97d4-e89afdc436a2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:35.830266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0de522-8b92-44bc-97d4-e89afdc436a2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:35.864885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f3d9-6726-4e0c-b59a-e1ac72abdfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:35.866096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f3d9-6726-4e0c-b59a-e1ac72abdfcf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:35.866382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f3d9-6726-4e0c-b59a-e1ac72abdfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:35.866665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f3d9-6726-4e0c-b59a-e1ac72abdfcf None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:35.867382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f3d9-6726-4e0c-b59a-e1ac72abdfcf None admin] RBAC: Adding query filter params (type=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:35.867691 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f3d9-6726-4e0c-b59a-e1ac72abdfcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:35.869089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f3d9-6726-4e0c-b59a-e1ac72abdfcf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:35.873568 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 646/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Fri Jul 15 15:15:35 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:37.909014 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46fb84-3187-4f9e-a03d-7c1c1cfee482 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:37.909556 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46fb84-3187-4f9e-a03d-7c1c1cfee482 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:37.909556 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46fb84-3187-4f9e-a03d-7c1c1cfee482 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:37.910918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 647/1293] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:15:37.916380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdc127-fd21-4bab-902a-493561cc705b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:37.916861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdc127-fd21-4bab-902a-493561cc705b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:37.916952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdc127-fd21-4bab-902a-493561cc705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:37.934389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4fcdc127-fd21-4bab-902a-493561cc705b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:15:37.935608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4fcdc127-fd21-4bab-902a-493561cc705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:15:37.967258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:38.006691 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 647/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:15:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:15:38.029459 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46fb84-3187-4f9e-a03d-7c1c1cfee482 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:38.063490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:38.134300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46fb84-3187-4f9e-a03d-7c1c1cfee482 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:38.170923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5305dc-569e-45a0-9828-adb727be8606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:38.171729 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5305dc-569e-45a0-9828-adb727be8606 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:38.171937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5305dc-569e-45a0-9828-adb727be8606 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:38.172206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5305dc-569e-45a0-9828-adb727be8606 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:38.172947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5305dc-569e-45a0-9828-adb727be8606 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:38.174455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5305dc-569e-45a0-9828-adb727be8606 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:38.193184 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 648/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Jul 15 15:15:38 2022] POST /identity/v3/services => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:15:40.230621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d7c06-c6ce-46b9-b5a1-7bde994364fe None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:40.231204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d7c06-c6ce-46b9-b5a1-7bde994364fe None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:40.231204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d7c06-c6ce-46b9-b5a1-7bde994364fe None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:40.232628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 648/1296] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:15:40.237970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a00d20-5ffc-4c11-90d5-9e16d6061837 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:40.238416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a00d20-5ffc-4c11-90d5-9e16d6061837 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:40.238528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a00d20-5ffc-4c11-90d5-9e16d6061837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:40.258326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-94a00d20-5ffc-4c11-90d5-9e16d6061837 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:15:40.259593 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-94a00d20-5ffc-4c11-90d5-9e16d6061837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:15:40.356060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 649/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:15:40 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:15:40.381160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d7c06-c6ce-46b9-b5a1-7bde994364fe None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:40.530076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d7c06-c6ce-46b9-b5a1-7bde994364fe None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:40.579933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f318f45-c5ac-40f8-8d51-e48c7a2971eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:40.581172 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f318f45-c5ac-40f8-8d51-e48c7a2971eb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:40.581610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f318f45-c5ac-40f8-8d51-e48c7a2971eb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:40.582033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f318f45-c5ac-40f8-8d51-e48c7a2971eb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:40.583123 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f318f45-c5ac-40f8-8d51-e48c7a2971eb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:40.585406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f318f45-c5ac-40f8-8d51-e48c7a2971eb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-5f318f45-c5ac-40f8-8d51-e48c7a2971eb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:40.605926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:40.607196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:40.608280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 649/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Jul 15 15:15:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:40.614347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a00d20-5ffc-4c11-90d5-9e16d6061837 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:40.634018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:40.724425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a00d20-5ffc-4c11-90d5-9e16d6061837 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:40.761193 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209abc2-09cf-4a87-b7b6-b12e38e3bb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:40.761874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209abc2-09cf-4a87-b7b6-b12e38e3bb7e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:40.762162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209abc2-09cf-4a87-b7b6-b12e38e3bb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:40.762439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209abc2-09cf-4a87-b7b6-b12e38e3bb7e None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:40.763157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209abc2-09cf-4a87-b7b6-b12e38e3bb7e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:40.763464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209abc2-09cf-4a87-b7b6-b12e38e3bb7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:40.764998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209abc2-09cf-4a87-b7b6-b12e38e3bb7e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:40.774363 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 650/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Fri Jul 15 15:15:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:40.780828 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f318f45-c5ac-40f8-8d51-e48c7a2971eb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:40.815906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:40.886095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f318f45-c5ac-40f8-8d51-e48c7a2971eb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:40.920441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f0b2a-bfb8-4d56-b0a5-a071d562001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:40.921121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f0b2a-bfb8-4d56-b0a5-a071d562001f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:40.921411 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f0b2a-bfb8-4d56-b0a5-a071d562001f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:40.921696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f0b2a-bfb8-4d56-b0a5-a071d562001f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:40.922490 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f0b2a-bfb8-4d56-b0a5-a071d562001f None admin] RBAC: Adding query filter params (interface=public, service_id=bdfb7e97e9834878b7fa4d55962f3757, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:40.922803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f0b2a-bfb8-4d56-b0a5-a071d562001f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:40.924189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f0b2a-bfb8-4d56-b0a5-a071d562001f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:40.930140 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 650/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Jul 15 15:15:40 2022] GET /identity/v3/endpoints?service_id=bdfb7e97e9834878b7fa4d55962f3757&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:40.935979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209abc2-09cf-4a87-b7b6-b12e38e3bb7e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:41.021411 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:41.039921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209abc2-09cf-4a87-b7b6-b12e38e3bb7e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:41.086375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b440d5-acc2-4461-80c0-20781d66f534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:41.087135 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b440d5-acc2-4461-80c0-20781d66f534 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:41.087422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b440d5-acc2-4461-80c0-20781d66f534 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:41.087698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b440d5-acc2-4461-80c0-20781d66f534 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:41.088389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b440d5-acc2-4461-80c0-20781d66f534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:41.089797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b440d5-acc2-4461-80c0-20781d66f534 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:41.096943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 651/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Jul 15 15:15:40 2022] GET /identity/v3/services => generated 2191 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:15:43.141037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d7132-fe48-4fea-955f-ac90457bd534 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:43.141634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d7132-fe48-4fea-955f-ac90457bd534 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:43.141634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d7132-fe48-4fea-955f-ac90457bd534 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:43.142991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 651/1302] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:15:43.148314 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cc047-a64b-427c-962f-edec9a86a956 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:43.148829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cc047-a64b-427c-962f-edec9a86a956 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:43.148931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cc047-a64b-427c-962f-edec9a86a956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:43.165740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5f2cc047-a64b-427c-962f-edec9a86a956 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:15:43.166953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5f2cc047-a64b-427c-962f-edec9a86a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:15:43.235789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 652/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:15:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:15:43.259467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d7132-fe48-4fea-955f-ac90457bd534 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:43.356130 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:43.363557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d7132-fe48-4fea-955f-ac90457bd534 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:43.397978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a8d98-adb0-48eb-867d-94b80006a1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:43.398697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a8d98-adb0-48eb-867d-94b80006a1bf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:43.398981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a8d98-adb0-48eb-867d-94b80006a1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:43.399258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a8d98-adb0-48eb-867d-94b80006a1bf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:43.399919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a8d98-adb0-48eb-867d-94b80006a1bf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:43.401324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a8d98-adb0-48eb-867d-94b80006a1bf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-146a8d98-adb0-48eb-867d-94b80006a1bf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:15:43.413889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:15:43.415145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 15 15:15:43.416111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 652/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Jul 15 15:15:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:15:43.421556 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cc047-a64b-427c-962f-edec9a86a956 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:43.506307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:43.529393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cc047-a64b-427c-962f-edec9a86a956 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:43.567568 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f945b3-5a86-4146-9fe3-3a49f4550309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:43.568238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f945b3-5a86-4146-9fe3-3a49f4550309 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:43.568521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f945b3-5a86-4146-9fe3-3a49f4550309 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:43.568797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f945b3-5a86-4146-9fe3-3a49f4550309 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:43.569611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f945b3-5a86-4146-9fe3-3a49f4550309 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:15:43.569919 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f945b3-5a86-4146-9fe3-3a49f4550309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:43.571299 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f945b3-5a86-4146-9fe3-3a49f4550309 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:43.576918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 653/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Fri Jul 15 15:15:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:15:43.583066 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a8d98-adb0-48eb-867d-94b80006a1bf None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:15:43.684480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a8d98-adb0-48eb-867d-94b80006a1bf None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:15:43.716760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055ef30-d463-4797-acab-5c2f4be6a538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:15:43.717452 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055ef30-d463-4797-acab-5c2f4be6a538 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:15:43.717741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055ef30-d463-4797-acab-5c2f4be6a538 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:15:43.718020 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055ef30-d463-4797-acab-5c2f4be6a538 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:15:43.718765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055ef30-d463-4797-acab-5c2f4be6a538 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:15:43.720206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055ef30-d463-4797-acab-5c2f4be6a538 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:15:43.739326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 653/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Jul 15 15:15:43 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:15:53.574290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=30 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:15:53.734879 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:16:49.676619 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13394bd-71c4-4664-a640-dfbb6ab98be3 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:49.677453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13394bd-71c4-4664-a640-dfbb6ab98be3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:49.677453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13394bd-71c4-4664-a640-dfbb6ab98be3 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:49.678495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 654/1307] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:16:49.683885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59cc1f-f69b-4d8b-b45a-be306f3aca5a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:49.684684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59cc1f-f69b-4d8b-b45a-be306f3aca5a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:49.684684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59cc1f-f69b-4d8b-b45a-be306f3aca5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:49.789033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6e59cc1f-f69b-4d8b-b45a-be306f3aca5a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:16:49.790310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6e59cc1f-f69b-4d8b-b45a-be306f3aca5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:49.913840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 654/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:16:49.967051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66fecf-fe75-4967-bbf6-8ca5c7da8b50 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:49.967345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66fecf-fe75-4967-bbf6-8ca5c7da8b50 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:49.967627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66fecf-fe75-4967-bbf6-8ca5c7da8b50 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:49.969391 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 655/1309] 10.222.0.64 () {54 vars in 964 bytes} [Fri Jul 15 15:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:16:49.985217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc79db-f8b5-424e-9906-0446d575942f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:49.986203 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc79db-f8b5-424e-9906-0446d575942f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:49.986952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc79db-f8b5-424e-9906-0446d575942f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:50.094887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3edc79db-f8b5-424e-9906-0446d575942f None None] MFA Rules not processed for user `88518fe83a7c4fbdb3088bb2daf04239`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:16:50.097112 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3edc79db-f8b5-424e-9906-0446d575942f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:50.123044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:16:50.191689 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 655/1310] 10.222.0.64 () {58 vars in 1061 bytes} [Fri Jul 15 15:16:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:16:50.199032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66fecf-fe75-4967-bbf6-8ca5c7da8b50 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:16:50.201013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-aa66fecf-fe75-4967-bbf6-8ca5c7da8b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:50.325557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66fecf-fe75-4967-bbf6-8ca5c7da8b50 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:16:50.421302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cd6f7-0778-4b39-b82b-07faee5eed7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:16:50.422030 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd6f7-0778-4b39-b82b-07faee5eed7a service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:50.422421 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd6f7-0778-4b39-b82b-07faee5eed7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:50.422809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd6f7-0778-4b39-b82b-07faee5eed7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:50.425210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ef8cd6f7-0778-4b39-b82b-07faee5eed7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:50.487491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:16:50.551500 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cd6f7-0778-4b39-b82b-07faee5eed7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:16:50.553146 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cd6f7-0778-4b39-b82b-07faee5eed7a service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:16:50.573475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 656/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:16:53.004948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5475b-ec40-470e-8a72-f95df41c18c5 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:53.005700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5475b-ec40-470e-8a72-f95df41c18c5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:53.005700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5475b-ec40-470e-8a72-f95df41c18c5 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:53.007285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 656/1312] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:16:53.013690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160fef0-a06b-42ff-bf35-dd5a159055a1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:53.014231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160fef0-a06b-42ff-bf35-dd5a159055a1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:53.014231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160fef0-a06b-42ff-bf35-dd5a159055a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:53.124899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3160fef0-a06b-42ff-bf35-dd5a159055a1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:16:53.126832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3160fef0-a06b-42ff-bf35-dd5a159055a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:53.313680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 657/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:16:53.362007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5475b-ec40-470e-8a72-f95df41c18c5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:16:53.363807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c8f5475b-ec40-470e-8a72-f95df41c18c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:53.516747 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5475b-ec40-470e-8a72-f95df41c18c5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:16:53.634754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:16:53.643648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf36501-954e-4710-b655-b8b7b664d189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:16:53.644753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf36501-954e-4710-b655-b8b7b664d189 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:53.645303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf36501-954e-4710-b655-b8b7b664d189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:53.645806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf36501-954e-4710-b655-b8b7b664d189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:53.647701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6cf36501-954e-4710-b655-b8b7b664d189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:53.791792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf36501-954e-4710-b655-b8b7b664d189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:16:53.793326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf36501-954e-4710-b655-b8b7b664d189 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:16:53.813446 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 657/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:16:56.269582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b55be-452c-4409-b11b-1efa355a63f4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:56.269582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b55be-452c-4409-b11b-1efa355a63f4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:56.270363 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b55be-452c-4409-b11b-1efa355a63f4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:56.271278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 658/1315] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:16:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:16:56.277387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb384c4-9a59-40d9-8f1a-27421589f79d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:56.277850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb384c4-9a59-40d9-8f1a-27421589f79d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:56.277942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb384c4-9a59-40d9-8f1a-27421589f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:56.349611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0bb384c4-9a59-40d9-8f1a-27421589f79d None None] MFA Rules not processed for user `3564ee5cf4b74d50a0faeae97059d272`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:16:56.350862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0bb384c4-9a59-40d9-8f1a-27421589f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:56.403166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:16:56.448311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 658/1316] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:16:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:16:56.488986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b55be-452c-4409-b11b-1efa355a63f4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:16:56.490545 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-033b55be-452c-4409-b11b-1efa355a63f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:56.506190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:16:56.608232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b55be-452c-4409-b11b-1efa355a63f4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:16:56.680768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b0d93-7d63-465f-b9e6-9ae3ab0bbadd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:16:56.681452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0d93-7d63-465f-b9e6-9ae3ab0bbadd service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:56.681740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0d93-7d63-465f-b9e6-9ae3ab0bbadd service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:56.682017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0d93-7d63-465f-b9e6-9ae3ab0bbadd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:56.683661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-547b0d93-7d63-465f-b9e6-9ae3ab0bbadd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:56.744751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:16:56.792186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b0d93-7d63-465f-b9e6-9ae3ab0bbadd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:16:56.793685 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b0d93-7d63-465f-b9e6-9ae3ab0bbadd service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:16:56.817278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 659/1317] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:16:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:16:59.461578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7888c-e1b1-409d-a0b6-4eb78874bc81 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:59.462163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7888c-e1b1-409d-a0b6-4eb78874bc81 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:59.462163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7888c-e1b1-409d-a0b6-4eb78874bc81 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:59.463500 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 659/1318] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:16:59.468661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14a37d-3d91-4fff-b1b8-3b68e48601c8 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:59.469053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14a37d-3d91-4fff-b1b8-3b68e48601c8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:59.469265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14a37d-3d91-4fff-b1b8-3b68e48601c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:59.534743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3c14a37d-3d91-4fff-b1b8-3b68e48601c8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:16:59.535963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3c14a37d-3d91-4fff-b1b8-3b68e48601c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:59.632732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 660/1319] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:16:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:16:59.687448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fae055-6988-4d41-bc0f-affc7a55f4eb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:59.687730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fae055-6988-4d41-bc0f-affc7a55f4eb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:59.688008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fae055-6988-4d41-bc0f-affc7a55f4eb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:59.689461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 660/1320] 10.222.0.64 () {54 vars in 964 bytes} [Fri Jul 15 15:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:16:59.695461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b560f31-9e0d-4d23-b334-0d15d7333ebc None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:16:59.695757 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b560f31-9e0d-4d23-b334-0d15d7333ebc None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:16:59.696045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b560f31-9e0d-4d23-b334-0d15d7333ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:16:59.716795 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:16:59.773477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2b560f31-9e0d-4d23-b334-0d15d7333ebc None None] MFA Rules not processed for user `88518fe83a7c4fbdb3088bb2daf04239`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:16:59.774698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2b560f31-9e0d-4d23-b334-0d15d7333ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:59.850044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 661/1321] 10.222.0.64 () {58 vars in 1061 bytes} [Fri Jul 15 15:16:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:16:59.859136 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fae055-6988-4d41-bc0f-affc7a55f4eb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:16:59.860671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a8fae055-6988-4d41-bc0f-affc7a55f4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:16:59.962352 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fae055-6988-4d41-bc0f-affc7a55f4eb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:00.034596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ec901-a3bb-4ed9-9798-626575767a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:00.035164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ec901-a3bb-4ed9-9798-626575767a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:00.035445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ec901-a3bb-4ed9-9798-626575767a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:00.035718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ec901-a3bb-4ed9-9798-626575767a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:00.037413 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1e6ec901-a3bb-4ed9-9798-626575767a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:00.045102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:00.150464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ec901-a3bb-4ed9-9798-626575767a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:00.151916 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ec901-a3bb-4ed9-9798-626575767a66 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:00.169852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 661/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:16:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:03.467239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf19ff7-47d5-4725-b268-21bf5955ca9d None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:03.467789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf19ff7-47d5-4725-b268-21bf5955ca9d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:03.467789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf19ff7-47d5-4725-b268-21bf5955ca9d None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:03.469201 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 662/1323] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:03.474673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c268d-6314-4907-9c06-6a6a3ed2540a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:03.475141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c268d-6314-4907-9c06-6a6a3ed2540a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:03.475247 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c268d-6314-4907-9c06-6a6a3ed2540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:03.547980 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-613c268d-6314-4907-9c06-6a6a3ed2540a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:03.549265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-613c268d-6314-4907-9c06-6a6a3ed2540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:03.623115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:03.666947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 662/1324] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:03.702785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf19ff7-47d5-4725-b268-21bf5955ca9d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:03.704391 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0bf19ff7-47d5-4725-b268-21bf5955ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:03.839680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf19ff7-47d5-4725-b268-21bf5955ca9d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:03.856501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:03.924285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f6f1-11d0-40d0-a826-0a98a8090298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:03.924955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f6f1-11d0-40d0-a826-0a98a8090298 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:03.925272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f6f1-11d0-40d0-a826-0a98a8090298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:03.925550 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f6f1-11d0-40d0-a826-0a98a8090298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:03.927308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6079f6f1-11d0-40d0-a826-0a98a8090298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:04.047211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079f6f1-11d0-40d0-a826-0a98a8090298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:04.049320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079f6f1-11d0-40d0-a826-0a98a8090298 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:04.071493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 663/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:17:06.190411 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bae58f-bc96-455e-897c-bc8ec16a4d96 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:06.191000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bae58f-bc96-455e-897c-bc8ec16a4d96 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:06.191000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bae58f-bc96-455e-897c-bc8ec16a4d96 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:06.192604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 663/1326] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:06.198378 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfd5af-cc42-441f-bf07-641654744787 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:06.198927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfd5af-cc42-441f-bf07-641654744787 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:06.199033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfd5af-cc42-441f-bf07-641654744787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:06.263218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:06.284407 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-00bfd5af-cc42-441f-bf07-641654744787 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:06.285571 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-00bfd5af-cc42-441f-bf07-641654744787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:06.395498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 664/1327] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:06.433037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bae58f-bc96-455e-897c-bc8ec16a4d96 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:06.434644 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-97bae58f-bc96-455e-897c-bc8ec16a4d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:06.542489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bae58f-bc96-455e-897c-bc8ec16a4d96 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:06.616974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454afb7-f4d5-4cce-9a5e-c8bdb97ee941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:06.617659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454afb7-f4d5-4cce-9a5e-c8bdb97ee941 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:06.617946 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454afb7-f4d5-4cce-9a5e-c8bdb97ee941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:06.618224 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454afb7-f4d5-4cce-9a5e-c8bdb97ee941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:06.619876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5454afb7-f4d5-4cce-9a5e-c8bdb97ee941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:06.637678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:06.731020 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454afb7-f4d5-4cce-9a5e-c8bdb97ee941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:06.732621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454afb7-f4d5-4cce-9a5e-c8bdb97ee941 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:06.751411 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 664/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:08.878408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e96b4-18b1-41af-b2c6-c30f00196dc9 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:08.879001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e96b4-18b1-41af-b2c6-c30f00196dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:08.879001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e96b4-18b1-41af-b2c6-c30f00196dc9 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:08.880358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 665/1329] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:08.885989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c6f5f-4b63-4468-b68f-94232c947d7f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:08.886451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c6f5f-4b63-4468-b68f-94232c947d7f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:08.886551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c6f5f-4b63-4468-b68f-94232c947d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:08.970554 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-be8c6f5f-4b63-4468-b68f-94232c947d7f None None] MFA Rules not processed for user `3564ee5cf4b74d50a0faeae97059d272`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:08.971798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-be8c6f5f-4b63-4468-b68f-94232c947d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:09.042769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:09.091259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 665/1330] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:09.129883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e96b4-18b1-41af-b2c6-c30f00196dc9 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:09.131373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-065e96b4-18b1-41af-b2c6-c30f00196dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:09.249931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e96b4-18b1-41af-b2c6-c30f00196dc9 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:09.274489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:09.336639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d4699-827d-4f66-bf1d-fde4777b00e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:09.337337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d4699-827d-4f66-bf1d-fde4777b00e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:09.337625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d4699-827d-4f66-bf1d-fde4777b00e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:09.337904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d4699-827d-4f66-bf1d-fde4777b00e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:09.339690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-992d4699-827d-4f66-bf1d-fde4777b00e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:09.465657 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d4699-827d-4f66-bf1d-fde4777b00e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:09.467028 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d4699-827d-4f66-bf1d-fde4777b00e3 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:09.486507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 666/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:11.824926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e76e01-edaa-475e-af9b-240b64e063f5 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:11.825570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e76e01-edaa-475e-af9b-240b64e063f5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:11.825570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e76e01-edaa-475e-af9b-240b64e063f5 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:11.826910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 666/1332] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:11.836897 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d556a-4581-4158-a263-033160ee84be None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:11.836897 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d556a-4581-4158-a263-033160ee84be None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:11.836897 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d556a-4581-4158-a263-033160ee84be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:11.897053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:11.900122 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-863d556a-4581-4158-a263-033160ee84be None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:11.901966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-863d556a-4581-4158-a263-033160ee84be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:11.999031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 667/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:12.035319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e76e01-edaa-475e-af9b-240b64e063f5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:12.036862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f4e76e01-edaa-475e-af9b-240b64e063f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:12.140438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e76e01-edaa-475e-af9b-240b64e063f5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:12.214312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24085b08-50e9-4d73-98f7-1520acc95fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:12.214966 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085b08-50e9-4d73-98f7-1520acc95fbb service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:12.215252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085b08-50e9-4d73-98f7-1520acc95fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:12.215538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085b08-50e9-4d73-98f7-1520acc95fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:12.217229 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-24085b08-50e9-4d73-98f7-1520acc95fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:12.245513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:12.333016 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24085b08-50e9-4d73-98f7-1520acc95fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:12.334406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24085b08-50e9-4d73-98f7-1520acc95fbb service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:12.353169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 667/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:14.477021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854c49-39db-4c30-8091-1fbf09b20181 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:14.477670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854c49-39db-4c30-8091-1fbf09b20181 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:14.477670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854c49-39db-4c30-8091-1fbf09b20181 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:14.478998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 668/1335] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:14.484572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0162c9-e21c-48a2-9fcd-3e4b36d4a2b5 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:14.485013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0162c9-e21c-48a2-9fcd-3e4b36d4a2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:14.485175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0162c9-e21c-48a2-9fcd-3e4b36d4a2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:14.555529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-db0162c9-e21c-48a2-9fcd-3e4b36d4a2b5 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:14.556783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-db0162c9-e21c-48a2-9fcd-3e4b36d4a2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:14.638940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:14.662898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 668/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:14.702541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72854c49-39db-4c30-8091-1fbf09b20181 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:14.704886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-72854c49-39db-4c30-8091-1fbf09b20181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:14.813165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72854c49-39db-4c30-8091-1fbf09b20181 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:14.841330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:14.897889 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfe567-1b80-4190-833a-a7597a7a7292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:14.898378 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfe567-1b80-4190-833a-a7597a7a7292 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:14.898663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfe567-1b80-4190-833a-a7597a7a7292 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:14.898943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfe567-1b80-4190-833a-a7597a7a7292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:14.900610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-42bfe567-1b80-4190-833a-a7597a7a7292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:15.010509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfe567-1b80-4190-833a-a7597a7a7292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:15.011972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfe567-1b80-4190-833a-a7597a7a7292 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:15.030579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 669/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:17.538493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913495e-6c0d-4f50-a2e5-ca81cb2567c0 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:17.539076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913495e-6c0d-4f50-a2e5-ca81cb2567c0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:17.539076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913495e-6c0d-4f50-a2e5-ca81cb2567c0 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:17.540508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 669/1338] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:17.546049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3051cc-43f4-47fe-a227-dcd9477189b3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:17.546475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3051cc-43f4-47fe-a227-dcd9477189b3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:17.546606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3051cc-43f4-47fe-a227-dcd9477189b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:17.621213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ee3051cc-43f4-47fe-a227-dcd9477189b3 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:17.622720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ee3051cc-43f4-47fe-a227-dcd9477189b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:17.632934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:17.726235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 670/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:17.763324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913495e-6c0d-4f50-a2e5-ca81cb2567c0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:17.765686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2913495e-6c0d-4f50-a2e5-ca81cb2567c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:17.869323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913495e-6c0d-4f50-a2e5-ca81cb2567c0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:17.943293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf94f9-8ce6-41b6-bfdc-37a7ea3351d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:17.943944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf94f9-8ce6-41b6-bfdc-37a7ea3351d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:17.944229 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf94f9-8ce6-41b6-bfdc-37a7ea3351d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:17.944505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf94f9-8ce6-41b6-bfdc-37a7ea3351d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:17.946283 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e1bf94f9-8ce6-41b6-bfdc-37a7ea3351d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:17.982325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:18.056806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf94f9-8ce6-41b6-bfdc-37a7ea3351d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:18.058294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf94f9-8ce6-41b6-bfdc-37a7ea3351d1 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:18.077508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 670/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:22.607963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90877b2e-6e8a-4f36-9f54-90850ebc8638 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:22.608508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90877b2e-6e8a-4f36-9f54-90850ebc8638 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:22.608930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90877b2e-6e8a-4f36-9f54-90850ebc8638 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:22.614156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 671/1341] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:22.617630 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0335d-af83-4d26-9c7f-10ed57058dcd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:22.618128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0335d-af83-4d26-9c7f-10ed57058dcd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:22.618128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0335d-af83-4d26-9c7f-10ed57058dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:22.709194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e3a0335d-af83-4d26-9c7f-10ed57058dcd None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:22.710431 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e3a0335d-af83-4d26-9c7f-10ed57058dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:22.812799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:22.824948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 671/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:17:22.864541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90877b2e-6e8a-4f36-9f54-90850ebc8638 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:22.866110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-90877b2e-6e8a-4f36-9f54-90850ebc8638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:22.996763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90877b2e-6e8a-4f36-9f54-90850ebc8638 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:23.056463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:23.103405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277af126-0c7d-4b0e-9b9d-819f402efa54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:23.104170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277af126-0c7d-4b0e-9b9d-819f402efa54 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:23.104674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277af126-0c7d-4b0e-9b9d-819f402efa54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:23.104972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277af126-0c7d-4b0e-9b9d-819f402efa54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:23.107537 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-277af126-0c7d-4b0e-9b9d-819f402efa54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:23.249347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277af126-0c7d-4b0e-9b9d-819f402efa54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:23.250739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277af126-0c7d-4b0e-9b9d-819f402efa54 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:23.271588 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 672/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:26.031527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba61842-bc4a-489e-b21b-61295e99d589 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:26.032326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba61842-bc4a-489e-b21b-61295e99d589 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:26.032326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba61842-bc4a-489e-b21b-61295e99d589 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:26.033477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 672/1344] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:26.039399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b13e2f-6e16-43ef-b539-33638d9b1f05 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:26.039937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b13e2f-6e16-43ef-b539-33638d9b1f05 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:26.039937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b13e2f-6e16-43ef-b539-33638d9b1f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:26.122057 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-56b13e2f-6e16-43ef-b539-33638d9b1f05 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:26.123655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-56b13e2f-6e16-43ef-b539-33638d9b1f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:26.149008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:26.250089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 673/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:26.300001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba61842-bc4a-489e-b21b-61295e99d589 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:26.302450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0ba61842-bc4a-489e-b21b-61295e99d589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:26.411832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba61842-bc4a-489e-b21b-61295e99d589 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:26.509735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd444f4-bc36-48a8-9786-bdaa01f56111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:26.515625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd444f4-bc36-48a8-9786-bdaa01f56111 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:26.515625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd444f4-bc36-48a8-9786-bdaa01f56111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:26.515625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd444f4-bc36-48a8-9786-bdaa01f56111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:26.515625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ebd444f4-bc36-48a8-9786-bdaa01f56111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:26.574739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:26.651342 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd444f4-bc36-48a8-9786-bdaa01f56111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:26.653121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd444f4-bc36-48a8-9786-bdaa01f56111 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:26.676239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 673/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:17:30.923028 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac113f-2c12-4065-85cc-d882db34661c None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:30.923566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac113f-2c12-4065-85cc-d882db34661c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:30.923566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac113f-2c12-4065-85cc-d882db34661c None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:30.925082 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 674/1347] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:30.930877 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448d66-d119-4d05-a83a-a91ecbc2b26e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:30.931374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448d66-d119-4d05-a83a-a91ecbc2b26e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:30.931455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448d66-d119-4d05-a83a-a91ecbc2b26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:31.013160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-04448d66-d119-4d05-a83a-a91ecbc2b26e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:31.014767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-04448d66-d119-4d05-a83a-a91ecbc2b26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:31.126234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:31.130061 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 674/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:31.168922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac113f-2c12-4065-85cc-d882db34661c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:31.170566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f9ac113f-2c12-4065-85cc-d882db34661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:31.310101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac113f-2c12-4065-85cc-d882db34661c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:31.370757 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:31.403510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f10501-f127-4681-9f67-5a5904381fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:31.404286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f10501-f127-4681-9f67-5a5904381fdb service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:31.404677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f10501-f127-4681-9f67-5a5904381fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:31.405024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f10501-f127-4681-9f67-5a5904381fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:31.406850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-79f10501-f127-4681-9f67-5a5904381fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:31.543435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f10501-f127-4681-9f67-5a5904381fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:31.544950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f10501-f127-4681-9f67-5a5904381fdb service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:31.565433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 675/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:36.639802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f4a85-cd61-4c20-9e7a-54eaf2af4699 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:36.640358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f4a85-cd61-4c20-9e7a-54eaf2af4699 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:36.640358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f4a85-cd61-4c20-9e7a-54eaf2af4699 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:36.642341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 675/1350] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:36.650115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a474-8302-4c95-9f2e-81cd43eb93a5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:36.650972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a474-8302-4c95-9f2e-81cd43eb93a5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:36.651457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a474-8302-4c95-9f2e-81cd43eb93a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:36.751008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d4c9a474-8302-4c95-9f2e-81cd43eb93a5 None None] MFA Rules not processed for user `3ba61318896f43e5a68e80f38ae5f3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:36.752747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d4c9a474-8302-4c95-9f2e-81cd43eb93a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:36.773639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:36.939850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 676/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:17:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:41.272968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953ffc-605f-4bf8-acaa-b4d1106d45e3 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:41.273547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953ffc-605f-4bf8-acaa-b4d1106d45e3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:41.273547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953ffc-605f-4bf8-acaa-b4d1106d45e3 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:41.275130 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 676/1352] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:41.280329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eeb9c-5d4a-435d-842d-9e42d28e7586 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:41.281191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eeb9c-5d4a-435d-842d-9e42d28e7586 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:41.281735 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eeb9c-5d4a-435d-842d-9e42d28e7586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:41.373245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b41eeb9c-5d4a-435d-842d-9e42d28e7586 None None] MFA Rules not processed for user `3ba61318896f43e5a68e80f38ae5f3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:41.375191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b41eeb9c-5d4a-435d-842d-9e42d28e7586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:41.467805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:41.507960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 677/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:17:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:42.661786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934b4a-b432-43ce-98d2-007264b529a5 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:42.662314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934b4a-b432-43ce-98d2-007264b529a5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:42.662439 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934b4a-b432-43ce-98d2-007264b529a5 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:42.664019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 677/1354] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:42.669307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04894fff-0a21-44cc-a898-296c9c88ee47 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:42.669752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04894fff-0a21-44cc-a898-296c9c88ee47 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:42.669886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04894fff-0a21-44cc-a898-296c9c88ee47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:42.743749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-04894fff-0a21-44cc-a898-296c9c88ee47 None None] MFA Rules not processed for user `3ba61318896f43e5a68e80f38ae5f3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:42.744948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-04894fff-0a21-44cc-a898-296c9c88ee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:42.850209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 678/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:17:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:17:46.309935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32dd44-07cf-4fed-ad76-0f67ff6a5ce7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:46.310457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32dd44-07cf-4fed-ad76-0f67ff6a5ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:46.310698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32dd44-07cf-4fed-ad76-0f67ff6a5ce7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:46.312835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 678/1356] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:46.318990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31effb-65f3-4388-877b-6ab96a87928c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:46.319453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31effb-65f3-4388-877b-6ab96a87928c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:46.319553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31effb-65f3-4388-877b-6ab96a87928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:46.387506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:46.426949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3f31effb-65f3-4388-877b-6ab96a87928c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:46.428349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3f31effb-65f3-4388-877b-6ab96a87928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:46.555068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 679/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:46.612998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e02c73-94a4-4247-bba9-e05d2f02da95 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:46.613564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e02c73-94a4-4247-bba9-e05d2f02da95 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:46.614035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e02c73-94a4-4247-bba9-e05d2f02da95 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:46.615939 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 679/1358] 10.222.0.64 () {54 vars in 961 bytes} [Fri Jul 15 15:17:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:46.625929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8d900-556d-449e-86f1-6310db0079e6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:46.627118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8d900-556d-449e-86f1-6310db0079e6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:46.627656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8d900-556d-449e-86f1-6310db0079e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:46.722955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-61b8d900-556d-449e-86f1-6310db0079e6 None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:46.724444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-61b8d900-556d-449e-86f1-6310db0079e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:46.779047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:46.856281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 680/1359] 10.222.0.64 () {58 vars in 1058 bytes} [Fri Jul 15 15:17:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:17:46.864528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e02c73-94a4-4247-bba9-e05d2f02da95 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:46.866458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-95e02c73-94a4-4247-bba9-e05d2f02da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:47.031805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e02c73-94a4-4247-bba9-e05d2f02da95 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:47.122040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:47.184650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe525bb-16a9-49a9-b05d-1c2c3cc1c3b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:47.185350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe525bb-16a9-49a9-b05d-1c2c3cc1c3b1 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:47.185637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe525bb-16a9-49a9-b05d-1c2c3cc1c3b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:47.185918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe525bb-16a9-49a9-b05d-1c2c3cc1c3b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:47.187643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cbe525bb-16a9-49a9-b05d-1c2c3cc1c3b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:47.290425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe525bb-16a9-49a9-b05d-1c2c3cc1c3b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:47.292051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe525bb-16a9-49a9-b05d-1c2c3cc1c3b1 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:47.311596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 680/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:49.578087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0bea-8e9b-47c1-90d8-f4dfe73715f8 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:49.578641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0bea-8e9b-47c1-90d8-f4dfe73715f8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:49.578641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0bea-8e9b-47c1-90d8-f4dfe73715f8 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:49.580394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 681/1361] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:49.586127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7878e37-6ea1-4f70-abf6-ac19c41752e4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:49.586618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7878e37-6ea1-4f70-abf6-ac19c41752e4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:49.586713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7878e37-6ea1-4f70-abf6-ac19c41752e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:49.663834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f7878e37-6ea1-4f70-abf6-ac19c41752e4 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:49.665412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f7878e37-6ea1-4f70-abf6-ac19c41752e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:49.706569 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:49.778661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 681/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:49.824266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e0bea-8e9b-47c1-90d8-f4dfe73715f8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:49.826103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6a9e0bea-8e9b-47c1-90d8-f4dfe73715f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:50.021566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e0bea-8e9b-47c1-90d8-f4dfe73715f8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:50.039771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:50.178829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7f9ad-86ae-4ff5-a3ff-07c712e2a346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:50.179490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f9ad-86ae-4ff5-a3ff-07c712e2a346 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:50.179774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f9ad-86ae-4ff5-a3ff-07c712e2a346 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:50.180046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f9ad-86ae-4ff5-a3ff-07c712e2a346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:50.181771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7ac7f9ad-86ae-4ff5-a3ff-07c712e2a346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:50.280302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7f9ad-86ae-4ff5-a3ff-07c712e2a346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:50.282001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7f9ad-86ae-4ff5-a3ff-07c712e2a346 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:50.302151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 682/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:52.663141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3d52b-14d0-4cd5-a1f1-d0e8362fc94e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:52.663694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3d52b-14d0-4cd5-a1f1-d0e8362fc94e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:52.663694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3d52b-14d0-4cd5-a1f1-d0e8362fc94e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:52.665412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 682/1364] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:52.670960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf10ce-2277-4bbd-b56e-1d09436dbaa6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:52.671445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf10ce-2277-4bbd-b56e-1d09436dbaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:52.671537 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf10ce-2277-4bbd-b56e-1d09436dbaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:52.690171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:52.757410 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a9bf10ce-2277-4bbd-b56e-1d09436dbaa6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:52.759027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a9bf10ce-2277-4bbd-b56e-1d09436dbaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:52.863675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 683/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:52.912989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992ddf-5ac7-4891-856d-56b67ce05bf5 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:52.913649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992ddf-5ac7-4891-856d-56b67ce05bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:52.914618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992ddf-5ac7-4891-856d-56b67ce05bf5 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:52.916074 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 683/1366] 10.222.0.64 () {54 vars in 961 bytes} [Fri Jul 15 15:17:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:52.921860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfefb2-eb34-4681-9af9-7e371555b156 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:52.922292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfefb2-eb34-4681-9af9-7e371555b156 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:52.922585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfefb2-eb34-4681-9af9-7e371555b156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:53.010444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b8dfefb2-eb34-4681-9af9-7e371555b156 None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:53.011750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b8dfefb2-eb34-4681-9af9-7e371555b156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:53.051424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:53.143339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 684/1367] 10.222.0.64 () {58 vars in 1058 bytes} [Fri Jul 15 15:17:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:53.151237 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9992ddf-5ac7-4891-856d-56b67ce05bf5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:53.152979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a9992ddf-5ac7-4891-856d-56b67ce05bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:53.335292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9992ddf-5ac7-4891-856d-56b67ce05bf5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:53.359683 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:53.475889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50c604-f89b-4eb1-857a-1d824e921a1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:53.476425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50c604-f89b-4eb1-857a-1d824e921a1f service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:53.476708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50c604-f89b-4eb1-857a-1d824e921a1f service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:53.476976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50c604-f89b-4eb1-857a-1d824e921a1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:53.478674 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9c50c604-f89b-4eb1-857a-1d824e921a1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:53.580431 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50c604-f89b-4eb1-857a-1d824e921a1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:53.582135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50c604-f89b-4eb1-857a-1d824e921a1f service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:53.608194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 684/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:54.621691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086ac85-ca8d-4b51-ac9b-2411397cda63 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:54.622175 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086ac85-ca8d-4b51-ac9b-2411397cda63 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:54.622258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086ac85-ca8d-4b51-ac9b-2411397cda63 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:54.623818 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 685/1369] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:54.629659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be45c-86f9-469a-b7d5-be050353a417 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:54.630066 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be45c-86f9-469a-b7d5-be050353a417 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:54.630237 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be45c-86f9-469a-b7d5-be050353a417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:54.661898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:54.699582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0e4be45c-86f9-469a-b7d5-be050353a417 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:54.700840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0e4be45c-86f9-469a-b7d5-be050353a417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:54.805435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 685/1370] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:55.150833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20367a86-a865-4371-aa8d-605159d12d05 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:55.150833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20367a86-a865-4371-aa8d-605159d12d05 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:55.150833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20367a86-a865-4371-aa8d-605159d12d05 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:55.150833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 686/1371] 10.222.0.64 () {54 vars in 963 bytes} [Fri Jul 15 15:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:55.155226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadcea6-1e03-4c97-aadd-506bf30bb3f5 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:55.155625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadcea6-1e03-4c97-aadd-506bf30bb3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:55.156009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadcea6-1e03-4c97-aadd-506bf30bb3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:55.245393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ecadcea6-1e03-4c97-aadd-506bf30bb3f5 None None] MFA Rules not processed for user `43cfdc27dbdb45c49f50e7bb3f93c260`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:55.246777 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ecadcea6-1e03-4c97-aadd-506bf30bb3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:55.296842 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:55.329974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 686/1372] 10.222.0.64 () {58 vars in 1060 bytes} [Fri Jul 15 15:17:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:55.338209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20367a86-a865-4371-aa8d-605159d12d05 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:55.339723 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-20367a86-a865-4371-aa8d-605159d12d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:55.457945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20367a86-a865-4371-aa8d-605159d12d05 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:55.501789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:55.540980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1b7b6-52f4-465e-bbad-90ed9a6fb673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:55.541895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1b7b6-52f4-465e-bbad-90ed9a6fb673 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:55.542191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1b7b6-52f4-465e-bbad-90ed9a6fb673 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:55.542473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1b7b6-52f4-465e-bbad-90ed9a6fb673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:55.544355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-eaa1b7b6-52f4-465e-bbad-90ed9a6fb673 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:55.683874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1b7b6-52f4-465e-bbad-90ed9a6fb673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:55.690169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1b7b6-52f4-465e-bbad-90ed9a6fb673 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:55.711866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 687/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:55.732104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707be98-e7b0-4ecf-ace2-f4fa8589a63e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:55.732600 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707be98-e7b0-4ecf-ace2-f4fa8589a63e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:55.733046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707be98-e7b0-4ecf-ace2-f4fa8589a63e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:55.734296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 687/1374] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:55.739783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a333ea5-c069-4685-a2a2-9000fbfafd88 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:55.740194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a333ea5-c069-4685-a2a2-9000fbfafd88 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:55.740611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a333ea5-c069-4685-a2a2-9000fbfafd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:55.837420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1a333ea5-c069-4685-a2a2-9000fbfafd88 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:55.840289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1a333ea5-c069-4685-a2a2-9000fbfafd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:55.871397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:55.973573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 688/1375] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:56.018371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707be98-e7b0-4ecf-ace2-f4fa8589a63e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:56.020418 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9707be98-e7b0-4ecf-ace2-f4fa8589a63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:56.167072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707be98-e7b0-4ecf-ace2-f4fa8589a63e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:56.218216 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:56.280036 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f35f-74a2-4f85-a3ab-e54386e85b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:56.280686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f35f-74a2-4f85-a3ab-e54386e85b39 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:56.280969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f35f-74a2-4f85-a3ab-e54386e85b39 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:56.281275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f35f-74a2-4f85-a3ab-e54386e85b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:56.282911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f037f35f-74a2-4f85-a3ab-e54386e85b39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:56.369754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037f35f-74a2-4f85-a3ab-e54386e85b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:56.371395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037f35f-74a2-4f85-a3ab-e54386e85b39 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:56.390116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 688/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:17:58.484409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae44574-bf99-4a23-a2cb-baec62801c83 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:58.484949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae44574-bf99-4a23-a2cb-baec62801c83 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:58.484949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae44574-bf99-4a23-a2cb-baec62801c83 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:58.486268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 689/1377] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:17:58.492054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a359b29-08c2-469b-84a0-ee865e4e8980 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:58.492493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a359b29-08c2-469b-84a0-ee865e4e8980 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:58.492688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a359b29-08c2-469b-84a0-ee865e4e8980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:58.569269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7a359b29-08c2-469b-84a0-ee865e4e8980 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:17:58.570736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7a359b29-08c2-469b-84a0-ee865e4e8980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:58.578557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:58.680633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 689/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:17:58.725860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae44574-bf99-4a23-a2cb-baec62801c83 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:17:58.727469 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fae44574-bf99-4a23-a2cb-baec62801c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:58.904602 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae44574-bf99-4a23-a2cb-baec62801c83 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:17:58.908372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:17:59.022356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccef0e-d622-4491-858c-f56fbdea5796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:17:59.023017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccef0e-d622-4491-858c-f56fbdea5796 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:17:59.023309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccef0e-d622-4491-858c-f56fbdea5796 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:17:59.023589 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccef0e-d622-4491-858c-f56fbdea5796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:17:59.025371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c3ccef0e-d622-4491-858c-f56fbdea5796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:17:59.123209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccef0e-d622-4491-858c-f56fbdea5796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:17:59.124880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccef0e-d622-4491-858c-f56fbdea5796 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:17:59.144906 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 690/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:01.264725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d76ce-9595-4813-8fbf-208651ae38d0 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:01.265302 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d76ce-9595-4813-8fbf-208651ae38d0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:01.265409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d76ce-9595-4813-8fbf-208651ae38d0 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:01.266927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 690/1380] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:01.272244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9008bb7-31a9-40ab-8443-68e3b95e77db None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:01.272710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9008bb7-31a9-40ab-8443-68e3b95e77db None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:01.273214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9008bb7-31a9-40ab-8443-68e3b95e77db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:01.288528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:01.359630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e9008bb7-31a9-40ab-8443-68e3b95e77db None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:01.361017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e9008bb7-31a9-40ab-8443-68e3b95e77db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:01.495422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 691/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:01.536848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d76ce-9595-4813-8fbf-208651ae38d0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:01.538778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f35d76ce-9595-4813-8fbf-208651ae38d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:01.724585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:01.752559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d76ce-9595-4813-8fbf-208651ae38d0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:01.878551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156b7ce-32f5-4dc6-8aa7-f0beb0409ef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:01.879879 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156b7ce-32f5-4dc6-8aa7-f0beb0409ef9 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:01.880256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156b7ce-32f5-4dc6-8aa7-f0beb0409ef9 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:01.880604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156b7ce-32f5-4dc6-8aa7-f0beb0409ef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:01.882355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5156b7ce-32f5-4dc6-8aa7-f0beb0409ef9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:01.985572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156b7ce-32f5-4dc6-8aa7-f0beb0409ef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:01.987186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156b7ce-32f5-4dc6-8aa7-f0beb0409ef9 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:01.998429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:02.015074 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 691/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:04.302659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca9de6-db70-4104-92c9-c2176695ce14 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:04.303203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca9de6-db70-4104-92c9-c2176695ce14 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:04.303203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca9de6-db70-4104-92c9-c2176695ce14 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:04.304610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 692/1383] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:04.310522 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523afce-6758-46eb-a8cc-68572a6ae611 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:04.311005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523afce-6758-46eb-a8cc-68572a6ae611 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:04.311675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523afce-6758-46eb-a8cc-68572a6ae611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:04.425176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0523afce-6758-46eb-a8cc-68572a6ae611 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:04.426472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0523afce-6758-46eb-a8cc-68572a6ae611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:04.537205 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 692/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:04.581034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca9de6-db70-4104-92c9-c2176695ce14 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:04.583270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d6ca9de6-db70-4104-92c9-c2176695ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:04.686056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:04.753389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca9de6-db70-4104-92c9-c2176695ce14 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:04.892596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a8544-b86e-4448-a7b4-0764b436fa58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:04.893525 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a8544-b86e-4448-a7b4-0764b436fa58 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:04.893923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a8544-b86e-4448-a7b4-0764b436fa58 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:04.894382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a8544-b86e-4448-a7b4-0764b436fa58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:04.896923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7a5a8544-b86e-4448-a7b4-0764b436fa58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:04.969899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:05.021713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a8544-b86e-4448-a7b4-0764b436fa58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:05.023409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a8544-b86e-4448-a7b4-0764b436fa58 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:05.042440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 693/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:18:07.126825 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eb55f-266d-4811-8977-679abdf5c4e6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:07.127548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eb55f-266d-4811-8977-679abdf5c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:07.127548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eb55f-266d-4811-8977-679abdf5c4e6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:07.129661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 693/1386] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:18:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:07.135306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49fa42-afe3-4b7a-80ee-ea5befb22d81 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:07.135921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49fa42-afe3-4b7a-80ee-ea5befb22d81 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:07.135921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49fa42-afe3-4b7a-80ee-ea5befb22d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:07.204384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-fb49fa42-afe3-4b7a-80ee-ea5befb22d81 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:07.205627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fb49fa42-afe3-4b7a-80ee-ea5befb22d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:07.314137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 694/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:07.373417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eb55f-266d-4811-8977-679abdf5c4e6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:07.375014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-296eb55f-266d-4811-8977-679abdf5c4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:07.469363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:07.547989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eb55f-266d-4811-8977-679abdf5c4e6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:07.678816 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31c607-ffa8-4f16-b7e5-1932e558201a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:07.679504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31c607-ffa8-4f16-b7e5-1932e558201a service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:07.679893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31c607-ffa8-4f16-b7e5-1932e558201a service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:07.680184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31c607-ffa8-4f16-b7e5-1932e558201a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:07.681943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-de31c607-ffa8-4f16-b7e5-1932e558201a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:07.732185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:07.791680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31c607-ffa8-4f16-b7e5-1932e558201a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:07.793395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31c607-ffa8-4f16-b7e5-1932e558201a service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:07.812890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 694/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:09.968306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec4f17-96ce-456f-8601-9f63482006f4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:09.968863 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec4f17-96ce-456f-8601-9f63482006f4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:09.968965 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec4f17-96ce-456f-8601-9f63482006f4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:09.970802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 695/1389] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:09.976653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd41f84-8bae-46ec-8cdd-a6b107d6f5f4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:09.977168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd41f84-8bae-46ec-8cdd-a6b107d6f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:09.977275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd41f84-8bae-46ec-8cdd-a6b107d6f5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:10.049124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ddd41f84-8bae-46ec-8cdd-a6b107d6f5f4 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:10.050389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ddd41f84-8bae-46ec-8cdd-a6b107d6f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:10.153301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 695/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:10.200609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec4f17-96ce-456f-8601-9f63482006f4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:10.202513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bfec4f17-96ce-456f-8601-9f63482006f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:10.236347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:10.361330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec4f17-96ce-456f-8601-9f63482006f4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:10.470721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:10.484214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5ede6-9ff7-4a40-9647-26cf38345fb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:10.484998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5ede6-9ff7-4a40-9647-26cf38345fb9 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:10.485310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5ede6-9ff7-4a40-9647-26cf38345fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:10.485582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5ede6-9ff7-4a40-9647-26cf38345fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:10.487275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9be5ede6-9ff7-4a40-9647-26cf38345fb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:10.578941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5ede6-9ff7-4a40-9647-26cf38345fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:10.580575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5ede6-9ff7-4a40-9647-26cf38345fb9 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:10.600757 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 696/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:12.253324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dc580-9010-4f21-8a65-fe1b7c1c21fa None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:12.253902 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dc580-9010-4f21-8a65-fe1b7c1c21fa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:12.253902 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dc580-9010-4f21-8a65-fe1b7c1c21fa None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:12.255379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 696/1392] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:12.265585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2737e84-ba4e-45a5-866b-5600b41bb7f6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:12.267040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2737e84-ba4e-45a5-866b-5600b41bb7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:12.267040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2737e84-ba4e-45a5-866b-5600b41bb7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:12.341900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e2737e84-ba4e-45a5-866b-5600b41bb7f6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:12.343104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e2737e84-ba4e-45a5-866b-5600b41bb7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:12.410049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:12.457099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 697/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:12.522471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaacbee-a234-419f-a29f-f2af88d9b7e2 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:12.522979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaacbee-a234-419f-a29f-f2af88d9b7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:12.523484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaacbee-a234-419f-a29f-f2af88d9b7e2 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:12.525567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 697/1394] 10.222.0.64 () {54 vars in 960 bytes} [Fri Jul 15 15:18:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:18:12.533452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6b374-0445-43e6-9d0c-1da0890f7201 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:12.533994 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6b374-0445-43e6-9d0c-1da0890f7201 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:12.534346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6b374-0445-43e6-9d0c-1da0890f7201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:12.628090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-78c6b374-0445-43e6-9d0c-1da0890f7201 None None] MFA Rules not processed for user `a87a4ae82b1b4619b90f9ad0f3dea5c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:12.629876 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-78c6b374-0445-43e6-9d0c-1da0890f7201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:12.676480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2feab-2df7-45cb-9e48-402e92e290e2 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:12.676750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2feab-2df7-45cb-9e48-402e92e290e2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:12.677032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2feab-2df7-45cb-9e48-402e92e290e2 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:12.678440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 698/1395] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:18:12.684006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a9a64-d4d9-436e-a3f0-183161eb10dc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:12.684301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a9a64-d4d9-436e-a3f0-183161eb10dc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:12.684628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a9a64-d4d9-436e-a3f0-183161eb10dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:12.703838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:12.715180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 698/1396] 10.222.0.64 () {58 vars in 1057 bytes} [Fri Jul 15 15:18:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:12.722776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6b374-0445-43e6-9d0c-1da0890f7201 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:12.730647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6b374-0445-43e6-9d0c-1da0890f7201 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:12.756418 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d58a9a64-d4d9-436e-a3f0-183161eb10dc None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:12.757603 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d58a9a64-d4d9-436e-a3f0-183161eb10dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:12.792778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:12.816475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366310bf-cbc6-4cfc-a37f-b8b25ae82258 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a4ae82b1b4619b90f9ad0f3dea5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:12.817669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366310bf-cbc6-4cfc-a37f-b8b25ae82258 service glance] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:12.817957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366310bf-cbc6-4cfc-a37f-b8b25ae82258 service glance] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:12.818498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366310bf-cbc6-4cfc-a37f-b8b25ae82258 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:12.819905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-366310bf-cbc6-4cfc-a37f-b8b25ae82258 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:12.873676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 699/1397] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:18:12.919243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a9a64-d4d9-436e-a3f0-183161eb10dc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:12.920445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d58a9a64-d4d9-436e-a3f0-183161eb10dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:12.944625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366310bf-cbc6-4cfc-a37f-b8b25ae82258 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:12.946125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366310bf-cbc6-4cfc-a37f-b8b25ae82258 service glance] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:12.977137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 699/1398] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:18:13.026207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:13.058441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a9a64-d4d9-436e-a3f0-183161eb10dc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:13.250724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca939c4-978a-47bb-afcb-b98818278140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:13.251524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca939c4-978a-47bb-afcb-b98818278140 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:13.252167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca939c4-978a-47bb-afcb-b98818278140 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:13.252543 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca939c4-978a-47bb-afcb-b98818278140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:13.255110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1ca939c4-978a-47bb-afcb-b98818278140 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:13.357697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca939c4-978a-47bb-afcb-b98818278140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:13.359261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca939c4-978a-47bb-afcb-b98818278140 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:13.364258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:13.382753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 700/1399] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:18:13.748518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1af72-492e-4196-8614-22cc73fd3d58 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:13.749098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1af72-492e-4196-8614-22cc73fd3d58 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:13.749243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1af72-492e-4196-8614-22cc73fd3d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:13.819607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0bb1af72-492e-4196-8614-22cc73fd3d58 None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:13.820852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0bb1af72-492e-4196-8614-22cc73fd3d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:13.861119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:13.920881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 700/1400] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:18:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:13.966969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c253a71-3947-464d-a1e4-59a6016b1378 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:13.967262 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c253a71-3947-464d-a1e4-59a6016b1378 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:13.967704 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c253a71-3947-464d-a1e4-59a6016b1378 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:13.969873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 701/1401] 10.222.0.64 () {54 vars in 942 bytes} [Fri Jul 15 15:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:18:13.980021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02757e-fb9a-46c3-bd02-5e640a35dc62 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:13.980320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02757e-fb9a-46c3-bd02-5e640a35dc62 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:13.980607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02757e-fb9a-46c3-bd02-5e640a35dc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:14.071183 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-bf02757e-fb9a-46c3-bd02-5e640a35dc62 None None] MFA Rules not processed for user `04f3a308ee69455287ac460d9ab2aef0`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:14.072971 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bf02757e-fb9a-46c3-bd02-5e640a35dc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:14.192463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 701/1402] 10.222.0.64 () {58 vars in 1039 bytes} [Fri Jul 15 15:18:13 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:18:14.202066 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c253a71-3947-464d-a1e4-59a6016b1378 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:14.203593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1c253a71-3947-464d-a1e4-59a6016b1378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:14.358272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c253a71-3947-464d-a1e4-59a6016b1378 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:14.438382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:14.474299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaf62f-bee7-4717-a9a8-b5151930851a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:14.474870 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaf62f-bee7-4717-a9a8-b5151930851a service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:14.475156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaf62f-bee7-4717-a9a8-b5151930851a service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:14.475432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaf62f-bee7-4717-a9a8-b5151930851a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:14.477146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eadaf62f-bee7-4717-a9a8-b5151930851a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:14.568868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaf62f-bee7-4717-a9a8-b5151930851a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:14.570597 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaf62f-bee7-4717-a9a8-b5151930851a service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:14.581709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 702/1403] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:18:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:18:15.507677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ff1d8-3df6-4c12-b9cf-22cb52ec17b8 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:15.508245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ff1d8-3df6-4c12-b9cf-22cb52ec17b8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:15.508245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ff1d8-3df6-4c12-b9cf-22cb52ec17b8 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:15.509656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 702/1404] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:15.515136 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f85304-0708-47b8-9499-86a3330edc5f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:15.515622 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f85304-0708-47b8-9499-86a3330edc5f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:15.515745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f85304-0708-47b8-9499-86a3330edc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:15.592828 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-95f85304-0708-47b8-9499-86a3330edc5f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:15.594193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-95f85304-0708-47b8-9499-86a3330edc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:15.665691 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:15.720584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 703/1405] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:15.767469 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ff1d8-3df6-4c12-b9cf-22cb52ec17b8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:15.768920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a60ff1d8-3df6-4c12-b9cf-22cb52ec17b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:15.777691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:15.935543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ff1d8-3df6-4c12-b9cf-22cb52ec17b8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:16.022257 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:16.063630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce49c38-8dd2-4f7e-8d16-3f6f1cef4180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:16.064289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce49c38-8dd2-4f7e-8d16-3f6f1cef4180 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:16.064579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce49c38-8dd2-4f7e-8d16-3f6f1cef4180 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:16.064860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce49c38-8dd2-4f7e-8d16-3f6f1cef4180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:16.066557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cce49c38-8dd2-4f7e-8d16-3f6f1cef4180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:16.175832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce49c38-8dd2-4f7e-8d16-3f6f1cef4180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:16.178139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce49c38-8dd2-4f7e-8d16-3f6f1cef4180 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:16.203074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 703/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:18.319215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e9b7d-c027-4bb6-95ab-a8d9d44619fb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:18.319807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e9b7d-c027-4bb6-95ab-a8d9d44619fb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:18.319807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e9b7d-c027-4bb6-95ab-a8d9d44619fb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:18.321137 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 704/1407] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:18.326583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9ec07-0397-43f0-a4de-4ef1e7ca5f45 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:18.327053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9ec07-0397-43f0-a4de-4ef1e7ca5f45 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:18.327147 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9ec07-0397-43f0-a4de-4ef1e7ca5f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:18.402762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1df9ec07-0397-43f0-a4de-4ef1e7ca5f45 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:18.404123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1df9ec07-0397-43f0-a4de-4ef1e7ca5f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:18.453767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:18.520430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 704/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:18.564996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e9b7d-c027-4bb6-95ab-a8d9d44619fb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:18.566555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-df1e9b7d-c027-4bb6-95ab-a8d9d44619fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:18.741565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e9b7d-c027-4bb6-95ab-a8d9d44619fb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:18.792987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:18.883239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822f4a9-5454-4707-b3ad-99a61bddbe86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:18.883239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822f4a9-5454-4707-b3ad-99a61bddbe86 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:18.883239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822f4a9-5454-4707-b3ad-99a61bddbe86 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:18.883239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822f4a9-5454-4707-b3ad-99a61bddbe86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:18.884158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9822f4a9-5454-4707-b3ad-99a61bddbe86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:18.986566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822f4a9-5454-4707-b3ad-99a61bddbe86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:18.988618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822f4a9-5454-4707-b3ad-99a61bddbe86 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:19.008928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 705/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:28.519935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=24 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:29.006642 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=78 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:36.867653 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd63d49-2b33-45ae-936d-111ae447f233 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:36.868232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd63d49-2b33-45ae-936d-111ae447f233 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:36.868232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd63d49-2b33-45ae-936d-111ae447f233 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:36.869529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 705/1410] 10.222.0.64 () {54 vars in 918 bytes} [Fri Jul 15 15:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:36.874719 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54343042-584e-4443-8b95-dc5329390cde None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:36.875183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54343042-584e-4443-8b95-dc5329390cde None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:36.875293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54343042-584e-4443-8b95-dc5329390cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:36.948936 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-54343042-584e-4443-8b95-dc5329390cde None None] MFA Rules not processed for user `3ba61318896f43e5a68e80f38ae5f3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:36.950204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-54343042-584e-4443-8b95-dc5329390cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:37.059911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 706/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Fri Jul 15 15:18:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:37.075190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25d023-7ce3-470d-9a11-7f51d1ee7a14 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:37.075442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25d023-7ce3-470d-9a11-7f51d1ee7a14 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:37.075751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25d023-7ce3-470d-9a11-7f51d1ee7a14 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:37.077236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 706/1412] 10.222.0.64 () {54 vars in 918 bytes} [Fri Jul 15 15:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:37.082347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb87f4-cb67-49b7-aa88-3ea176f2920d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:37.082656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb87f4-cb67-49b7-aa88-3ea176f2920d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:37.082940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb87f4-cb67-49b7-aa88-3ea176f2920d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:37.155412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:37.158251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-eacb87f4-cb67-49b7-aa88-3ea176f2920d None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:37.159518 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eacb87f4-cb67-49b7-aa88-3ea176f2920d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:37.273377 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 707/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Fri Jul 15 15:18:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:39.761116 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d9d16-8c3e-48d3-9673-92bb3e0a4902 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:39.761672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d9d16-8c3e-48d3-9673-92bb3e0a4902 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:39.761672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d9d16-8c3e-48d3-9673-92bb3e0a4902 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:39.763192 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:39.768838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b806b37-9b2c-4b27-af33-060a5a3cd007 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:39.769367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b806b37-9b2c-4b27-af33-060a5a3cd007 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:39.769467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b806b37-9b2c-4b27-af33-060a5a3cd007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:39.834831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0b806b37-9b2c-4b27-af33-060a5a3cd007 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:39.836097 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0b806b37-9b2c-4b27-af33-060a5a3cd007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:39.891534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:39.934186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:39.978624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d9d16-8c3e-48d3-9673-92bb3e0a4902 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:39.980253 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-612d9d16-8c3e-48d3-9673-92bb3e0a4902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:40.127449 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d9d16-8c3e-48d3-9673-92bb3e0a4902 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:40.198425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:40.240272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040d146-8223-43a8-85e2-60b53063d5a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:40.240926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040d146-8223-43a8-85e2-60b53063d5a5 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:40.241319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040d146-8223-43a8-85e2-60b53063d5a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:40.241604 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040d146-8223-43a8-85e2-60b53063d5a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:40.243269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e040d146-8223-43a8-85e2-60b53063d5a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:40.336789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040d146-8223-43a8-85e2-60b53063d5a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:40.338452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040d146-8223-43a8-85e2-60b53063d5a5 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:40.356981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 708/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:41.249892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa491e3c-9a7f-4d3d-b295-f4a93bda001d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:41.250649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa491e3c-9a7f-4d3d-b295-f4a93bda001d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:41.250649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa491e3c-9a7f-4d3d-b295-f4a93bda001d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:41.251805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:41.257680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def9b65-e022-4d8c-8e8a-5d1ede7accdb None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:41.258128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def9b65-e022-4d8c-8e8a-5d1ede7accdb None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:41.258236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def9b65-e022-4d8c-8e8a-5d1ede7accdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:41.332056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5def9b65-e022-4d8c-8e8a-5d1ede7accdb None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:41.333288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5def9b65-e022-4d8c-8e8a-5d1ede7accdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:41.359799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:41.429850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:41.578382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa491e3c-9a7f-4d3d-b295-f4a93bda001d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:41.579863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-aa491e3c-9a7f-4d3d-b295-f4a93bda001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:41.729631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa491e3c-9a7f-4d3d-b295-f4a93bda001d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:41.768530 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:41.842004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc627b-d4b2-400f-a0e7-fff835aec9c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:41.842661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc627b-d4b2-400f-a0e7-fff835aec9c3 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:41.842946 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc627b-d4b2-400f-a0e7-fff835aec9c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:41.843226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc627b-d4b2-400f-a0e7-fff835aec9c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:41.844867 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d1fc627b-d4b2-400f-a0e7-fff835aec9c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:41.935441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc627b-d4b2-400f-a0e7-fff835aec9c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:41.937049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc627b-d4b2-400f-a0e7-fff835aec9c3 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:41.955287 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 710/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:42.858333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443f446-ac0c-4f12-88fe-c020036b5679 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:42.858852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443f446-ac0c-4f12-88fe-c020036b5679 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:42.858852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443f446-ac0c-4f12-88fe-c020036b5679 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:42.860180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:42.865971 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1da7f-efbe-42c1-8619-528e412b6d7f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:42.866380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1da7f-efbe-42c1-8619-528e412b6d7f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:42.866540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1da7f-efbe-42c1-8619-528e412b6d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:42.920615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:42.943222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-25b1da7f-efbe-42c1-8619-528e412b6d7f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:42.944459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-25b1da7f-efbe-42c1-8619-528e412b6d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:43.040423 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:43.189594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443f446-ac0c-4f12-88fe-c020036b5679 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:43.191031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a443f446-ac0c-4f12-88fe-c020036b5679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:43.335770 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443f446-ac0c-4f12-88fe-c020036b5679 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:43.347545 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:43.447891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492b29a-6ba4-4ca5-8f00-679d21458786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:43.448461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492b29a-6ba4-4ca5-8f00-679d21458786 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:43.448747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492b29a-6ba4-4ca5-8f00-679d21458786 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:43.449027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492b29a-6ba4-4ca5-8f00-679d21458786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:43.450716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7492b29a-6ba4-4ca5-8f00-679d21458786 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:43.542727 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492b29a-6ba4-4ca5-8f00-679d21458786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:43.544349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492b29a-6ba4-4ca5-8f00-679d21458786 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:43.562321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 711/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:44.469188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9397226-ec39-49ca-8998-3006533a1d93 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:44.469769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9397226-ec39-49ca-8998-3006533a1d93 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:44.469769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9397226-ec39-49ca-8998-3006533a1d93 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:44.471126 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:44.476675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2de6b-3b14-4abe-aa0e-d53b0aae4923 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:44.477114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2de6b-3b14-4abe-aa0e-d53b0aae4923 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:44.477270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2de6b-3b14-4abe-aa0e-d53b0aae4923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:44.496306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:44.553564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2ad2de6b-3b14-4abe-aa0e-d53b0aae4923 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:44.554787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2ad2de6b-3b14-4abe-aa0e-d53b0aae4923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:44.654627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:44.803935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9397226-ec39-49ca-8998-3006533a1d93 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:44.805484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b9397226-ec39-49ca-8998-3006533a1d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:44.916457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:44.953794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9397226-ec39-49ca-8998-3006533a1d93 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:45.065095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b611349-dd39-4d20-900c-c03ec0b6b499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:45.065669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b611349-dd39-4d20-900c-c03ec0b6b499 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:45.065955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b611349-dd39-4d20-900c-c03ec0b6b499 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:45.066238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b611349-dd39-4d20-900c-c03ec0b6b499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:45.067889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0b611349-dd39-4d20-900c-c03ec0b6b499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:45.142653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:45.156571 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b611349-dd39-4d20-900c-c03ec0b6b499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:45.158236 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b611349-dd39-4d20-900c-c03ec0b6b499 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:45.176595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 713/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:46.045962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f51b0-94dd-40b3-b371-26772c064d77 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:46.046479 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f51b0-94dd-40b3-b371-26772c064d77 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:46.046479 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f51b0-94dd-40b3-b371-26772c064d77 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:46.047849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:46.052878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd51fa7-d8a7-4280-88d5-000b579233af None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:46.053362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd51fa7-d8a7-4280-88d5-000b579233af None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:46.053477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd51fa7-d8a7-4280-88d5-000b579233af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:46.129819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4dd51fa7-d8a7-4280-88d5-000b579233af None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:46.131054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4dd51fa7-d8a7-4280-88d5-000b579233af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:46.236094 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:46.398867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f51b0-94dd-40b3-b371-26772c064d77 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:46.400404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fa0f51b0-94dd-40b3-b371-26772c064d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:46.484631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:46.551191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f51b0-94dd-40b3-b371-26772c064d77 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:46.673221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3af8a-fa00-4d42-94d0-7e86cd3ab4f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:46.673871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3af8a-fa00-4d42-94d0-7e86cd3ab4f6 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:46.674152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3af8a-fa00-4d42-94d0-7e86cd3ab4f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:46.674423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3af8a-fa00-4d42-94d0-7e86cd3ab4f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:46.676070 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d4b3af8a-fa00-4d42-94d0-7e86cd3ab4f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:46.728640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:46.773329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3af8a-fa00-4d42-94d0-7e86cd3ab4f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:46.774958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3af8a-fa00-4d42-94d0-7e86cd3ab4f6 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:46.793356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 714/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:47.620547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b454b-1e5f-4f10-9f6b-7ec320d32abe None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:47.621193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b454b-1e5f-4f10-9f6b-7ec320d32abe None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:47.621193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b454b-1e5f-4f10-9f6b-7ec320d32abe None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:47.622577 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:47.627685 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d89d5-8d68-4624-9d38-3fcafa8134d6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:47.628124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d89d5-8d68-4624-9d38-3fcafa8134d6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:47.628226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d89d5-8d68-4624-9d38-3fcafa8134d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:47.702892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4b5d89d5-8d68-4624-9d38-3fcafa8134d6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:47.704105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4b5d89d5-8d68-4624-9d38-3fcafa8134d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:47.804588 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:47.954201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b454b-1e5f-4f10-9f6b-7ec320d32abe None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:47.955660 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2d6b454b-1e5f-4f10-9f6b-7ec320d32abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:48.007729 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:48.106538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b454b-1e5f-4f10-9f6b-7ec320d32abe None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:48.225165 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f60b4a-3b52-47f0-a4e4-16aa32e2dda5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:48.225762 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60b4a-3b52-47f0-a4e4-16aa32e2dda5 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:48.226048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60b4a-3b52-47f0-a4e4-16aa32e2dda5 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:48.226323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60b4a-3b52-47f0-a4e4-16aa32e2dda5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:48.228074 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c1f60b4a-3b52-47f0-a4e4-16aa32e2dda5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:48.236113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:48.321665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f60b4a-3b52-47f0-a4e4-16aa32e2dda5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:48.323324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f60b4a-3b52-47f0-a4e4-16aa32e2dda5 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:48.342268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 716/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:49.162783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c008d1-b2c7-4454-b4ff-ffab26b0a557 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:49.163336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c008d1-b2c7-4454-b4ff-ffab26b0a557 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:49.163336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c008d1-b2c7-4454-b4ff-ffab26b0a557 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:49.164638 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:49.169930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986b41-0789-4bc5-8735-bd95229b8b08 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:49.170396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986b41-0789-4bc5-8735-bd95229b8b08 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:49.170511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986b41-0789-4bc5-8735-bd95229b8b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:49.247490 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-83986b41-0789-4bc5-8735-bd95229b8b08 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:49.248732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-83986b41-0789-4bc5-8735-bd95229b8b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:49.316451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:49.345705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:49.494982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c008d1-b2c7-4454-b4ff-ffab26b0a557 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:49.496465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b0c008d1-b2c7-4454-b4ff-ffab26b0a557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:49.514701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:49.647446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c008d1-b2c7-4454-b4ff-ffab26b0a557 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:49.737750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:49.764451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b45919-d95c-4bd9-9086-2fbfebb69861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:49.765021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45919-d95c-4bd9-9086-2fbfebb69861 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:49.765331 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45919-d95c-4bd9-9086-2fbfebb69861 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:49.765607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45919-d95c-4bd9-9086-2fbfebb69861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:49.767246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e9b45919-d95c-4bd9-9086-2fbfebb69861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:49.855591 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b45919-d95c-4bd9-9086-2fbfebb69861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:49.857262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b45919-d95c-4bd9-9086-2fbfebb69861 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:49.875620 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 717/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:50.694950 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0d9ec-26be-41e4-825a-3cba49c22f2d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:50.695514 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0d9ec-26be-41e4-825a-3cba49c22f2d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:50.695514 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0d9ec-26be-41e4-825a-3cba49c22f2d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:50.696888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:50.701881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ea983-212e-44b1-a7c4-a86f73c10429 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:50.702319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ea983-212e-44b1-a7c4-a86f73c10429 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:50.702434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ea983-212e-44b1-a7c4-a86f73c10429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:50.776713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-be3ea983-212e-44b1-a7c4-a86f73c10429 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:50.777971 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-be3ea983-212e-44b1-a7c4-a86f73c10429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:50.820790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:50.879002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:51.032023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0d9ec-26be-41e4-825a-3cba49c22f2d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:51.033618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2fb0d9ec-26be-41e4-825a-3cba49c22f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:51.188801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0d9ec-26be-41e4-825a-3cba49c22f2d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:51.253538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:51.314974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d53ad-8698-46d3-a538-872e4598f179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:51.315631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d53ad-8698-46d3-a538-872e4598f179 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:51.315919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d53ad-8698-46d3-a538-872e4598f179 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:51.316199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d53ad-8698-46d3-a538-872e4598f179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:51.317898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7a5d53ad-8698-46d3-a538-872e4598f179 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:51.405928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d53ad-8698-46d3-a538-872e4598f179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:51.407572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d53ad-8698-46d3-a538-872e4598f179 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:51.426092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 719/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:52.245040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538d6d3-ae41-4211-b026-e165a9349452 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:52.245635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538d6d3-ae41-4211-b026-e165a9349452 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:52.245635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538d6d3-ae41-4211-b026-e165a9349452 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:52.246995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:52.252049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e37d16-7801-4c14-a7d1-1f8627208c6b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:52.252494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e37d16-7801-4c14-a7d1-1f8627208c6b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:52.252609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e37d16-7801-4c14-a7d1-1f8627208c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:52.333080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-07e37d16-7801-4c14-a7d1-1f8627208c6b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:52.334387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-07e37d16-7801-4c14-a7d1-1f8627208c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:52.336627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:52.432841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:18:52.586209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538d6d3-ae41-4211-b026-e165a9349452 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:52.587717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a538d6d3-ae41-4211-b026-e165a9349452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:52.730370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538d6d3-ae41-4211-b026-e165a9349452 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:52.757709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:52.842957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46adeac-b878-433e-8c18-45d3dad21b95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:52.843609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46adeac-b878-433e-8c18-45d3dad21b95 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:52.843896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46adeac-b878-433e-8c18-45d3dad21b95 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:52.844177 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46adeac-b878-433e-8c18-45d3dad21b95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:52.845885 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d46adeac-b878-433e-8c18-45d3dad21b95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:52.934637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46adeac-b878-433e-8c18-45d3dad21b95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:52.936258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46adeac-b878-433e-8c18-45d3dad21b95 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:52.954588 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 720/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:54.881716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad976-4335-471a-ad26-09bdfd0c9349 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:54.882265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad976-4335-471a-ad26-09bdfd0c9349 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:54.882265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad976-4335-471a-ad26-09bdfd0c9349 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:54.883542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:54.889114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768ed8-89ea-40c4-b460-c868e0545a22 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:54.889572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768ed8-89ea-40c4-b460-c868e0545a22 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:54.889692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768ed8-89ea-40c4-b460-c868e0545a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:54.931762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:54.958001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6a768ed8-89ea-40c4-b460-c868e0545a22 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:54.959794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6a768ed8-89ea-40c4-b460-c868e0545a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:55.060857 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:55.101990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad976-4335-471a-ad26-09bdfd0c9349 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:55.103539 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-44cad976-4335-471a-ad26-09bdfd0c9349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:55.217211 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad976-4335-471a-ad26-09bdfd0c9349 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:55.250092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:55.294122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46a3f0-0834-4756-820f-9d7bec9a4044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:55.294789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46a3f0-0834-4756-820f-9d7bec9a4044 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:55.295177 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46a3f0-0834-4756-820f-9d7bec9a4044 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:55.295461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46a3f0-0834-4756-820f-9d7bec9a4044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:55.297161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eb46a3f0-0834-4756-820f-9d7bec9a4044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:55.418742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46a3f0-0834-4756-820f-9d7bec9a4044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:55.420209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46a3f0-0834-4756-820f-9d7bec9a4044 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:55.439176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 722/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:18:57.638022 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b4b6-3987-4a6a-9815-8b222b97ca0e None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:57.638584 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b4b6-3987-4a6a-9815-8b222b97ca0e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:57.638584 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b4b6-3987-4a6a-9815-8b222b97ca0e None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:57.639987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:18:57.645677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f2382-f78f-4232-ab58-996e240b33ce None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:57.646134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f2382-f78f-4232-ab58-996e240b33ce None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:57.646228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f2382-f78f-4232-ab58-996e240b33ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:57.712865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-409f2382-f78f-4232-ab58-996e240b33ce None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:18:57.714105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-409f2382-f78f-4232-ab58-996e240b33ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:57.727434 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:57.813470 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:18:57.852426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b4b6-3987-4a6a-9815-8b222b97ca0e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:18:57.853937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cda9b4b6-3987-4a6a-9815-8b222b97ca0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:57.963648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b4b6-3987-4a6a-9815-8b222b97ca0e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:18:57.982342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:58.056922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a93ea4-7bdb-44d6-99ad-393da09e5924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:18:58.057618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a93ea4-7bdb-44d6-99ad-393da09e5924 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:18:58.057906 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a93ea4-7bdb-44d6-99ad-393da09e5924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:18:58.058190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a93ea4-7bdb-44d6-99ad-393da09e5924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:18:58.059887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-09a93ea4-7bdb-44d6-99ad-393da09e5924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:18:58.175997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a93ea4-7bdb-44d6-99ad-393da09e5924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:18:58.177403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a93ea4-7bdb-44d6-99ad-393da09e5924 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:18:58.196719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 723/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:00.600924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52401a81-72e4-4670-9815-8c2630d48931 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:00.600924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52401a81-72e4-4670-9815-8c2630d48931 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:00.601456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52401a81-72e4-4670-9815-8c2630d48931 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:00.603695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:00.609878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab81a58-d77a-47d8-8949-c7bccb6b2619 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:00.610367 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab81a58-d77a-47d8-8949-c7bccb6b2619 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:00.610508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab81a58-d77a-47d8-8949-c7bccb6b2619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:00.658468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:00.677860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-cab81a58-d77a-47d8-8949-c7bccb6b2619 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:00.679132 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cab81a58-d77a-47d8-8949-c7bccb6b2619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:00.779754 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:00.818933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52401a81-72e4-4670-9815-8c2630d48931 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:00.821903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-52401a81-72e4-4670-9815-8c2630d48931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:00.930866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52401a81-72e4-4670-9815-8c2630d48931 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:00.972151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:01.009131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20623ab1-2b61-48e5-b8dd-43204ad53f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:01.009796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623ab1-2b61-48e5-b8dd-43204ad53f30 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:01.010086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623ab1-2b61-48e5-b8dd-43204ad53f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:01.010371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623ab1-2b61-48e5-b8dd-43204ad53f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:01.012081 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-20623ab1-2b61-48e5-b8dd-43204ad53f30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:01.128734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20623ab1-2b61-48e5-b8dd-43204ad53f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:01.130483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20623ab1-2b61-48e5-b8dd-43204ad53f30 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:01.151528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 725/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:03.341392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374b71c-f6fe-4859-9dd9-d0431ebc2fdc None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:03.341969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374b71c-f6fe-4859-9dd9-d0431ebc2fdc None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:03.341969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374b71c-f6fe-4859-9dd9-d0431ebc2fdc None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:03.343350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:03.348864 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62279a0a-62a7-47d9-a920-8385b3a3be44 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:03.349308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62279a0a-62a7-47d9-a920-8385b3a3be44 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:03.349463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62279a0a-62a7-47d9-a920-8385b3a3be44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:03.413588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-62279a0a-62a7-47d9-a920-8385b3a3be44 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:03.414821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-62279a0a-62a7-47d9-a920-8385b3a3be44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:03.435875 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:03.510556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:03.548432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374b71c-f6fe-4859-9dd9-d0431ebc2fdc None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:03.550035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f374b71c-f6fe-4859-9dd9-d0431ebc2fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:03.655676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374b71c-f6fe-4859-9dd9-d0431ebc2fdc None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:03.675615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:03.729280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bbb1f-a85a-43da-be45-abe6333bbc68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:03.729940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bbb1f-a85a-43da-be45-abe6333bbc68 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:03.730226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bbb1f-a85a-43da-be45-abe6333bbc68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:03.730504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bbb1f-a85a-43da-be45-abe6333bbc68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:03.732154 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-339bbb1f-a85a-43da-be45-abe6333bbc68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:03.840439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bbb1f-a85a-43da-be45-abe6333bbc68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:03.841983 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bbb1f-a85a-43da-be45-abe6333bbc68 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:03.860440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 726/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:05.954757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933967e-99f5-4bd8-a2cc-9a5bb483ec97 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:05.955268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933967e-99f5-4bd8-a2cc-9a5bb483ec97 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:05.955268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933967e-99f5-4bd8-a2cc-9a5bb483ec97 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:05.956663 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:05.962463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaded0-f093-4968-badd-d7db48892974 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:05.962984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaded0-f093-4968-badd-d7db48892974 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:05.963111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaded0-f093-4968-badd-d7db48892974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:06.029080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:06.032032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-edaaded0-f093-4968-badd-d7db48892974 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:06.033896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-edaaded0-f093-4968-badd-d7db48892974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:06.149219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:06.189892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933967e-99f5-4bd8-a2cc-9a5bb483ec97 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:06.191492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a933967e-99f5-4bd8-a2cc-9a5bb483ec97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:06.305873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933967e-99f5-4bd8-a2cc-9a5bb483ec97 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:06.356400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:06.383025 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b93fe-5871-4aa7-ad3a-86d87a7a64a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:06.383688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b93fe-5871-4aa7-ad3a-86d87a7a64a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:06.383977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b93fe-5871-4aa7-ad3a-86d87a7a64a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:06.384254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b93fe-5871-4aa7-ad3a-86d87a7a64a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:06.386321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d60b93fe-5871-4aa7-ad3a-86d87a7a64a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:06.503848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b93fe-5871-4aa7-ad3a-86d87a7a64a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:06.505873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b93fe-5871-4aa7-ad3a-86d87a7a64a3 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:06.524544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 728/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:08.603145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d087d-c130-45f1-a7db-9479d071b4ea None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:08.603607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d087d-c130-45f1-a7db-9479d071b4ea None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:08.603733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d087d-c130-45f1-a7db-9479d071b4ea None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:08.605109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:08.610808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52246a-78fe-4cab-aefa-44bd3f55f81d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:08.611234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52246a-78fe-4cab-aefa-44bd3f55f81d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:08.611401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52246a-78fe-4cab-aefa-44bd3f55f81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:08.679611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-eb52246a-78fe-4cab-aefa-44bd3f55f81d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:08.680837 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eb52246a-78fe-4cab-aefa-44bd3f55f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:08.709534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:08.777684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:08.815049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d087d-c130-45f1-a7db-9479d071b4ea None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:08.816623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f06d087d-c130-45f1-a7db-9479d071b4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:08.921168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d087d-c130-45f1-a7db-9479d071b4ea None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:08.950739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:08.996522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d19446-47a2-43b0-99cc-77749013c863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:08.997207 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d19446-47a2-43b0-99cc-77749013c863 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:08.997495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d19446-47a2-43b0-99cc-77749013c863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:08.997773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d19446-47a2-43b0-99cc-77749013c863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:08.999438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-01d19446-47a2-43b0-99cc-77749013c863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:09.112912 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d19446-47a2-43b0-99cc-77749013c863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:09.114398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d19446-47a2-43b0-99cc-77749013c863 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:09.133317 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 729/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:11.248560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a03ec-e364-4244-9f88-bffc50d51a56 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:11.249196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a03ec-e364-4244-9f88-bffc50d51a56 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:11.249196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a03ec-e364-4244-9f88-bffc50d51a56 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:11.250535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:11.256169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d0688-f835-4936-8894-c98fbc5549bb None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:11.256606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d0688-f835-4936-8894-c98fbc5549bb None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:11.256738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d0688-f835-4936-8894-c98fbc5549bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:11.325009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-964d0688-f835-4936-8894-c98fbc5549bb None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:11.326270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-964d0688-f835-4936-8894-c98fbc5549bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:11.334511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:11.422764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:11.461018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a03ec-e364-4244-9f88-bffc50d51a56 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:11.462606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fa6a03ec-e364-4244-9f88-bffc50d51a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:11.566927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a03ec-e364-4244-9f88-bffc50d51a56 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:11.628495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:11.649452 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6cb3d-c9cb-48b0-8821-dc7931754a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:11.650110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6cb3d-c9cb-48b0-8821-dc7931754a89 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:11.650396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6cb3d-c9cb-48b0-8821-dc7931754a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:11.650672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6cb3d-c9cb-48b0-8821-dc7931754a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:11.652645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d1c6cb3d-c9cb-48b0-8821-dc7931754a89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:11.763195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6cb3d-c9cb-48b0-8821-dc7931754a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:11.764658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6cb3d-c9cb-48b0-8821-dc7931754a89 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:11.782766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 731/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:14.115124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc2e40-09b0-47df-afd5-833457700205 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:14.115673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc2e40-09b0-47df-afd5-833457700205 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:14.115673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc2e40-09b0-47df-afd5-833457700205 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:14.117710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:14.123408 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fb2f3-3c4c-42ef-ac66-e00d1644738c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:14.123832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fb2f3-3c4c-42ef-ac66-e00d1644738c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:14.123963 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fb2f3-3c4c-42ef-ac66-e00d1644738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:14.191461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-db8fb2f3-3c4c-42ef-ac66-e00d1644738c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:14.192697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-db8fb2f3-3c4c-42ef-ac66-e00d1644738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:14.235290 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:14.298193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:14.335683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc2e40-09b0-47df-afd5-833457700205 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:14.337260 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d9dc2e40-09b0-47df-afd5-833457700205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:14.441882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc2e40-09b0-47df-afd5-833457700205 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:14.478875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:14.516738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6655e05-e77c-49ff-a8bd-275022f97bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:14.517475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6655e05-e77c-49ff-a8bd-275022f97bfb service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:14.517762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6655e05-e77c-49ff-a8bd-275022f97bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:14.518134 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6655e05-e77c-49ff-a8bd-275022f97bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:14.519935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d6655e05-e77c-49ff-a8bd-275022f97bfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:14.647452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6655e05-e77c-49ff-a8bd-275022f97bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:14.649605 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6655e05-e77c-49ff-a8bd-275022f97bfb service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:14.668152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 732/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:16.782957 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb962b3f-cc25-47d6-9c42-7466d5318ffd None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:16.783494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb962b3f-cc25-47d6-9c42-7466d5318ffd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:16.783494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb962b3f-cc25-47d6-9c42-7466d5318ffd None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:16.784794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:16.790703 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3f106-9b5d-4cd0-a09f-d9b609124a4a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:16.791170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3f106-9b5d-4cd0-a09f-d9b609124a4a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:16.791287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3f106-9b5d-4cd0-a09f-d9b609124a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:16.855245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-37e3f106-9b5d-4cd0-a09f-d9b609124a4a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:16.856820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-37e3f106-9b5d-4cd0-a09f-d9b609124a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:16.876311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:16.954536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:16.992358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb962b3f-cc25-47d6-9c42-7466d5318ffd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:16.993947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eb962b3f-cc25-47d6-9c42-7466d5318ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:17.100128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb962b3f-cc25-47d6-9c42-7466d5318ffd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:17.167450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:17.174754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4ab76-5c86-4611-a5bc-8e2d4f48bbd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:17.175412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4ab76-5c86-4611-a5bc-8e2d4f48bbd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:17.175701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4ab76-5c86-4611-a5bc-8e2d4f48bbd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:17.175989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4ab76-5c86-4611-a5bc-8e2d4f48bbd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:17.177672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-65b4ab76-5c86-4611-a5bc-8e2d4f48bbd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:17.285045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4ab76-5c86-4611-a5bc-8e2d4f48bbd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:17.286519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4ab76-5c86-4611-a5bc-8e2d4f48bbd6 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:17.304986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 734/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:19.369360 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3871328-53d5-4923-81fb-8da75803cb1d None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:19.369955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3871328-53d5-4923-81fb-8da75803cb1d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:19.369955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3871328-53d5-4923-81fb-8da75803cb1d None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:19.371300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:19.376624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469831e2-6186-4456-b359-98c551c1ed2c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:19.377025 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469831e2-6186-4456-b359-98c551c1ed2c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:19.377234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469831e2-6186-4456-b359-98c551c1ed2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:19.448993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-469831e2-6186-4456-b359-98c551c1ed2c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:19.450268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-469831e2-6186-4456-b359-98c551c1ed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:19.497541 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:19.547845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:19.585663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3871328-53d5-4923-81fb-8da75803cb1d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:19.587213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b3871328-53d5-4923-81fb-8da75803cb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:19.693900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3871328-53d5-4923-81fb-8da75803cb1d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:19.746793 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:19.774953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6152173-9a5d-4d01-a6cf-cafb599ded3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:19.775623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6152173-9a5d-4d01-a6cf-cafb599ded3f service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:19.775918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6152173-9a5d-4d01-a6cf-cafb599ded3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:19.776199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6152173-9a5d-4d01-a6cf-cafb599ded3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:19.777936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d6152173-9a5d-4d01-a6cf-cafb599ded3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:19.889162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6152173-9a5d-4d01-a6cf-cafb599ded3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:19.890628 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6152173-9a5d-4d01-a6cf-cafb599ded3f service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:19.910880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 735/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:29.546062 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=22 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:29.908098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=66 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:40.825374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8655fd-ca7c-4c02-a51d-f7b2ee19faf0 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:40.825374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8655fd-ca7c-4c02-a51d-f7b2ee19faf0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:40.826403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8655fd-ca7c-4c02-a51d-f7b2ee19faf0 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:40.827321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 736/1471] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:40.832512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd7621-f292-4548-b6d5-09b2481b8c0e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:40.832943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd7621-f292-4548-b6d5-09b2481b8c0e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:40.833103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd7621-f292-4548-b6d5-09b2481b8c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:40.899385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-61bd7621-f292-4548-b6d5-09b2481b8c0e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:40.900536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-61bd7621-f292-4548-b6d5-09b2481b8c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:40.996929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 736/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:41.048164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaacd8b-e8d1-4ca8-a150-2581c3db2ae0 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:41.048458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaacd8b-e8d1-4ca8-a150-2581c3db2ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:41.048738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaacd8b-e8d1-4ca8-a150-2581c3db2ae0 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:41.050133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 737/1473] 10.222.0.64 () {54 vars in 960 bytes} [Fri Jul 15 15:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:41.055089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa61cf-ba23-4ac5-be87-eda87f50a6b3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:41.055386 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa61cf-ba23-4ac5-be87-eda87f50a6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:41.055675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa61cf-ba23-4ac5-be87-eda87f50a6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:41.128821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-46fa61cf-ba23-4ac5-be87-eda87f50a6b3 None None] MFA Rules not processed for user `a87a4ae82b1b4619b90f9ad0f3dea5c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:41.130083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-46fa61cf-ba23-4ac5-be87-eda87f50a6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:41.150965 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:41.208097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 737/1474] 10.222.0.64 () {58 vars in 1057 bytes} [Fri Jul 15 15:19:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:41.216161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaacd8b-e8d1-4ca8-a150-2581c3db2ae0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:41.217784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-deaacd8b-e8d1-4ca8-a150-2581c3db2ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:41.317007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaacd8b-e8d1-4ca8-a150-2581c3db2ae0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:41.390451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec70f9-4494-4d07-8818-42a5507e4237 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a4ae82b1b4619b90f9ad0f3dea5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:41.391104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec70f9-4494-4d07-8818-42a5507e4237 service glance] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:41.391390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec70f9-4494-4d07-8818-42a5507e4237 service glance] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:41.391671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec70f9-4494-4d07-8818-42a5507e4237 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:41.393342 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d3ec70f9-4494-4d07-8818-42a5507e4237 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:41.447328 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:41.501139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec70f9-4494-4d07-8818-42a5507e4237 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:41.502599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec70f9-4494-4d07-8818-42a5507e4237 service glance] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:41.521544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 738/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:19:43.657025 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8185c-7eb3-47cb-aff9-6b99b21b2360 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:43.657596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8185c-7eb3-47cb-aff9-6b99b21b2360 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:43.657596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8185c-7eb3-47cb-aff9-6b99b21b2360 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:43.658996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 738/1476] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:43.664392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7225-8a47-47b4-a7a8-a91fd5a10b0b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:43.664846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7225-8a47-47b4-a7a8-a91fd5a10b0b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:43.664955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7225-8a47-47b4-a7a8-a91fd5a10b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:43.729410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-68dd7225-8a47-47b4-a7a8-a91fd5a10b0b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:43.730608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-68dd7225-8a47-47b4-a7a8-a91fd5a10b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:43.827531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 739/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:43.850839 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8185c-7eb3-47cb-aff9-6b99b21b2360 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:43.853231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d1e8185c-7eb3-47cb-aff9-6b99b21b2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:43.978375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8185c-7eb3-47cb-aff9-6b99b21b2360 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:44.027656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:44.073961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161fd34-3b5a-4fa2-866e-576881fdf0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:44.074869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161fd34-3b5a-4fa2-866e-576881fdf0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:44.075138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161fd34-3b5a-4fa2-866e-576881fdf0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:44.075418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161fd34-3b5a-4fa2-866e-576881fdf0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:44.076160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161fd34-3b5a-4fa2-866e-576881fdf0a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:44.077971 dv-cinder-850015-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-4161fd34-3b5a-4fa2-866e-576881fdf0a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:19:44.077971 dv-cinder-850015-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 15 15:19:44.077971 dv-cinder-850015-1-smb devstack@keystone.service[80236]: Jul 15 15:19:44.079143 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161fd34-3b5a-4fa2-866e-576881fdf0a4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:44.103170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 739/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Jul 15 15:19:43 2022] GET /identity/v3/projects => generated 2553 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:19:46.187118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2628b-4d55-4799-b015-c0b9fede7b54 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:46.187718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2628b-4d55-4799-b015-c0b9fede7b54 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:46.187718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2628b-4d55-4799-b015-c0b9fede7b54 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:46.189044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 740/1479] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:46.194635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9871d8-28c3-4644-9092-3b44483ae3d6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:46.195096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9871d8-28c3-4644-9092-3b44483ae3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:46.195227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9871d8-28c3-4644-9092-3b44483ae3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:46.265515 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9d9871d8-28c3-4644-9092-3b44483ae3d6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:46.266754 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9d9871d8-28c3-4644-9092-3b44483ae3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:46.389616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 740/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:46.445031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2628b-4d55-4799-b015-c0b9fede7b54 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:46.448648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-80d2628b-4d55-4799-b015-c0b9fede7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:46.461660 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:46.612023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2628b-4d55-4799-b015-c0b9fede7b54 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:46.702211 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:46.742002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55468cf4-98cc-4104-9f4a-3d14bcddeb95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:46.742658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55468cf4-98cc-4104-9f4a-3d14bcddeb95 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:46.742945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55468cf4-98cc-4104-9f4a-3d14bcddeb95 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:46.743224 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55468cf4-98cc-4104-9f4a-3d14bcddeb95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:46.744962 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-55468cf4-98cc-4104-9f4a-3d14bcddeb95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:46.845981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55468cf4-98cc-4104-9f4a-3d14bcddeb95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:46.847826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55468cf4-98cc-4104-9f4a-3d14bcddeb95 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:46.870048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 741/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:49.106339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56061175-9590-49ab-a416-1d30d5cf251b None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:49.106911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56061175-9590-49ab-a416-1d30d5cf251b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:49.106911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56061175-9590-49ab-a416-1d30d5cf251b None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:49.108234 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 741/1482] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:49.113521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9ccd3-91f6-485a-99b2-e7a91249f122 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:49.113927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9ccd3-91f6-485a-99b2-e7a91249f122 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:49.114085 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9ccd3-91f6-485a-99b2-e7a91249f122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:49.181620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9fe9ccd3-91f6-485a-99b2-e7a91249f122 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:49.182702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9fe9ccd3-91f6-485a-99b2-e7a91249f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:49.232371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:49.282560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 742/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:49.319696 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56061175-9590-49ab-a416-1d30d5cf251b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:49.322589 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-56061175-9590-49ab-a416-1d30d5cf251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:49.347755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:49.429018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56061175-9590-49ab-a416-1d30d5cf251b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:49.506203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367e1b0-f892-43e9-ae8b-a4643bb60b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:49.506865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e1b0-f892-43e9-ae8b-a4643bb60b8b service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:49.507155 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e1b0-f892-43e9-ae8b-a4643bb60b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:49.507436 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e1b0-f892-43e9-ae8b-a4643bb60b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:49.509434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0367e1b0-f892-43e9-ae8b-a4643bb60b8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:49.585032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:49.622819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367e1b0-f892-43e9-ae8b-a4643bb60b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:49.624329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367e1b0-f892-43e9-ae8b-a4643bb60b8b service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:49.644782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 742/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:51.715035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966797eb-fbea-4511-8e78-fab4dde90e40 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:51.715596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966797eb-fbea-4511-8e78-fab4dde90e40 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:51.715596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966797eb-fbea-4511-8e78-fab4dde90e40 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:51.716952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 743/1485] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:51.722202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabdfa9-45c8-4204-971b-a628a0b3c03b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:51.722607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabdfa9-45c8-4204-971b-a628a0b3c03b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:51.722796 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabdfa9-45c8-4204-971b-a628a0b3c03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:51.787417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5eabdfa9-45c8-4204-971b-a628a0b3c03b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:51.788636 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5eabdfa9-45c8-4204-971b-a628a0b3c03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:51.888097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 743/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:51.926038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966797eb-fbea-4511-8e78-fab4dde90e40 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:51.927657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-966797eb-fbea-4511-8e78-fab4dde90e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:52.032997 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966797eb-fbea-4511-8e78-fab4dde90e40 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:52.107222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:52.109259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ab733-9a82-4cff-bb39-7b77107797e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:52.109918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ab733-9a82-4cff-bb39-7b77107797e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:52.110398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ab733-9a82-4cff-bb39-7b77107797e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:52.110896 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ab733-9a82-4cff-bb39-7b77107797e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:52.112872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e25ab733-9a82-4cff-bb39-7b77107797e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:52.220052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ab733-9a82-4cff-bb39-7b77107797e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:52.221547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ab733-9a82-4cff-bb39-7b77107797e6 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:52.239659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 744/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:54.427825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60c03-b563-4c56-ae70-9a47ba5af29f None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:54.428409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60c03-b563-4c56-ae70-9a47ba5af29f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:54.428409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60c03-b563-4c56-ae70-9a47ba5af29f None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:54.430316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 744/1488] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:54.435641 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689768-66cd-4e42-a50a-bb9ba3a3067d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:54.436083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689768-66cd-4e42-a50a-bb9ba3a3067d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:54.436200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689768-66cd-4e42-a50a-bb9ba3a3067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:54.499382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-01689768-66cd-4e42-a50a-bb9ba3a3067d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:54.500585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-01689768-66cd-4e42-a50a-bb9ba3a3067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:54.553541 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:54.598465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 745/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:54.638633 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e60c03-b563-4c56-ae70-9a47ba5af29f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:54.640309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c4e60c03-b563-4c56-ae70-9a47ba5af29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:54.676106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:54.758517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e60c03-b563-4c56-ae70-9a47ba5af29f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:54.834559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b2bd0-6fcf-44e3-8a53-e800f51533ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:54.835215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b2bd0-6fcf-44e3-8a53-e800f51533ac service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:54.835506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b2bd0-6fcf-44e3-8a53-e800f51533ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:54.835788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b2bd0-6fcf-44e3-8a53-e800f51533ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:54.838064 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9b2b2bd0-6fcf-44e3-8a53-e800f51533ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:54.917482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:54.948227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b2bd0-6fcf-44e3-8a53-e800f51533ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:54.949737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b2bd0-6fcf-44e3-8a53-e800f51533ac service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:54.969885 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 745/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:57.221489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4468aa0-9b73-4c8f-9a7f-97b83fda3612 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:57.222066 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4468aa0-9b73-4c8f-9a7f-97b83fda3612 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:57.222066 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4468aa0-9b73-4c8f-9a7f-97b83fda3612 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:57.223405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 746/1491] 10.222.0.64 () {54 vars in 926 bytes} [Fri Jul 15 15:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:19:57.229482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599503ca-add8-4009-a68d-e7e500522f7e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:57.229894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599503ca-add8-4009-a68d-e7e500522f7e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:57.230058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599503ca-add8-4009-a68d-e7e500522f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:57.293894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-599503ca-add8-4009-a68d-e7e500522f7e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:19:57.295108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-599503ca-add8-4009-a68d-e7e500522f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:57.391897 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 746/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Fri Jul 15 15:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:19:57.431757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4468aa0-9b73-4c8f-9a7f-97b83fda3612 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:19:57.433386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c4468aa0-9b73-4c8f-9a7f-97b83fda3612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:57.538713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4468aa0-9b73-4c8f-9a7f-97b83fda3612 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:19:57.615404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e793cf-1b0a-4a9f-b2f4-e9b5b05993dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:19:57.616064 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e793cf-1b0a-4a9f-b2f4-e9b5b05993dc service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:19:57.616355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e793cf-1b0a-4a9f-b2f4-e9b5b05993dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:19:57.616640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e793cf-1b0a-4a9f-b2f4-e9b5b05993dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:19:57.618330 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-19e793cf-1b0a-4a9f-b2f4-e9b5b05993dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:19:57.628853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:57.736989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e793cf-1b0a-4a9f-b2f4-e9b5b05993dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:19:57.738478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e793cf-1b0a-4a9f-b2f4-e9b5b05993dc service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:19:57.756531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 747/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:20:07.390040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=82 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:20:07.753913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=50 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:21:27.889632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9be24-8206-4b9f-b9f3-632a55c8d65c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:27.890219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9be24-8206-4b9f-b9f3-632a55c8d65c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:27.890219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9be24-8206-4b9f-b9f3-632a55c8d65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:27.984394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-35b9be24-8206-4b9f-b9f3-632a55c8d65c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:21:27.985719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-35b9be24-8206-4b9f-b9f3-632a55c8d65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:28.090890 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 747/1494] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:21:28.099317 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ca448-ddb5-4808-8b53-18cf44b013e1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:28.099849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ca448-ddb5-4808-8b53-18cf44b013e1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:28.099960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ca448-ddb5-4808-8b53-18cf44b013e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:28.184022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-282ca448-ddb5-4808-8b53-18cf44b013e1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:21:28.185524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-282ca448-ddb5-4808-8b53-18cf44b013e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:28.301989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 748/1495] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:21:28.307439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9be24-8206-4b9f-b9f3-632a55c8d65c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:21:28.308749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-35b9be24-8206-4b9f-b9f3-632a55c8d65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:28.320882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9be24-8206-4b9f-b9f3-632a55c8d65c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:21:28.392191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:21:28.428497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4252c58-0184-4aef-a054-74e84421e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:21:28.429210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4252c58-0184-4aef-a054-74e84421e3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:28.429501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4252c58-0184-4aef-a054-74e84421e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:28.429782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4252c58-0184-4aef-a054-74e84421e3f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:28.430513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4252c58-0184-4aef-a054-74e84421e3f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:21:28.430939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4252c58-0184-4aef-a054-74e84421e3f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:21:28.431978 dv-cinder-850015-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-c4252c58-0184-4aef-a054-74e84421e3f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:21:28.431978 dv-cinder-850015-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 15 15:21:28.431978 dv-cinder-850015-1-smb devstack@keystone.service[80236]: Jul 15 15:21:28.432915 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4252c58-0184-4aef-a054-74e84421e3f8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:21:28.444755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 748/1496] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:21:28.453029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ca448-ddb5-4808-8b53-18cf44b013e1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:21:28.463057 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ca448-ddb5-4808-8b53-18cf44b013e1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:21:28.525235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:21:28.559398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5053b-d004-4903-8cab-00617a940439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:21:28.560060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5053b-d004-4903-8cab-00617a940439 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:28.560344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5053b-d004-4903-8cab-00617a940439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:28.560621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5053b-d004-4903-8cab-00617a940439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:28.561373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5053b-d004-4903-8cab-00617a940439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:21:28.563161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-8ef5053b-d004-4903-8cab-00617a940439 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:21:28.563161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 15 15:21:28.563161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: Jul 15 15:21:28.564377 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5053b-d004-4903-8cab-00617a940439 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:21:28.622228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 749/1497] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:21:28 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:21:28.626539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4252c58-0184-4aef-a054-74e84421e3f8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:21:28.628057 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c4252c58-0184-4aef-a054-74e84421e3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:28.662151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4252c58-0184-4aef-a054-74e84421e3f8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:21:28.755213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b875ab-dc6b-432b-a665-30f0cfe3ab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:21:28.755801 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b875ab-dc6b-432b-a665-30f0cfe3ab42 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:28.756082 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b875ab-dc6b-432b-a665-30f0cfe3ab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:28.756358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b875ab-dc6b-432b-a665-30f0cfe3ab42 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:28.757053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b875ab-dc6b-432b-a665-30f0cfe3ab42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:21:28.758103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-04b875ab-dc6b-432b-a665-30f0cfe3ab42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:21:28.758103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 15 15:21:28.758103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: Jul 15 15:21:28.759842 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b875ab-dc6b-432b-a665-30f0cfe3ab42 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:21:28.801979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 749/1498] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:21:28 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:21:28.806207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5053b-d004-4903-8cab-00617a940439 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:21:28.807761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8ef5053b-d004-4903-8cab-00617a940439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:28.873320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5053b-d004-4903-8cab-00617a940439 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:21:28.958025 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:21:28.970341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52cb4d-49fe-4969-a9f9-64376e85f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:21:28.971013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52cb4d-49fe-4969-a9f9-64376e85f3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:28.971311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52cb4d-49fe-4969-a9f9-64376e85f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:28.971561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52cb4d-49fe-4969-a9f9-64376e85f3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:28.972294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52cb4d-49fe-4969-a9f9-64376e85f3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:21:28.973350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-bb52cb4d-49fe-4969-a9f9-64376e85f3c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:21:28.973350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 15 15:21:28.973350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: Jul 15 15:21:28.974265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52cb4d-49fe-4969-a9f9-64376e85f3c2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:21:28.987027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 750/1499] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:21:28.991392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b875ab-dc6b-432b-a665-30f0cfe3ab42 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:21:28.992916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-04b875ab-dc6b-432b-a665-30f0cfe3ab42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:29.004366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b875ab-dc6b-432b-a665-30f0cfe3ab42 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:21:29.030743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:21:29.221451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7333aa-4cd6-4269-a007-3915f0f00b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:21:29.222133 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7333aa-4cd6-4269-a007-3915f0f00b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:29.222417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7333aa-4cd6-4269-a007-3915f0f00b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:29.222699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7333aa-4cd6-4269-a007-3915f0f00b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:29.223442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7333aa-4cd6-4269-a007-3915f0f00b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:21:29.224533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-3e7333aa-4cd6-4269-a007-3915f0f00b3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:21:29.224533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 15 15:21:29.224533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: Jul 15 15:21:29.225487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7333aa-4cd6-4269-a007-3915f0f00b3d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:21:29.238074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 750/1500] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:21:29.242313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52cb4d-49fe-4969-a9f9-64376e85f3c2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:21:29.244364 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bb52cb4d-49fe-4969-a9f9-64376e85f3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:29.279268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52cb4d-49fe-4969-a9f9-64376e85f3c2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:21:29.378142 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d4aac-33f9-4731-a753-cd53d5806b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:21:29.379110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d4aac-33f9-4731-a753-cd53d5806b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:29.379338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d4aac-33f9-4731-a753-cd53d5806b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:29.379630 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d4aac-33f9-4731-a753-cd53d5806b14 admin admin] PATH_INFO: `/v3/projects/52d03cc228aa456888177276cc320b10/users/c1ca6bec0d1a4c2586ea0c2e5e385458/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:29.402905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d4aac-33f9-4731-a753-cd53d5806b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d03cc228aa456888177276cc320b10, user_id=c1ca6bec0d1a4c2586ea0c2e5e385458, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:21:29.403968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-435d4aac-33f9-4731-a753-cd53d5806b14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:21:29.403968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 15 15:21:29.403968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: Jul 15 15:21:29.405995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d4aac-33f9-4731-a753-cd53d5806b14 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:21:29.433512 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 751/1501] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:21:29 2022] PUT /identity/v3/projects/52d03cc228aa456888177276cc320b10/users/c1ca6bec0d1a4c2586ea0c2e5e385458/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:21:29.446060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d5ec4-5263-4fa5-aa0c-a1e5bd74c5c7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:29.446381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d5ec4-5263-4fa5-aa0c-a1e5bd74c5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:29.447214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d5ec4-5263-4fa5-aa0c-a1e5bd74c5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:29.501585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1c0d5ec4-5263-4fa5-aa0c-a1e5bd74c5c7 None None] MFA Rules not processed for user `c1ca6bec0d1a4c2586ea0c2e5e385458`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:21:29.502893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1c0d5ec4-5263-4fa5-aa0c-a1e5bd74c5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:29.580181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 751/1502] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:21:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:21:29.593405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddcb42-f4c8-4c84-a002-b0be80e66da0 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:29.593696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddcb42-f4c8-4c84-a002-b0be80e66da0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:29.593978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddcb42-f4c8-4c84-a002-b0be80e66da0 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:29.595395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 752/1503] 10.222.0.64 () {54 vars in 963 bytes} [Fri Jul 15 15:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:21:29.601006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5184d3f-6b68-4c98-92fe-e5f6c2c98da1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:29.601344 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5184d3f-6b68-4c98-92fe-e5f6c2c98da1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:29.601634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5184d3f-6b68-4c98-92fe-e5f6c2c98da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:29.632486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:21:29.678791 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a5184d3f-6b68-4c98-92fe-e5f6c2c98da1 None None] MFA Rules not processed for user `43cfdc27dbdb45c49f50e7bb3f93c260`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:21:29.680036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a5184d3f-6b68-4c98-92fe-e5f6c2c98da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:29.757254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 752/1504] 10.222.0.64 () {58 vars in 1060 bytes} [Fri Jul 15 15:21:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:21:29.766117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddcb42-f4c8-4c84-a002-b0be80e66da0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:21:29.767700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6cddcb42-f4c8-4c84-a002-b0be80e66da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:29.824013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:21:29.886461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddcb42-f4c8-4c84-a002-b0be80e66da0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:21:29.964142 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e0cee-fe87-4ba8-abed-3b902231f8b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:21:29.964815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e0cee-fe87-4ba8-abed-3b902231f8b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:29.965126 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e0cee-fe87-4ba8-abed-3b902231f8b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:29.965413 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e0cee-fe87-4ba8-abed-3b902231f8b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:29.967110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-018e0cee-fe87-4ba8-abed-3b902231f8b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:30.071233 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e0cee-fe87-4ba8-abed-3b902231f8b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:21:30.073262 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e0cee-fe87-4ba8-abed-3b902231f8b8 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:21:30.077005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:21:30.093283 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 753/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:21:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:21:30.138753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e55e8-79ae-4849-b1c7-b648bd9a4560 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:30.139222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e55e8-79ae-4849-b1c7-b648bd9a4560 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:30.139340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e55e8-79ae-4849-b1c7-b648bd9a4560 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:30.140599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 753/1506] 10.222.0.64 () {52 vars in 829 bytes} [Fri Jul 15 15:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:21:30.144379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e0cee-fe87-4ba8-abed-3b902231f8b8 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:21:30.145681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-018e0cee-fe87-4ba8-abed-3b902231f8b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:30.371293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e0cee-fe87-4ba8-abed-3b902231f8b8 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:21:30.472378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:21:30.473202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:30.473513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:30.473802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] PATH_INFO: `/v3/users/c1ca6bec0d1a4c2586ea0c2e5e385458` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:30.486994 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ca6bec0d1a4c2586ea0c2e5e385458)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:21:30.488053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:21:30.488053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 15 15:21:30.488053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: Jul 15 15:21:30.489546 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:21:30.500069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:21:30.564996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ca6bec0d1a4c2586ea0c2e5e385458'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:21:30.593037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ca6bec0d1a4c2586ea0c2e5e385458'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:21:30.608327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ca6bec0d1a4c2586ea0c2e5e385458'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:21:30.618388 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ca6bec0d1a4c2586ea0c2e5e385458'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:21:30.619012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ca6bec0d1a4c2586ea0c2e5e385458'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:21:30.625024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 754/1507] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:21:30 2022] DELETE /identity/v3/users/c1ca6bec0d1a4c2586ea0c2e5e385458 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:21:30.629804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a06ab-9fb6-43aa-a13c-88c5a93271c2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:30.630104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a06ab-9fb6-43aa-a13c-88c5a93271c2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:30.630384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a06ab-9fb6-43aa-a13c-88c5a93271c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:30.691674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-520a06ab-9fb6-43aa-a13c-88c5a93271c2 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:21:30.692925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-520a06ab-9fb6-43aa-a13c-88c5a93271c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:30.778317 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:21:30.794105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 754/1508] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:21:30.804368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:21:30.806204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:30.939725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c43de0-827b-4b9b-8a9c-965437862825 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:21:31.002746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:21:31.027704 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cec09-b3ae-45ca-a41c-fa161eb407f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:21:31.028421 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cec09-b3ae-45ca-a41c-fa161eb407f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:31.028648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cec09-b3ae-45ca-a41c-fa161eb407f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:31.028921 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cec09-b3ae-45ca-a41c-fa161eb407f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:31.030655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-da8cec09-b3ae-45ca-a41c-fa161eb407f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:31.147341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cec09-b3ae-45ca-a41c-fa161eb407f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:21:31.148804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cec09-b3ae-45ca-a41c-fa161eb407f0 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:21:31.167329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 755/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:21:31.499041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a06ab-9fb6-43aa-a13c-88c5a93271c2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:21:31.500405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-520a06ab-9fb6-43aa-a13c-88c5a93271c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:21:31.512814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a06ab-9fb6-43aa-a13c-88c5a93271c2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:21:31.613593 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:21:31.614466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:21:31.614751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:21:31.615029 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] PATH_INFO: `/v3/projects/52d03cc228aa456888177276cc320b10` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:21:31.625002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d03cc228aa456888177276cc320b10)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:21:31.626069 dv-cinder-850015-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:21:31.626069 dv-cinder-850015-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 15 15:21:31.626069 dv-cinder-850015-1-smb devstack@keystone.service[80236]: Jul 15 15:21:31.627272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:21:31.684492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d03cc228aa456888177276cc320b10', 'request_id': 'req-424413c6-07e5-493c-808b-e129e4d17d63'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:21:31.694488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d03cc228aa456888177276cc320b10', 'request_id': 'req-424413c6-07e5-493c-808b-e129e4d17d63'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:21:31.707612 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d03cc228aa456888177276cc320b10', 'request_id': 'req-424413c6-07e5-493c-808b-e129e4d17d63'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:21:31.730680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] The token cache is being invalidate because project 52d03cc228aa456888177276cc320b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:21:31.730970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:21:31.731499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-424413c6-07e5-493c-808b-e129e4d17d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:21:31.732873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 755/1510] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:21:31 2022] DELETE /identity/v3/projects/52d03cc228aa456888177276cc320b10 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:21:41.164467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=62 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:21:41.728497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:23:29.321382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ecb29-163d-4aed-9918-13b5049da942 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:29.322006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ecb29-163d-4aed-9918-13b5049da942 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:29.322006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ecb29-163d-4aed-9918-13b5049da942 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:29.323915 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:23:29.330115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eda23-0ca2-4064-9da2-862bc85bb6d3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:29.330622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eda23-0ca2-4064-9da2-862bc85bb6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:29.330731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eda23-0ca2-4064-9da2-862bc85bb6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:29.417014 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e13eda23-0ca2-4064-9da2-862bc85bb6d3 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:23:29.418288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e13eda23-0ca2-4064-9da2-862bc85bb6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:29.532666 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:23:29.687056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ecb29-163d-4aed-9918-13b5049da942 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:23:29.689261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-390ecb29-163d-4aed-9918-13b5049da942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:29.887040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ecb29-163d-4aed-9918-13b5049da942 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:23:29.893747 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c8cf0-1a02-4244-9f07-7de8a15604cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:23:29.894493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c8cf0-1a02-4244-9f07-7de8a15604cc service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:29.894820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c8cf0-1a02-4244-9f07-7de8a15604cc service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:29.895350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c8cf0-1a02-4244-9f07-7de8a15604cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:29.908179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c8cf0-1a02-4244-9f07-7de8a15604cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:23:29.909858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c8cf0-1a02-4244-9f07-7de8a15604cc service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:23:29.921584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 757/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:23:30.792721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76d0eb-f4c8-4f99-b206-3f41ea011ab2 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:30.793499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76d0eb-f4c8-4f99-b206-3f41ea011ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:30.793499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76d0eb-f4c8-4f99-b206-3f41ea011ab2 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:30.794800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:23:30.800567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41af19-359d-4d65-9564-d2eef35f3243 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:30.801651 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41af19-359d-4d65-9564-d2eef35f3243 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:30.801651 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41af19-359d-4d65-9564-d2eef35f3243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:30.830370 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cc41af19-359d-4d65-9564-d2eef35f3243 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:23:30.831674 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cc41af19-359d-4d65-9564-d2eef35f3243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:30.840807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:23:30.994629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76d0eb-f4c8-4f99-b206-3f41ea011ab2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:23:31.010152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76d0eb-f4c8-4f99-b206-3f41ea011ab2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:23:31.016081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62322a-21b5-4359-931e-06063371fa84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:23:31.016739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62322a-21b5-4359-931e-06063371fa84 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:31.017022 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62322a-21b5-4359-931e-06063371fa84 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:31.017330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62322a-21b5-4359-931e-06063371fa84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:31.027996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62322a-21b5-4359-931e-06063371fa84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:23:31.029663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62322a-21b5-4359-931e-06063371fa84 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:23:31.040395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 758/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:23:31.491973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b90fb8-ef41-4078-b219-707e20d659d0 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:31.492826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b90fb8-ef41-4078-b219-707e20d659d0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:31.493164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b90fb8-ef41-4078-b219-707e20d659d0 None None] PATH_INFO: `/v3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:31.494562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 759/1517] 10.222.0.79 () {54 vars in 925 bytes} [Fri Jul 15 15:23:31 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:23:31.501754 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb404-2eca-4c70-be12-219e349a9264 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:31.502038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb404-2eca-4c70-be12-219e349a9264 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:31.502311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb404-2eca-4c70-be12-219e349a9264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:31.571000 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-66fcb404-2eca-4c70-be12-219e349a9264 None None] MFA Rules not processed for user `3ba61318896f43e5a68e80f38ae5f3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:23:31.572294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-66fcb404-2eca-4c70-be12-219e349a9264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:31.591850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:23:31.657052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 759/1518] 10.222.0.79 () {58 vars in 1015 bytes} [Fri Jul 15 15:23:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:23:35.645840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfed48-f84b-4586-b241-c1570270c39f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:35.646394 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfed48-f84b-4586-b241-c1570270c39f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:35.646394 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfed48-f84b-4586-b241-c1570270c39f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:35.647755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 760/1519] 10.222.0.64 () {54 vars in 960 bytes} [Fri Jul 15 15:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:23:35.653935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e35326-1a13-4ebf-aff9-882567b0db8c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:35.654502 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e35326-1a13-4ebf-aff9-882567b0db8c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:35.654502 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e35326-1a13-4ebf-aff9-882567b0db8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:35.675546 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-82e35326-1a13-4ebf-aff9-882567b0db8c None None] MFA Rules not processed for user `3ba61318896f43e5a68e80f38ae5f3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:23:35.676898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-82e35326-1a13-4ebf-aff9-882567b0db8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:35.686920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 760/1520] 10.222.0.64 () {58 vars in 1057 bytes} [Fri Jul 15 15:23:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:23:35.694705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfed48-f84b-4586-b241-c1570270c39f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:23:35.710163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfed48-f84b-4586-b241-c1570270c39f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:23:35.717910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6a83a-9175-4373-ae4e-991e874b03cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba61318896f43e5a68e80f38ae5f3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:23:35.718892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6a83a-9175-4373-ae4e-991e874b03cb service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:35.719402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6a83a-9175-4373-ae4e-991e874b03cb service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:35.719870 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6a83a-9175-4373-ae4e-991e874b03cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:35.735916 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6a83a-9175-4373-ae4e-991e874b03cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:23:35.738823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6a83a-9175-4373-ae4e-991e874b03cb service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:23:35.756877 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 761/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:23:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:23:42.300654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378394b-d094-4d7f-9359-524b96d42aec None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:42.301228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378394b-d094-4d7f-9359-524b96d42aec None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:42.301228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378394b-d094-4d7f-9359-524b96d42aec None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:42.302547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:23:42.308259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26befeb2-ca2d-44dc-8ebf-2edf683c6bc2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:42.308712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26befeb2-ca2d-44dc-8ebf-2edf683c6bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:42.308807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26befeb2-ca2d-44dc-8ebf-2edf683c6bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:42.327578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-26befeb2-ca2d-44dc-8ebf-2edf683c6bc2 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:23:42.328807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-26befeb2-ca2d-44dc-8ebf-2edf683c6bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:42.336835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:23:42.492858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378394b-d094-4d7f-9359-524b96d42aec None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:23:42.508716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378394b-d094-4d7f-9359-524b96d42aec None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:23:42.516311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054efe3-e1f2-475a-ad3d-419368ddebf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:23:42.516880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054efe3-e1f2-475a-ad3d-419368ddebf1 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:42.517201 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054efe3-e1f2-475a-ad3d-419368ddebf1 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:42.517487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054efe3-e1f2-475a-ad3d-419368ddebf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:42.528142 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054efe3-e1f2-475a-ad3d-419368ddebf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:23:42.530040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054efe3-e1f2-475a-ad3d-419368ddebf1 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:23:42.540980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 762/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:23:43.380780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b340f-598e-4714-955b-8efc685122a9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:43.381414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b340f-598e-4714-955b-8efc685122a9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:43.381414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b340f-598e-4714-955b-8efc685122a9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:43.382682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:23:43.388119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fe6f3-85c5-45f3-96aa-f51e4e0e4b80 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:43.388601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fe6f3-85c5-45f3-96aa-f51e4e0e4b80 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:43.388697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fe6f3-85c5-45f3-96aa-f51e4e0e4b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:43.408466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-fc5fe6f3-85c5-45f3-96aa-f51e4e0e4b80 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:23:43.409729 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fc5fe6f3-85c5-45f3-96aa-f51e4e0e4b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:43.418322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:23:43.569224 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b340f-598e-4714-955b-8efc685122a9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:23:43.585091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b340f-598e-4714-955b-8efc685122a9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:23:43.591173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98847af5-b7d0-4bca-ad7a-8f6377f0405c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:23:43.591817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98847af5-b7d0-4bca-ad7a-8f6377f0405c service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:43.592102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98847af5-b7d0-4bca-ad7a-8f6377f0405c service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:43.592387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98847af5-b7d0-4bca-ad7a-8f6377f0405c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:43.602180 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98847af5-b7d0-4bca-ad7a-8f6377f0405c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:23:43.604298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98847af5-b7d0-4bca-ad7a-8f6377f0405c service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:23:43.615173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 764/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:23:47.569875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbe2bd-4a22-45b4-a57a-e417217c3ce5 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:47.570584 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbe2bd-4a22-45b4-a57a-e417217c3ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:47.570867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbe2bd-4a22-45b4-a57a-e417217c3ce5 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:47.572245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:23:47.577494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693c435-c48a-46c9-93d6-cf741a735666 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:47.577927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693c435-c48a-46c9-93d6-cf741a735666 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:47.578056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693c435-c48a-46c9-93d6-cf741a735666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:47.595776 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c693c435-c48a-46c9-93d6-cf741a735666 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:23:47.596981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c693c435-c48a-46c9-93d6-cf741a735666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:47.606038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:23:47.645120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbe2bd-4a22-45b4-a57a-e417217c3ce5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:23:47.646803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1bfbe2bd-4a22-45b4-a57a-e417217c3ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:47.725113 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbe2bd-4a22-45b4-a57a-e417217c3ce5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:23:47.728750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722666f5-fe5b-4859-9701-e5b88e9ffb97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:23:47.729442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722666f5-fe5b-4859-9701-e5b88e9ffb97 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:47.729730 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722666f5-fe5b-4859-9701-e5b88e9ffb97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:47.730011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722666f5-fe5b-4859-9701-e5b88e9ffb97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:47.739494 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722666f5-fe5b-4859-9701-e5b88e9ffb97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:23:47.740955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722666f5-fe5b-4859-9701-e5b88e9ffb97 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:23:47.751277 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 765/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:23:49.763337 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395756d-5789-469f-8ba8-1d33e52b4782 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:49.763893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395756d-5789-469f-8ba8-1d33e52b4782 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:49.763893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395756d-5789-469f-8ba8-1d33e52b4782 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:49.765555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:23:49.770867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f3e3-34cb-421e-a755-3e4e90ed02c5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:49.771301 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f3e3-34cb-421e-a755-3e4e90ed02c5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:49.771429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f3e3-34cb-421e-a755-3e4e90ed02c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:49.790558 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b2f2f3e3-34cb-421e-a755-3e4e90ed02c5 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:23:49.791756 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b2f2f3e3-34cb-421e-a755-3e4e90ed02c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:49.799593 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:23:49.835371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395756d-5789-469f-8ba8-1d33e52b4782 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:23:49.846605 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395756d-5789-469f-8ba8-1d33e52b4782 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:23:49.850199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26754e8-4cf9-4238-b7f6-b95cc5b7ee16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:23:49.850845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26754e8-4cf9-4238-b7f6-b95cc5b7ee16 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:49.851131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26754e8-4cf9-4238-b7f6-b95cc5b7ee16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:49.851408 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26754e8-4cf9-4238-b7f6-b95cc5b7ee16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:49.860606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26754e8-4cf9-4238-b7f6-b95cc5b7ee16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:23:49.862133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26754e8-4cf9-4238-b7f6-b95cc5b7ee16 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:23:49.871493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 767/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:23:53.851306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee6ef4-dc20-47ad-8917-b4c06c3bd610 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:53.851854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee6ef4-dc20-47ad-8917-b4c06c3bd610 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:53.851854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee6ef4-dc20-47ad-8917-b4c06c3bd610 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:53.853241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:23:53.858626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9136d0d-e23d-48ce-a4e3-f5606627a242 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:53.859096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9136d0d-e23d-48ce-a4e3-f5606627a242 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:53.859213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9136d0d-e23d-48ce-a4e3-f5606627a242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:53.865771 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=81 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:23:53.879606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a9136d0d-e23d-48ce-a4e3-f5606627a242 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:23:53.880739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a9136d0d-e23d-48ce-a4e3-f5606627a242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:53.889524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:23:54.202740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee6ef4-dc20-47ad-8917-b4c06c3bd610 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:23:54.204445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-faee6ef4-dc20-47ad-8917-b4c06c3bd610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:54.286713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:23:54.300842 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee6ef4-dc20-47ad-8917-b4c06c3bd610 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:23:54.304557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc494e-469e-4914-91c1-26ac1e4c71e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:23:54.305747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc494e-469e-4914-91c1-26ac1e4c71e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:54.306036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc494e-469e-4914-91c1-26ac1e4c71e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:54.306320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc494e-469e-4914-91c1-26ac1e4c71e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:54.316048 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc494e-469e-4914-91c1-26ac1e4c71e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:23:54.317539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc494e-469e-4914-91c1-26ac1e4c71e5 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:23:54.328319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 768/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:23:56.382315 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173afce4-2f84-43bd-ad26-dd0b63e66ab0 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:56.383421 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173afce4-2f84-43bd-ad26-dd0b63e66ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:56.383531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173afce4-2f84-43bd-ad26-dd0b63e66ab0 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:56.384833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:23:56.390716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edf789-eb65-4392-a89f-7c8b388d92d0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:56.391140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edf789-eb65-4392-a89f-7c8b388d92d0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:56.391289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edf789-eb65-4392-a89f-7c8b388d92d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:56.410352 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-13edf789-eb65-4392-a89f-7c8b388d92d0 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:23:56.411579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-13edf789-eb65-4392-a89f-7c8b388d92d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:56.420272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:23:56.729823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173afce4-2f84-43bd-ad26-dd0b63e66ab0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:23:56.731521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-173afce4-2f84-43bd-ad26-dd0b63e66ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:23:56.745378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173afce4-2f84-43bd-ad26-dd0b63e66ab0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:23:56.748832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf3f27-d8c1-45ce-8527-41da166735ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:23:56.749520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3f27-d8c1-45ce-8527-41da166735ce service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:23:56.749805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3f27-d8c1-45ce-8527-41da166735ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:23:56.750087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3f27-d8c1-45ce-8527-41da166735ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:23:56.760075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf3f27-d8c1-45ce-8527-41da166735ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:23:56.761577 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf3f27-d8c1-45ce-8527-41da166735ce service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:23:56.772056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 770/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:24:06.405309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=11 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:24:06.767435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=8 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:34.925283 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258228ff-0ff7-4b64-af33-dc89b62424af None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:34.925902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258228ff-0ff7-4b64-af33-dc89b62424af None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:34.925902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258228ff-0ff7-4b64-af33-dc89b62424af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:34.953964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-258228ff-0ff7-4b64-af33-dc89b62424af None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:34.955255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-258228ff-0ff7-4b64-af33-dc89b62424af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:34.974079 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 770/1540] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:34.983481 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d3c5d-aeb6-42c4-9221-412f37ce604c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:34.984099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d3c5d-aeb6-42c4-9221-412f37ce604c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:34.984099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d3c5d-aeb6-42c4-9221-412f37ce604c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.010498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fd6d3c5d-aeb6-42c4-9221-412f37ce604c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.012280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fd6d3c5d-aeb6-42c4-9221-412f37ce604c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.024072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 771/1541] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.029105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258228ff-0ff7-4b64-af33-dc89b62424af None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.033593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5fe14-aaff-41a6-a536-24ca8a0c597b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.033881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5fe14-aaff-41a6-a536-24ca8a0c597b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.034211 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5fe14-aaff-41a6-a536-24ca8a0c597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.051894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258228ff-0ff7-4b64-af33-dc89b62424af None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.058058 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-92c5fe14-aaff-41a6-a536-24ca8a0c597b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.059331 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-92c5fe14-aaff-41a6-a536-24ca8a0c597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.067278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f1839-0583-413b-a1bd-485cbc76a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.067994 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f1839-0583-413b-a1bd-485cbc76a1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.068281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f1839-0583-413b-a1bd-485cbc76a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.068569 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f1839-0583-413b-a1bd-485cbc76a1f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.069372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f1839-0583-413b-a1bd-485cbc76a1f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:25:35.069695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f1839-0583-413b-a1bd-485cbc76a1f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.072241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f1839-0583-413b-a1bd-485cbc76a1f8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.078572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 772/1542] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:25:35.092274 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9423a53-5f46-416e-9fe5-cbc69638bfbc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.092663 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9423a53-5f46-416e-9fe5-cbc69638bfbc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.092859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9423a53-5f46-416e-9fe5-cbc69638bfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.108369 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 771/1543] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:25:35.124627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d9423a53-5f46-416e-9fe5-cbc69638bfbc None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.125982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d9423a53-5f46-416e-9fe5-cbc69638bfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.134461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f1839-0583-413b-a1bd-485cbc76a1f8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.145629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 773/1544] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:25:35.152721 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9423a53-5f46-416e-9fe5-cbc69638bfbc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.163033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f1839-0583-413b-a1bd-485cbc76a1f8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.164408 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9423a53-5f46-416e-9fe5-cbc69638bfbc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.177374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc738b-9b79-4164-88c5-7b78a9ded059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.178014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc738b-9b79-4164-88c5-7b78a9ded059 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.178342 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc738b-9b79-4164-88c5-7b78a9ded059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.178621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc738b-9b79-4164-88c5-7b78a9ded059 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.180944 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f5c0c-2895-4db1-87fd-1c9ce4854ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.181698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f5c0c-2895-4db1-87fd-1c9ce4854ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.181996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f5c0c-2895-4db1-87fd-1c9ce4854ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.182324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f5c0c-2895-4db1-87fd-1c9ce4854ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.183041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f5c0c-2895-4db1-87fd-1c9ce4854ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.184148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-d24f5c0c-2895-4db1-87fd-1c9ce4854ae6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:25:35.184148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 15 15:25:35.184148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: Jul 15 15:25:35.185519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f5c0c-2895-4db1-87fd-1c9ce4854ae6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.187124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc738b-9b79-4164-88c5-7b78a9ded059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:25:35.187509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc738b-9b79-4164-88c5-7b78a9ded059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.188581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-04fc738b-9b79-4164-88c5-7b78a9ded059 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:25:35.188581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 15 15:25:35.188581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: Jul 15 15:25:35.189798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc738b-9b79-4164-88c5-7b78a9ded059 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.220631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 774/1545] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:25:35.223898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9441d-b2ce-466b-a70e-e7c23d5545b4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.224189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9441d-b2ce-466b-a70e-e7c23d5545b4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.224471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9441d-b2ce-466b-a70e-e7c23d5545b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.260375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-92c9441d-b2ce-466b-a70e-e7c23d5545b4 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.262250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-92c9441d-b2ce-466b-a70e-e7c23d5545b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.273935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 772/1546] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:35.276555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f5c0c-2895-4db1-87fd-1c9ce4854ae6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.280772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 775/1547] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.283294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86478855-b701-4e3b-badd-376cee707839 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.283600 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86478855-b701-4e3b-badd-376cee707839 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.283848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86478855-b701-4e3b-badd-376cee707839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.333743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-86478855-b701-4e3b-badd-376cee707839 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.335488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-86478855-b701-4e3b-badd-376cee707839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.388215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f5c0c-2895-4db1-87fd-1c9ce4854ae6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.403992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd476f3-a74f-484b-b004-499387304d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.404757 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd476f3-a74f-484b-b004-499387304d07 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.405167 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd476f3-a74f-484b-b004-499387304d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.405457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd476f3-a74f-484b-b004-499387304d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.406269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd476f3-a74f-484b-b004-499387304d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.408643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd476f3-a74f-484b-b004-499387304d07 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.425655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 776/1548] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.426582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86478855-b701-4e3b-badd-376cee707839 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.442310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86478855-b701-4e3b-badd-376cee707839 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.449479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c617c-3e15-4c1d-b055-174a31be9172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.450560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c617c-3e15-4c1d-b055-174a31be9172 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.450952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c617c-3e15-4c1d-b055-174a31be9172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.451440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c617c-3e15-4c1d-b055-174a31be9172 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.452252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c617c-3e15-4c1d-b055-174a31be9172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.453426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 773/1549] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/projects => generated 405 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:35.453575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-cd0c617c-3e15-4c1d-b055-174a31be9172 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:25:35.453575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 15 15:25:35.453575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: Jul 15 15:25:35.455264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c617c-3e15-4c1d-b055-174a31be9172 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.455618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca4ac3-c9e0-4cf1-838b-eb14bb43db44 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.456067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca4ac3-c9e0-4cf1-838b-eb14bb43db44 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.456645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca4ac3-c9e0-4cf1-838b-eb14bb43db44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.481974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 777/1550] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/users => generated 283 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:35.486799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148b2c-f157-43cb-a059-92ec13124f56 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.487244 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148b2c-f157-43cb-a059-92ec13124f56 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.487664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148b2c-f157-43cb-a059-92ec13124f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.498351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b1ca4ac3-c9e0-4cf1-838b-eb14bb43db44 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.501215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b1ca4ac3-c9e0-4cf1-838b-eb14bb43db44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.510089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6a148b2c-f157-43cb-a059-92ec13124f56 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.512884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6a148b2c-f157-43cb-a059-92ec13124f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.598705 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 774/1551] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.600117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a6413-cd1a-45ee-addb-d9434da65769 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.600417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a6413-cd1a-45ee-addb-d9434da65769 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.600699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a6413-cd1a-45ee-addb-d9434da65769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.624131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ab6a6413-cd1a-45ee-addb-d9434da65769 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.625480 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ab6a6413-cd1a-45ee-addb-d9434da65769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.629374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 778/1552] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.634023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 775/1553] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.634236 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a29a-1485-4785-a985-a556608a209c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.634639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a29a-1485-4785-a985-a556608a209c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.634855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a6413-cd1a-45ee-addb-d9434da65769 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.637826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a29a-1485-4785-a985-a556608a209c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.649732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a6413-cd1a-45ee-addb-d9434da65769 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.657847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a6aad-b9e5-4013-82d3-c8f669addb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.658896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a6aad-b9e5-4013-82d3-c8f669addb5f admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.659378 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a6aad-b9e5-4013-82d3-c8f669addb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.659894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a6aad-b9e5-4013-82d3-c8f669addb5f admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.661241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a6aad-b9e5-4013-82d3-c8f669addb5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.664786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a6aad-b9e5-4013-82d3-c8f669addb5f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.665649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6b71a29a-1485-4785-a985-a556608a209c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.667059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6b71a29a-1485-4785-a985-a556608a209c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.677440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 779/1554] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.682802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71a29a-1485-4785-a985-a556608a209c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.693293 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 776/1555] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/users => generated 303 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:35.694775 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035bfa-dde7-4896-8416-2b9696fc4e32 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.695299 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035bfa-dde7-4896-8416-2b9696fc4e32 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.695551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035bfa-dde7-4896-8416-2b9696fc4e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.696178 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71a29a-1485-4785-a985-a556608a209c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.702967 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01640938-74ec-44f6-8197-9ecaf9ae2460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.703799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01640938-74ec-44f6-8197-9ecaf9ae2460 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.704190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01640938-74ec-44f6-8197-9ecaf9ae2460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.704759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01640938-74ec-44f6-8197-9ecaf9ae2460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.705573 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01640938-74ec-44f6-8197-9ecaf9ae2460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.707648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01640938-74ec-44f6-8197-9ecaf9ae2460 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.721128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 780/1556] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:35.722914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81a293-03ae-4383-b28b-2d5364208df4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.723289 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81a293-03ae-4383-b28b-2d5364208df4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.723652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81a293-03ae-4383-b28b-2d5364208df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.727123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ff035bfa-dde7-4896-8416-2b9696fc4e32 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.728473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ff035bfa-dde7-4896-8416-2b9696fc4e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.737931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 777/1557] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.738782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035bfa-dde7-4896-8416-2b9696fc4e32 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.745499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0a81a293-03ae-4383-b28b-2d5364208df4 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.746726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0a81a293-03ae-4383-b28b-2d5364208df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.749028 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:35.753643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035bfa-dde7-4896-8416-2b9696fc4e32 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.756217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 781/1558] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.757824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae40483-1c03-4a52-b490-4eb977b9252a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.758149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae40483-1c03-4a52-b490-4eb977b9252a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.758432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae40483-1c03-4a52-b490-4eb977b9252a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.760722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a737c-6475-4303-b015-45913e258fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.761909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a737c-6475-4303-b015-45913e258fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.762268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a737c-6475-4303-b015-45913e258fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.762627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a737c-6475-4303-b015-45913e258fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.763459 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a737c-6475-4303-b015-45913e258fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:25:35.763897 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a737c-6475-4303-b015-45913e258fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.765743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a737c-6475-4303-b015-45913e258fc4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.779847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7ae40483-1c03-4a52-b490-4eb977b9252a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.781082 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7ae40483-1c03-4a52-b490-4eb977b9252a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.781789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 778/1559] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:25:35.783129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de331f-20a8-49e1-b579-c091c0baa4f5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.783426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de331f-20a8-49e1-b579-c091c0baa4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.783708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de331f-20a8-49e1-b579-c091c0baa4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.790129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 782/1560] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.790932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae40483-1c03-4a52-b490-4eb977b9252a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.802044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae40483-1c03-4a52-b490-4eb977b9252a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.804512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-27de331f-20a8-49e1-b579-c091c0baa4f5 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.805783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-27de331f-20a8-49e1-b579-c091c0baa4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.806968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b060d9-0f00-4ccd-8088-1edd462f657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.807638 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b060d9-0f00-4ccd-8088-1edd462f657d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.807922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b060d9-0f00-4ccd-8088-1edd462f657d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.808200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b060d9-0f00-4ccd-8088-1edd462f657d admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.808935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b060d9-0f00-4ccd-8088-1edd462f657d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:25:35.809269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b060d9-0f00-4ccd-8088-1edd462f657d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.810932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b060d9-0f00-4ccd-8088-1edd462f657d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.814369 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 779/1561] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.815262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de331f-20a8-49e1-b579-c091c0baa4f5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.821602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:35.833141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 783/1562] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:25:35.833141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b060d9-0f00-4ccd-8088-1edd462f657d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.833499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de331f-20a8-49e1-b579-c091c0baa4f5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.840367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b060d9-0f00-4ccd-8088-1edd462f657d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.841955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e35302-d049-4f6c-b486-cb8e56725205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.843110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e35302-d049-4f6c-b486-cb8e56725205 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.843465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e35302-d049-4f6c-b486-cb8e56725205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.843822 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e35302-d049-4f6c-b486-cb8e56725205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.844903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e35302-d049-4f6c-b486-cb8e56725205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.845708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320c7f2-7a52-46ad-af9f-9dd4b4eb84a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.846481 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320c7f2-7a52-46ad-af9f-9dd4b4eb84a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.846769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320c7f2-7a52-46ad-af9f-9dd4b4eb84a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.847122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320c7f2-7a52-46ad-af9f-9dd4b4eb84a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.847257 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e35302-d049-4f6c-b486-cb8e56725205 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.847949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320c7f2-7a52-46ad-af9f-9dd4b4eb84a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.849763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320c7f2-7a52-46ad-af9f-9dd4b4eb84a0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.861865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 780/1563] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:35.863434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01c6a9-32d3-46cf-87e2-debe2d7071e7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.863728 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01c6a9-32d3-46cf-87e2-debe2d7071e7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.864041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 784/1564] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:35.864181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01c6a9-32d3-46cf-87e2-debe2d7071e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.865967 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72551bf-7aaa-4543-9764-d98f7938e78c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.866317 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72551bf-7aaa-4543-9764-d98f7938e78c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.866819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72551bf-7aaa-4543-9764-d98f7938e78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.885010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7b01c6a9-32d3-46cf-87e2-debe2d7071e7 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.886265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7b01c6a9-32d3-46cf-87e2-debe2d7071e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.890266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b72551bf-7aaa-4543-9764-d98f7938e78c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:35.892578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b72551bf-7aaa-4543-9764-d98f7938e78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:35.894562 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 781/1565] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.895430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01c6a9-32d3-46cf-87e2-debe2d7071e7 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.905538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 785/1566] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:35.906549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72551bf-7aaa-4543-9764-d98f7938e78c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.906663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01c6a9-32d3-46cf-87e2-debe2d7071e7 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.911552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe240fff-aa3e-4d0e-b756-2b23420b0ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.912305 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe240fff-aa3e-4d0e-b756-2b23420b0ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.912590 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe240fff-aa3e-4d0e-b756-2b23420b0ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.913130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe240fff-aa3e-4d0e-b756-2b23420b0ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.914444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe240fff-aa3e-4d0e-b756-2b23420b0ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.916563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe240fff-aa3e-4d0e-b756-2b23420b0ae0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.920650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72551bf-7aaa-4543-9764-d98f7938e78c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:35.925529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a796812-e135-47dc-a2ee-fbb997d46be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:35.926346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a796812-e135-47dc-a2ee-fbb997d46be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:35.926775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a796812-e135-47dc-a2ee-fbb997d46be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:35.927167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a796812-e135-47dc-a2ee-fbb997d46be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:35.928169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a796812-e135-47dc-a2ee-fbb997d46be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:25:35.928618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a796812-e135-47dc-a2ee-fbb997d46be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:35.930783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a796812-e135-47dc-a2ee-fbb997d46be0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:35.949438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 786/1567] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:25:35.950788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a796812-e135-47dc-a2ee-fbb997d46be0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.958835 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 782/1568] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:35.958835 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe240fff-aa3e-4d0e-b756-2b23420b0ae0 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:35.968996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a796812-e135-47dc-a2ee-fbb997d46be0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.034241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe240fff-aa3e-4d0e-b756-2b23420b0ae0 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.036963 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867b47f-0f2f-48f7-a02e-5dbd6c24b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.037705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867b47f-0f2f-48f7-a02e-5dbd6c24b5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.037993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867b47f-0f2f-48f7-a02e-5dbd6c24b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.038278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867b47f-0f2f-48f7-a02e-5dbd6c24b5d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.039132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867b47f-0f2f-48f7-a02e-5dbd6c24b5d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:25:36.039435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867b47f-0f2f-48f7-a02e-5dbd6c24b5d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.040703 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67be01-8978-4c93-9e7f-1e5cbb76d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.041178 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867b47f-0f2f-48f7-a02e-5dbd6c24b5d2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.041478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67be01-8978-4c93-9e7f-1e5cbb76d1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.041789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67be01-8978-4c93-9e7f-1e5cbb76d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.042110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67be01-8978-4c93-9e7f-1e5cbb76d1b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.042826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67be01-8978-4c93-9e7f-1e5cbb76d1b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.044955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67be01-8978-4c93-9e7f-1e5cbb76d1b6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.055351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 787/1569] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:25:36.056192 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867b47f-0f2f-48f7-a02e-5dbd6c24b5d2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.069176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867b47f-0f2f-48f7-a02e-5dbd6c24b5d2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.074773 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665973b-5e2f-4ce5-aa8f-266c89bd14d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.075445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665973b-5e2f-4ce5-aa8f-266c89bd14d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.075683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 783/1570] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:35 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:36.075943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665973b-5e2f-4ce5-aa8f-266c89bd14d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.076056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665973b-5e2f-4ce5-aa8f-266c89bd14d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.076522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67be01-8978-4c93-9e7f-1e5cbb76d1b6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.076798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665973b-5e2f-4ce5-aa8f-266c89bd14d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.078513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665973b-5e2f-4ce5-aa8f-266c89bd14d3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.090811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 788/1571] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:36.091812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665973b-5e2f-4ce5-aa8f-266c89bd14d3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.103338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665973b-5e2f-4ce5-aa8f-266c89bd14d3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.153808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67be01-8978-4c93-9e7f-1e5cbb76d1b6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.159237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e94d37-2ddd-4b22-a3fa-7aac83fa0703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.160122 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e94d37-2ddd-4b22-a3fa-7aac83fa0703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.160406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e94d37-2ddd-4b22-a3fa-7aac83fa0703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.160687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e94d37-2ddd-4b22-a3fa-7aac83fa0703 admin admin] PATH_INFO: `/v3/projects/37455dda66e94faba63f2583e81202e2/users/7e3bf11d825d4ce3a4acf1f40b3b9bd9/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.168677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccb36c-1644-49ee-ac25-b9fc59beeb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.169688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccb36c-1644-49ee-ac25-b9fc59beeb1c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.170134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccb36c-1644-49ee-ac25-b9fc59beeb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.170493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccb36c-1644-49ee-ac25-b9fc59beeb1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.171804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccb36c-1644-49ee-ac25-b9fc59beeb1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:25:36.171804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccb36c-1644-49ee-ac25-b9fc59beeb1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.174540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccb36c-1644-49ee-ac25-b9fc59beeb1c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.180350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e94d37-2ddd-4b22-a3fa-7aac83fa0703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37455dda66e94faba63f2583e81202e2, user_id=7e3bf11d825d4ce3a4acf1f40b3b9bd9, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.181452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-38e94d37-2ddd-4b22-a3fa-7aac83fa0703 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:25:36.181452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 15 15:25:36.181452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: Jul 15 15:25:36.183548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e94d37-2ddd-4b22-a3fa-7aac83fa0703 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.188033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 789/1572] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:25:36.189127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccb36c-1644-49ee-ac25-b9fc59beeb1c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.200456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccb36c-1644-49ee-ac25-b9fc59beeb1c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.205697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dc9ec-27a8-4c74-a4bc-a26c1cd9e217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.206395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dc9ec-27a8-4c74-a4bc-a26c1cd9e217 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.206697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dc9ec-27a8-4c74-a4bc-a26c1cd9e217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.206931 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dc9ec-27a8-4c74-a4bc-a26c1cd9e217 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.207645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92dc9ec-27a8-4c74-a4bc-a26c1cd9e217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:25:36.207991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92dc9ec-27a8-4c74-a4bc-a26c1cd9e217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.209717 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92dc9ec-27a8-4c74-a4bc-a26c1cd9e217 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.212283 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 784/1573] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:36 2022] PUT /identity/v3/projects/37455dda66e94faba63f2583e81202e2/users/7e3bf11d825d4ce3a4acf1f40b3b9bd9/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:36.213899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e94d37-2ddd-4b22-a3fa-7aac83fa0703 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.227280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 790/1574] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:25:36.228250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dc9ec-27a8-4c74-a4bc-a26c1cd9e217 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.238643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:36.242560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dc9ec-27a8-4c74-a4bc-a26c1cd9e217 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.278647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:36.296713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e94d37-2ddd-4b22-a3fa-7aac83fa0703 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.302037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e33a7-48a7-412d-952d-7b47f828b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.303726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e33a7-48a7-412d-952d-7b47f828b97a admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.303726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e33a7-48a7-412d-952d-7b47f828b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.303726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e33a7-48a7-412d-952d-7b47f828b97a admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.304418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e33a7-48a7-412d-952d-7b47f828b97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.306033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e33a7-48a7-412d-952d-7b47f828b97a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.307994 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71002eb1-33dc-44e5-920d-1b4efdf76d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.308861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71002eb1-33dc-44e5-920d-1b4efdf76d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.309314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71002eb1-33dc-44e5-920d-1b4efdf76d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.309672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71002eb1-33dc-44e5-920d-1b4efdf76d77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.310427 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71002eb1-33dc-44e5-920d-1b4efdf76d77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.312940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71002eb1-33dc-44e5-920d-1b4efdf76d77 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.328685 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 785/1575] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:36.329710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e33a7-48a7-412d-952d-7b47f828b97a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.343200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e33a7-48a7-412d-952d-7b47f828b97a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.348374 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21dfad-d6eb-4b8a-8c6d-236acf11c23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.349137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21dfad-d6eb-4b8a-8c6d-236acf11c23e admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.349524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21dfad-d6eb-4b8a-8c6d-236acf11c23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.349953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21dfad-d6eb-4b8a-8c6d-236acf11c23e admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.350265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 791/1576] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/projects => generated 357 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:36.350995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21dfad-d6eb-4b8a-8c6d-236acf11c23e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.351460 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71002eb1-33dc-44e5-920d-1b4efdf76d77 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.353466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21dfad-d6eb-4b8a-8c6d-236acf11c23e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.381006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 786/1577] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:36.381936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21dfad-d6eb-4b8a-8c6d-236acf11c23e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.434217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71002eb1-33dc-44e5-920d-1b4efdf76d77 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.459026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21dfad-d6eb-4b8a-8c6d-236acf11c23e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.466265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074d58e-68f8-48ad-b426-6b280c491569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.467355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d58e-68f8-48ad-b426-6b280c491569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.467751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d58e-68f8-48ad-b426-6b280c491569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.468139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d58e-68f8-48ad-b426-6b280c491569 admin admin] PATH_INFO: `/v3/projects/e45aae614bf845459cf519c39842abc0/users/252502cd22264ce99d942048de462454/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.485301 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074d58e-68f8-48ad-b426-6b280c491569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45aae614bf845459cf519c39842abc0, user_id=252502cd22264ce99d942048de462454, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.488035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074d58e-68f8-48ad-b426-6b280c491569 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.495761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f67e7-2f9c-4e6e-81aa-2cf575529505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.496459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f67e7-2f9c-4e6e-81aa-2cf575529505 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.496748 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f67e7-2f9c-4e6e-81aa-2cf575529505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.497026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f67e7-2f9c-4e6e-81aa-2cf575529505 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.498669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f67e7-2f9c-4e6e-81aa-2cf575529505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.499803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f67e7-2f9c-4e6e-81aa-2cf575529505 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.505437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 787/1578] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:36 2022] PUT /identity/v3/projects/e45aae614bf845459cf519c39842abc0/users/252502cd22264ce99d942048de462454/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:36.506489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074d58e-68f8-48ad-b426-6b280c491569 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.529350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 792/1579] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:36.529350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb986b-865b-4def-8102-bc0c56c896c6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.529788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb986b-865b-4def-8102-bc0c56c896c6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.529788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb986b-865b-4def-8102-bc0c56c896c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.559978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-66cb986b-865b-4def-8102-bc0c56c896c6 None None] MFA Rules not processed for user `7e3bf11d825d4ce3a4acf1f40b3b9bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:36.561392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-66cb986b-865b-4def-8102-bc0c56c896c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:36.596198 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074d58e-68f8-48ad-b426-6b280c491569 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.606455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ff0ce-4a63-4471-8238-08891fe4c984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.607191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ff0ce-4a63-4471-8238-08891fe4c984 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.607533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ff0ce-4a63-4471-8238-08891fe4c984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.608013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ff0ce-4a63-4471-8238-08891fe4c984 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.608728 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ff0ce-4a63-4471-8238-08891fe4c984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.610734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ff0ce-4a63-4471-8238-08891fe4c984 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.620747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:36.633751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:36.646780 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 788/1580] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:36.646780 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ff0ce-4a63-4471-8238-08891fe4c984 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.661123 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 793/1581] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:36.666124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb986b-865b-4def-8102-bc0c56c896c6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.679110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb986b-865b-4def-8102-bc0c56c896c6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.722426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ff0ce-4a63-4471-8238-08891fe4c984 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.728906 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf5ae9-d135-4fe1-98c0-b0d471bdc0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.729785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf5ae9-d135-4fe1-98c0-b0d471bdc0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.730034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf5ae9-d135-4fe1-98c0-b0d471bdc0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.730318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf5ae9-d135-4fe1-98c0-b0d471bdc0d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.731156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf5ae9-d135-4fe1-98c0-b0d471bdc0d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.733275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf5ae9-d135-4fe1-98c0-b0d471bdc0d5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.759731 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d18d47-a974-4039-8f46-5db290fae31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.761050 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d18d47-a974-4039-8f46-5db290fae31f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.761594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d18d47-a974-4039-8f46-5db290fae31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.762099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d18d47-a974-4039-8f46-5db290fae31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.762776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 789/1582] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:36.763605 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf5ae9-d135-4fe1-98c0-b0d471bdc0d5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.763848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d18d47-a974-4039-8f46-5db290fae31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.767229 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d18d47-a974-4039-8f46-5db290fae31f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.786760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 794/1583] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:36.788221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d18d47-a974-4039-8f46-5db290fae31f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.805519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d18d47-a974-4039-8f46-5db290fae31f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.840460 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf5ae9-d135-4fe1-98c0-b0d471bdc0d5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.848065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600e2ce-9ef2-4d86-81f9-d46afe2d9f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.848861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600e2ce-9ef2-4d86-81f9-d46afe2d9f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.849378 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600e2ce-9ef2-4d86-81f9-d46afe2d9f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.849769 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600e2ce-9ef2-4d86-81f9-d46afe2d9f66 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.850678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600e2ce-9ef2-4d86-81f9-d46afe2d9f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.852679 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600e2ce-9ef2-4d86-81f9-d46afe2d9f66 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.882351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 790/1584] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/users => generated 279 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:36.882351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ee96-19cd-4538-a599-bd04d08af126 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.882351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ee96-19cd-4538-a599-bd04d08af126 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.882351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ee96-19cd-4538-a599-bd04d08af126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.890214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1aed65-4b58-456e-bc09-c4533eaa0fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.891601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1aed65-4b58-456e-bc09-c4533eaa0fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.892070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1aed65-4b58-456e-bc09-c4533eaa0fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.892535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1aed65-4b58-456e-bc09-c4533eaa0fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.893741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1aed65-4b58-456e-bc09-c4533eaa0fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.896772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1aed65-4b58-456e-bc09-c4533eaa0fe2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.915244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4cc6ee96-19cd-4538-a599-bd04d08af126 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:36.917201 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4cc6ee96-19cd-4538-a599-bd04d08af126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:36.930759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 795/1585] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:36.930759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1aed65-4b58-456e-bc09-c4533eaa0fe2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.931070 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 791/1586] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:36.931399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6ee96-19cd-4538-a599-bd04d08af126 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.947674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6ee96-19cd-4538-a599-bd04d08af126 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.947925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1aed65-4b58-456e-bc09-c4533eaa0fe2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.955012 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8e7fa-cb7f-4bd1-bb2a-3286dded30fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.955314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e2869-e4da-48a3-8714-33039cac9607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.956099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8e7fa-cb7f-4bd1-bb2a-3286dded30fb admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.956445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e2869-e4da-48a3-8714-33039cac9607 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.956627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8e7fa-cb7f-4bd1-bb2a-3286dded30fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.956849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e2869-e4da-48a3-8714-33039cac9607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.957001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8e7fa-cb7f-4bd1-bb2a-3286dded30fb admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.957332 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e2869-e4da-48a3-8714-33039cac9607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:36.958189 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8e7fa-cb7f-4bd1-bb2a-3286dded30fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.958556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e2869-e4da-48a3-8714-33039cac9607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:36.961880 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e2869-e4da-48a3-8714-33039cac9607 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.962109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8e7fa-cb7f-4bd1-bb2a-3286dded30fb admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:36.979108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 796/1587] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:36.979884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e2869-e4da-48a3-8714-33039cac9607 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.990926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 792/1588] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/users => generated 293 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:36.991992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8e7fa-cb7f-4bd1-bb2a-3286dded30fb admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:36.992450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e2869-e4da-48a3-8714-33039cac9607 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:36.997866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae62c45-cf41-42a6-a5f7-bb490368de1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:36.998882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae62c45-cf41-42a6-a5f7-bb490368de1d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:36.999177 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae62c45-cf41-42a6-a5f7-bb490368de1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:36.999584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae62c45-cf41-42a6-a5f7-bb490368de1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.000464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae62c45-cf41-42a6-a5f7-bb490368de1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.002970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae62c45-cf41-42a6-a5f7-bb490368de1d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.003230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8e7fa-cb7f-4bd1-bb2a-3286dded30fb admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.008544 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af568915-3893-4437-948f-5721a469ef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.009263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af568915-3893-4437-948f-5721a469ef15 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.009601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af568915-3893-4437-948f-5721a469ef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.009886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af568915-3893-4437-948f-5721a469ef15 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.010551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af568915-3893-4437-948f-5721a469ef15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.012492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af568915-3893-4437-948f-5721a469ef15 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.034734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 797/1589] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:37.035905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae62c45-cf41-42a6-a5f7-bb490368de1d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.039327 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 793/1590] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:36 2022] POST /identity/v3/users => generated 295 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:37.039327 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af568915-3893-4437-948f-5721a469ef15 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.054430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af568915-3893-4437-948f-5721a469ef15 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.081989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:37.086725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:37.112742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae62c45-cf41-42a6-a5f7-bb490368de1d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.118230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900cbc-8acf-4c5d-8aed-007471434d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.119049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900cbc-8acf-4c5d-8aed-007471434d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.119336 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900cbc-8acf-4c5d-8aed-007471434d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.119618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900cbc-8acf-4c5d-8aed-007471434d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.120373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97900cbc-8acf-4c5d-8aed-007471434d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.122110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97900cbc-8acf-4c5d-8aed-007471434d00 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.134194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 798/1591] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:37.134698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900cbc-8acf-4c5d-8aed-007471434d00 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.136511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef7e8f-7c71-413c-9490-8bc6ff6fba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.137461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef7e8f-7c71-413c-9490-8bc6ff6fba4b admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.137868 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef7e8f-7c71-413c-9490-8bc6ff6fba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.138380 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef7e8f-7c71-413c-9490-8bc6ff6fba4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.139332 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef7e8f-7c71-413c-9490-8bc6ff6fba4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.143378 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef7e8f-7c71-413c-9490-8bc6ff6fba4b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.145431 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900cbc-8acf-4c5d-8aed-007471434d00 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.150934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f83d4e-aac3-4b4c-a07d-010a9e31348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.151621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f83d4e-aac3-4b4c-a07d-010a9e31348a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.151909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f83d4e-aac3-4b4c-a07d-010a9e31348a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.152190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f83d4e-aac3-4b4c-a07d-010a9e31348a admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.152929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f83d4e-aac3-4b4c-a07d-010a9e31348a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.154707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f83d4e-aac3-4b4c-a07d-010a9e31348a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.157999 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 794/1592] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:37.157999 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef7e8f-7c71-413c-9490-8bc6ff6fba4b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.163196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-08ef7e8f-7c71-413c-9490-8bc6ff6fba4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:37.168521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 799/1593] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:37.169191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f83d4e-aac3-4b4c-a07d-010a9e31348a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.180452 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f83d4e-aac3-4b4c-a07d-010a9e31348a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.185521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0e166-d1ef-42de-8a05-c6f8debb3530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.186199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0e166-d1ef-42de-8a05-c6f8debb3530 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.186483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0e166-d1ef-42de-8a05-c6f8debb3530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.186764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0e166-d1ef-42de-8a05-c6f8debb3530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.187487 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0e166-d1ef-42de-8a05-c6f8debb3530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.189151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0e166-d1ef-42de-8a05-c6f8debb3530 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.202552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 800/1594] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:37.203636 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0e166-d1ef-42de-8a05-c6f8debb3530 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.215436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0e166-d1ef-42de-8a05-c6f8debb3530 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.220782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5947d-4420-4e07-b9fc-8097dd87ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.221585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5947d-4420-4e07-b9fc-8097dd87ded2 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.221943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5947d-4420-4e07-b9fc-8097dd87ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.222307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5947d-4420-4e07-b9fc-8097dd87ded2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.223048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5947d-4420-4e07-b9fc-8097dd87ded2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.224710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5947d-4420-4e07-b9fc-8097dd87ded2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.238975 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 801/1595] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:37.238975 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5947d-4420-4e07-b9fc-8097dd87ded2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.246876 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef7e8f-7c71-413c-9490-8bc6ff6fba4b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.249010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5947d-4420-4e07-b9fc-8097dd87ded2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.251464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50ad7e-d74f-4eab-bb5e-c44403ca5ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.252344 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50ad7e-d74f-4eab-bb5e-c44403ca5ebc service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.252706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50ad7e-d74f-4eab-bb5e-c44403ca5ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.253096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50ad7e-d74f-4eab-bb5e-c44403ca5ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.254737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79271121-10ef-481f-8a74-2f43fefe06a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.255728 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79271121-10ef-481f-8a74-2f43fefe06a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.256042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79271121-10ef-481f-8a74-2f43fefe06a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.256363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79271121-10ef-481f-8a74-2f43fefe06a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.257214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79271121-10ef-481f-8a74-2f43fefe06a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.259720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79271121-10ef-481f-8a74-2f43fefe06a1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.264532 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50ad7e-d74f-4eab-bb5e-c44403ca5ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.266416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50ad7e-d74f-4eab-bb5e-c44403ca5ebc service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.274672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 802/1596] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:37.275512 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79271121-10ef-481f-8a74-2f43fefe06a1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.280158 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 795/1597] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:37.281688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50ad7e-d74f-4eab-bb5e-c44403ca5ebc service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.287843 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79271121-10ef-481f-8a74-2f43fefe06a1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.293369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33aa115-d9d6-40c2-ad1a-9399c47d0ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.294063 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aa115-d9d6-40c2-ad1a-9399c47d0ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.294354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aa115-d9d6-40c2-ad1a-9399c47d0ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.294624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aa115-d9d6-40c2-ad1a-9399c47d0ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.295100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50ad7e-d74f-4eab-bb5e-c44403ca5ebc service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.295518 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33aa115-d9d6-40c2-ad1a-9399c47d0ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.297559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33aa115-d9d6-40c2-ad1a-9399c47d0ec3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.300646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc288002-8a17-426f-a204-5b4d82314997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.302223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc288002-8a17-426f-a204-5b4d82314997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.302688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc288002-8a17-426f-a204-5b4d82314997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.303073 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc288002-8a17-426f-a204-5b4d82314997 admin admin] PATH_INFO: `/v3/projects/e3f2046e3edc444eb1035a384e54787c/users/a0362afd4064418e9cd9e43e0ec93f0c/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.325637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 803/1598] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:37 2022] POST /identity/v3/users => generated 291 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:37.326305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33aa115-d9d6-40c2-ad1a-9399c47d0ec3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.336929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc288002-8a17-426f-a204-5b4d82314997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f2046e3edc444eb1035a384e54787c, user_id=a0362afd4064418e9cd9e43e0ec93f0c, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.337829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33aa115-d9d6-40c2-ad1a-9399c47d0ec3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.343286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc288002-8a17-426f-a204-5b4d82314997 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.343716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6b00-d66f-4feb-8ff8-4f1e9f8b553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.344573 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6b00-d66f-4feb-8ff8-4f1e9f8b553f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.345086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6b00-d66f-4feb-8ff8-4f1e9f8b553f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.345389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6b00-d66f-4feb-8ff8-4f1e9f8b553f admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.346282 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d6b00-d66f-4feb-8ff8-4f1e9f8b553f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.348408 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d6b00-d66f-4feb-8ff8-4f1e9f8b553f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.362491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 796/1599] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:37 2022] PUT /identity/v3/projects/e3f2046e3edc444eb1035a384e54787c/users/a0362afd4064418e9cd9e43e0ec93f0c/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:37.363525 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc288002-8a17-426f-a204-5b4d82314997 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.365632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 804/1600] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:37.366619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6b00-d66f-4feb-8ff8-4f1e9f8b553f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.378444 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6b00-d66f-4feb-8ff8-4f1e9f8b553f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.453106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc288002-8a17-426f-a204-5b4d82314997 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.454214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616df67-3a4d-4b3c-a511-b9075c66f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.455324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616df67-3a4d-4b3c-a511-b9075c66f8be admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.455682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616df67-3a4d-4b3c-a511-b9075c66f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.455993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616df67-3a4d-4b3c-a511-b9075c66f8be admin admin] PATH_INFO: `/v3/projects/d048351d2ed44ed3a793e9d405936c6d/users/57a22b28dadc4360bdf01dbf5fcc67ef/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.458879 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be24415-d2dc-4461-b7cf-c801fc010632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.460504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be24415-d2dc-4461-b7cf-c801fc010632 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.460504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be24415-d2dc-4461-b7cf-c801fc010632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.460504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be24415-d2dc-4461-b7cf-c801fc010632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.461016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be24415-d2dc-4461-b7cf-c801fc010632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.462613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be24415-d2dc-4461-b7cf-c801fc010632 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.474564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 797/1601] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:37.475368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be24415-d2dc-4461-b7cf-c801fc010632 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.480003 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616df67-3a4d-4b3c-a511-b9075c66f8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d048351d2ed44ed3a793e9d405936c6d, user_id=57a22b28dadc4360bdf01dbf5fcc67ef, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.482820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616df67-3a4d-4b3c-a511-b9075c66f8be admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.486662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be24415-d2dc-4461-b7cf-c801fc010632 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.492675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6151f-2f49-4af7-a872-57a675940dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.493734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6151f-2f49-4af7-a872-57a675940dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.493734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6151f-2f49-4af7-a872-57a675940dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.494324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6151f-2f49-4af7-a872-57a675940dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.494642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6151f-2f49-4af7-a872-57a675940dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.496419 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6151f-2f49-4af7-a872-57a675940dd5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.499345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 805/1602] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:37 2022] PUT /identity/v3/projects/d048351d2ed44ed3a793e9d405936c6d/users/57a22b28dadc4360bdf01dbf5fcc67ef/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:37.500450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616df67-3a4d-4b3c-a511-b9075c66f8be admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.520516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 798/1603] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:37.521842 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6151f-2f49-4af7-a872-57a675940dd5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.537535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6151f-2f49-4af7-a872-57a675940dd5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.571702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:37.579314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:37.626400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616df67-3a4d-4b3c-a511-b9075c66f8be admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.631054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c7a49-2c23-4096-9043-b0a36a25d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.631834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7a49-2c23-4096-9043-b0a36a25d943 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.632181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7a49-2c23-4096-9043-b0a36a25d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.632570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7a49-2c23-4096-9043-b0a36a25d943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.633356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c7a49-2c23-4096-9043-b0a36a25d943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.634988 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c7a49-2c23-4096-9043-b0a36a25d943 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.646193 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43905e13-56e0-4265-a5b3-6a039020bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.647054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43905e13-56e0-4265-a5b3-6a039020bacd admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.647554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43905e13-56e0-4265-a5b3-6a039020bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.647956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43905e13-56e0-4265-a5b3-6a039020bacd admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.648869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43905e13-56e0-4265-a5b3-6a039020bacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.650622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43905e13-56e0-4265-a5b3-6a039020bacd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.652334 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 806/1604] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:37.653310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c7a49-2c23-4096-9043-b0a36a25d943 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.662927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 799/1605] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:37.664984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887f8d1-cb9f-46d9-b15a-0d5185b1d3d3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.665560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887f8d1-cb9f-46d9-b15a-0d5185b1d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.665765 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887f8d1-cb9f-46d9-b15a-0d5185b1d3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.670576 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c7a49-2c23-4096-9043-b0a36a25d943 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.677519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693e968-12ec-4108-ac05-894c302046c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.678598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e968-12ec-4108-ac05-894c302046c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.678890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e968-12ec-4108-ac05-894c302046c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.679180 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e968-12ec-4108-ac05-894c302046c2 admin admin] PATH_INFO: `/v3/projects/eaa930186f1447c6a945a70a7a66a4ea/users/3a314122deb44fc8b1be75e6b0311451/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.704244 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693e968-12ec-4108-ac05-894c302046c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa930186f1447c6a945a70a7a66a4ea, user_id=3a314122deb44fc8b1be75e6b0311451, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.707562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693e968-12ec-4108-ac05-894c302046c2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.709760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9887f8d1-cb9f-46d9-b15a-0d5185b1d3d3 None None] MFA Rules not processed for user `a0362afd4064418e9cd9e43e0ec93f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:37.711246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9887f8d1-cb9f-46d9-b15a-0d5185b1d3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:37.735495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 807/1606] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:37 2022] PUT /identity/v3/projects/eaa930186f1447c6a945a70a7a66a4ea/users/3a314122deb44fc8b1be75e6b0311451/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:37.736979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693e968-12ec-4108-ac05-894c302046c2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.815492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 800/1607] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:37.816941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0ee2a-0a3e-4cb4-8ddd-5879c1feb0f1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.817263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0ee2a-0a3e-4cb4-8ddd-5879c1feb0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.817547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0ee2a-0a3e-4cb4-8ddd-5879c1feb0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.850310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693e968-12ec-4108-ac05-894c302046c2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:37.861767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52117daa-5cdf-4033-abda-f95e193d4d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:37.863003 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-97f0ee2a-0a3e-4cb4-8ddd-5879c1feb0f1 None None] MFA Rules not processed for user `57a22b28dadc4360bdf01dbf5fcc67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:37.863272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52117daa-5cdf-4033-abda-f95e193d4d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:37.863959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52117daa-5cdf-4033-abda-f95e193d4d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:37.864534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52117daa-5cdf-4033-abda-f95e193d4d62 admin admin] PATH_INFO: `/v3/projects/4b94dc2b731a47408e97fef37b3770c6/users/29b465d5c26f4071a88eb65d73edac2f/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:37.865249 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-97f0ee2a-0a3e-4cb4-8ddd-5879c1feb0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:37.892765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52117daa-5cdf-4033-abda-f95e193d4d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b94dc2b731a47408e97fef37b3770c6, user_id=29b465d5c26f4071a88eb65d73edac2f, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:37.899612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52117daa-5cdf-4033-abda-f95e193d4d62 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:37.935820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 808/1608] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:37 2022] PUT /identity/v3/projects/4b94dc2b731a47408e97fef37b3770c6/users/29b465d5c26f4071a88eb65d73edac2f/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:37.937581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52117daa-5cdf-4033-abda-f95e193d4d62 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.963235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 801/1609] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:37.975602 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0ee2a-0a3e-4cb4-8ddd-5879c1feb0f1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:37.995668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0ee2a-0a3e-4cb4-8ddd-5879c1feb0f1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:38.042464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:38.058154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52117daa-5cdf-4033-abda-f95e193d4d62 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:38.065304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c632f-0daa-4b87-871b-e20812e98e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:38.066328 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c632f-0daa-4b87-871b-e20812e98e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.066619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c632f-0daa-4b87-871b-e20812e98e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.066930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c632f-0daa-4b87-871b-e20812e98e78 admin admin] PATH_INFO: `/v3/projects/460ace684cf746f49212e98dcdb556ce/users/0383866c48dc4e6a99608d3079d15ba3/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.075670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47ca77-d3f3-44c7-99be-e5a9b7883583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:38.076978 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47ca77-d3f3-44c7-99be-e5a9b7883583 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.077501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47ca77-d3f3-44c7-99be-e5a9b7883583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.078414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47ca77-d3f3-44c7-99be-e5a9b7883583 admin admin] PATH_INFO: `/v3/projects/06be5826a11e438fb7d87f2d37678e22/users/0c4b2c84be7d4670a7232ae93db14740/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.084890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c632f-0daa-4b87-871b-e20812e98e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460ace684cf746f49212e98dcdb556ce, user_id=0383866c48dc4e6a99608d3079d15ba3, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:38.088401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c632f-0daa-4b87-871b-e20812e98e78 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:38.100833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47ca77-d3f3-44c7-99be-e5a9b7883583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06be5826a11e438fb7d87f2d37678e22, user_id=0c4b2c84be7d4670a7232ae93db14740, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:38.105126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47ca77-d3f3-44c7-99be-e5a9b7883583 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:38.105503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 809/1610] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:37 2022] PUT /identity/v3/projects/460ace684cf746f49212e98dcdb556ce/users/0383866c48dc4e6a99608d3079d15ba3/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:38.106468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c632f-0daa-4b87-871b-e20812e98e78 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:38.130223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 802/1611] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:37 2022] PUT /identity/v3/projects/06be5826a11e438fb7d87f2d37678e22/users/0c4b2c84be7d4670a7232ae93db14740/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:38.130223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131a33d-50ac-46d5-a673-8a0e252b21f9 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.130223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131a33d-50ac-46d5-a673-8a0e252b21f9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.130223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131a33d-50ac-46d5-a673-8a0e252b21f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.146878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:38.192603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a131a33d-50ac-46d5-a673-8a0e252b21f9 None None] MFA Rules not processed for user `3a314122deb44fc8b1be75e6b0311451`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:38.194781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a131a33d-50ac-46d5-a673-8a0e252b21f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:38.223915 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c632f-0daa-4b87-871b-e20812e98e78 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:38.326885 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 803/1612] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:38.328910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f32ff-55d2-43d7-b0cf-7a974b083c8d None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.329835 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f32ff-55d2-43d7-b0cf-7a974b083c8d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.330641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f32ff-55d2-43d7-b0cf-7a974b083c8d None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.333106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 804/1613] 10.222.0.64 () {54 vars in 961 bytes} [Fri Jul 15 15:25:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:25:38.340728 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba352a-c66d-42fb-84e4-a8048351aef1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.345326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba352a-c66d-42fb-84e4-a8048351aef1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.346079 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba352a-c66d-42fb-84e4-a8048351aef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.349767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeeaacf-2f84-481e-839e-c3207bd57907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:38.350847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeaacf-2f84-481e-839e-c3207bd57907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.351241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeaacf-2f84-481e-839e-c3207bd57907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.351567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeaacf-2f84-481e-839e-c3207bd57907 admin admin] PATH_INFO: `/v3/projects/1c192a53b9ef4d45bd84ffe7dd7b1126/users/52bdac6f66c642ea9c4bcba52317d1ae/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.367667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-88ba352a-c66d-42fb-84e4-a8048351aef1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:38.369122 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-88ba352a-c66d-42fb-84e4-a8048351aef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:38.378395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 805/1614] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:38.379980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b01bf9-2f34-479a-9121-eddfec6b9245 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.380178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b01bf9-2f34-479a-9121-eddfec6b9245 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.380443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b01bf9-2f34-479a-9121-eddfec6b9245 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.382066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 806/1615] 10.222.0.64 () {54 vars in 961 bytes} [Fri Jul 15 15:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:25:38.383819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2362ae-a7c0-4157-964e-498f0d7cda0b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.384116 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2362ae-a7c0-4157-964e-498f0d7cda0b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.384400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2362ae-a7c0-4157-964e-498f0d7cda0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.391806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeeaacf-2f84-481e-839e-c3207bd57907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c192a53b9ef4d45bd84ffe7dd7b1126, user_id=52bdac6f66c642ea9c4bcba52317d1ae, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:38.396261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeeaacf-2f84-481e-839e-c3207bd57907 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:38.408604 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-db2362ae-a7c0-4157-964e-498f0d7cda0b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:38.410869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-db2362ae-a7c0-4157-964e-498f0d7cda0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:38.430277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 810/1616] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:38 2022] PUT /identity/v3/projects/1c192a53b9ef4d45bd84ffe7dd7b1126/users/52bdac6f66c642ea9c4bcba52317d1ae/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:38.431344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af26d-4500-4859-b961-7a5455df87e8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.431711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af26d-4500-4859-b961-7a5455df87e8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.431992 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af26d-4500-4859-b961-7a5455df87e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.460683 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-973af26d-4500-4859-b961-7a5455df87e8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:38.462384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-973af26d-4500-4859-b961-7a5455df87e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:38.525443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 807/1617] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:38.526612 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2362ae-a7c0-4157-964e-498f0d7cda0b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:38.543051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 811/1618] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:38.543051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26fcd0-f80b-4b1a-80b5-a568cfe996f5 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.543051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26fcd0-f80b-4b1a-80b5-a568cfe996f5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.543051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26fcd0-f80b-4b1a-80b5-a568cfe996f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.549904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2362ae-a7c0-4157-964e-498f0d7cda0b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:38.558406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9bbe-8b0a-48d0-a5d4-a4b9a6ecbedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:38.560323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9bbe-8b0a-48d0-a5d4-a4b9a6ecbedf admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.560563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9bbe-8b0a-48d0-a5d4-a4b9a6ecbedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.561181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9bbe-8b0a-48d0-a5d4-a4b9a6ecbedf admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.563990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9bbe-8b0a-48d0-a5d4-a4b9a6ecbedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:38.567613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9bbe-8b0a-48d0-a5d4-a4b9a6ecbedf admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:38.605252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ca26fcd0-f80b-4b1a-80b5-a568cfe996f5 None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:38.607119 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ca26fcd0-f80b-4b1a-80b5-a568cfe996f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:38.615104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 808/1619] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:38 2022] POST /identity/v3/projects => generated 353 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:38.616316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60594-442e-41cf-97e1-6b607da5f4b2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.616614 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60594-442e-41cf-97e1-6b607da5f4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.617504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60594-442e-41cf-97e1-6b607da5f4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.650208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-cfb60594-442e-41cf-97e1-6b607da5f4b2 None None] MFA Rules not processed for user `252502cd22264ce99d942048de462454`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:38.651586 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cfb60594-442e-41cf-97e1-6b607da5f4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:38.658990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:38.662678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:38.712548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 812/1620] 10.222.0.64 () {58 vars in 1058 bytes} [Fri Jul 15 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:38.714263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26fcd0-f80b-4b1a-80b5-a568cfe996f5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:38.729896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 809/1621] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:38.732221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70702530-1f7f-498b-85c4-1096b14573eb None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.732805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70702530-1f7f-498b-85c4-1096b14573eb None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.733554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70702530-1f7f-498b-85c4-1096b14573eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.763294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-70702530-1f7f-498b-85c4-1096b14573eb None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:38.764966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-70702530-1f7f-498b-85c4-1096b14573eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:38.787383 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26fcd0-f80b-4b1a-80b5-a568cfe996f5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:38.843905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a2248-54d3-4f2a-ab1e-ccff15fb7336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:38.844572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a2248-54d3-4f2a-ab1e-ccff15fb7336 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.844856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a2248-54d3-4f2a-ab1e-ccff15fb7336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.845160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a2248-54d3-4f2a-ab1e-ccff15fb7336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.861301 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 810/1622] 10.222.0.64 () {58 vars in 1058 bytes} [Fri Jul 15 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:38.866217 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70702530-1f7f-498b-85c4-1096b14573eb None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:38.929273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a2248-54d3-4f2a-ab1e-ccff15fb7336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:38.931727 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a2248-54d3-4f2a-ab1e-ccff15fb7336 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:38.943569 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 813/1623] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:38.944487 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a2248-54d3-4f2a-ab1e-ccff15fb7336 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:38.949717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70702530-1f7f-498b-85c4-1096b14573eb None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:38.954822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a2248-54d3-4f2a-ab1e-ccff15fb7336 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:38.958061 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774a28b-b727-4b52-bc02-43d45a7ea25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:38.958612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74f988-dc6a-4db2-a9a5-99c73c67cb40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:38.959232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74f988-dc6a-4db2-a9a5-99c73c67cb40 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.959385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774a28b-b727-4b52-bc02-43d45a7ea25a admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:38.959617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74f988-dc6a-4db2-a9a5-99c73c67cb40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.959785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774a28b-b727-4b52-bc02-43d45a7ea25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:38.959914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74f988-dc6a-4db2-a9a5-99c73c67cb40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.961248 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774a28b-b727-4b52-bc02-43d45a7ea25a admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:38.962662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774a28b-b727-4b52-bc02-43d45a7ea25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:38.965837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774a28b-b727-4b52-bc02-43d45a7ea25a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:38.971345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74f988-dc6a-4db2-a9a5-99c73c67cb40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:38.972965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74f988-dc6a-4db2-a9a5-99c73c67cb40 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:38.982262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 811/1624] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:38.983426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774a28b-b727-4b52-bc02-43d45a7ea25a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:38.991195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 814/1625] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:38.993563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74f988-dc6a-4db2-a9a5-99c73c67cb40 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:39.000006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774a28b-b727-4b52-bc02-43d45a7ea25a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.005708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e5dce-3279-46cf-8132-ffb949d3f10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.006557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e5dce-3279-46cf-8132-ffb949d3f10c service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.006916 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74f988-dc6a-4db2-a9a5-99c73c67cb40 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.007109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e5dce-3279-46cf-8132-ffb949d3f10c service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.007432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e5dce-3279-46cf-8132-ffb949d3f10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.012806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed67d8-1483-468e-9e33-292abad94305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.013759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed67d8-1483-468e-9e33-292abad94305 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.014060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed67d8-1483-468e-9e33-292abad94305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.014343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed67d8-1483-468e-9e33-292abad94305 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.015078 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed67d8-1483-468e-9e33-292abad94305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:39.017690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed67d8-1483-468e-9e33-292abad94305 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:39.021928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e5dce-3279-46cf-8132-ffb949d3f10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:39.023930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e5dce-3279-46cf-8132-ffb949d3f10c service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:39.041768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 812/1626] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:39.042331 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 815/1627] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:38 2022] POST /identity/v3/users => generated 283 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:39.043341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed67d8-1483-468e-9e33-292abad94305 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:39.046724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e5dce-3279-46cf-8132-ffb949d3f10c service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:39.055269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed67d8-1483-468e-9e33-292abad94305 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.061675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7350a4-364f-44f0-8535-995c26fb5c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.061981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e5dce-3279-46cf-8132-ffb949d3f10c service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.062177 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7350a4-364f-44f0-8535-995c26fb5c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.062560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7350a4-364f-44f0-8535-995c26fb5c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.062746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7350a4-364f-44f0-8535-995c26fb5c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.063678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7350a4-364f-44f0-8535-995c26fb5c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:39.065619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7350a4-364f-44f0-8535-995c26fb5c77 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:39.068910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32156cc-24b7-4789-b9a2-02ec48d16a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.069361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:39.069941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32156cc-24b7-4789-b9a2-02ec48d16a84 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.070380 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32156cc-24b7-4789-b9a2-02ec48d16a84 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.070788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32156cc-24b7-4789-b9a2-02ec48d16a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.107442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:39.121782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 816/1628] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:39 2022] POST /identity/v3/projects => generated 403 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:39.123977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7350a4-364f-44f0-8535-995c26fb5c77 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:39.154094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32156cc-24b7-4789-b9a2-02ec48d16a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:39.155749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32156cc-24b7-4789-b9a2-02ec48d16a84 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:39.168629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 813/1629] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:39.169330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32156cc-24b7-4789-b9a2-02ec48d16a84 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:39.184046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32156cc-24b7-4789-b9a2-02ec48d16a84 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.255459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7350a4-364f-44f0-8535-995c26fb5c77 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.263917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e28f03-afdc-41db-b3aa-5e536f1a203a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.265413 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e28f03-afdc-41db-b3aa-5e536f1a203a service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.265749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e28f03-afdc-41db-b3aa-5e536f1a203a service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.265954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e28f03-afdc-41db-b3aa-5e536f1a203a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.295658 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc0880-daf3-409e-aa89-ce1e97d64c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.297077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc0880-daf3-409e-aa89-ce1e97d64c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.297762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc0880-daf3-409e-aa89-ce1e97d64c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.299407 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc0880-daf3-409e-aa89-ce1e97d64c41 admin admin] PATH_INFO: `/v3/projects/1c192a53b9ef4d45bd84ffe7dd7b1126/users/52bdac6f66c642ea9c4bcba52317d1ae/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.307191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc0880-daf3-409e-aa89-ce1e97d64c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c192a53b9ef4d45bd84ffe7dd7b1126, user_id=52bdac6f66c642ea9c4bcba52317d1ae, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:39.316542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc0880-daf3-409e-aa89-ce1e97d64c41 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:39.340498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e28f03-afdc-41db-b3aa-5e536f1a203a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:39.342274 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e28f03-afdc-41db-b3aa-5e536f1a203a service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:39.355161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 814/1630] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:39 2022] PUT /identity/v3/projects/1c192a53b9ef4d45bd84ffe7dd7b1126/users/52bdac6f66c642ea9c4bcba52317d1ae/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:39.357754 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc0880-daf3-409e-aa89-ce1e97d64c41 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:39.364981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 817/1631] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:39.365981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e28f03-afdc-41db-b3aa-5e536f1a203a service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:39.396817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e28f03-afdc-41db-b3aa-5e536f1a203a service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.454405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc0880-daf3-409e-aa89-ce1e97d64c41 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.460640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cfedb-33ee-4679-a44d-9202e95f6141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.461465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cfedb-33ee-4679-a44d-9202e95f6141 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.461826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cfedb-33ee-4679-a44d-9202e95f6141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.462348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cfedb-33ee-4679-a44d-9202e95f6141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.463325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cfedb-33ee-4679-a44d-9202e95f6141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:39.465564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cfedb-33ee-4679-a44d-9202e95f6141 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:39.483227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 815/1632] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:39.485987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321881-b04c-4e2d-9e57-a183b600c1c3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.486396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321881-b04c-4e2d-9e57-a183b600c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.487524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321881-b04c-4e2d-9e57-a183b600c1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.520288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86546a55-5be2-43ce-bf04-3fc31c525c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.520288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86546a55-5be2-43ce-bf04-3fc31c525c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.520288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86546a55-5be2-43ce-bf04-3fc31c525c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.520712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86546a55-5be2-43ce-bf04-3fc31c525c08 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.521505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86546a55-5be2-43ce-bf04-3fc31c525c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:39.524092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86546a55-5be2-43ce-bf04-3fc31c525c08 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:39.531957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4c321881-b04c-4e2d-9e57-a183b600c1c3 None None] MFA Rules not processed for user `52bdac6f66c642ea9c4bcba52317d1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:39.534129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4c321881-b04c-4e2d-9e57-a183b600c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:39.562850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 818/1633] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:39 2022] POST /identity/v3/users => generated 308 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:39.565653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766b6b1-3a52-4585-9b55-f9bf78b43305 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.566044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766b6b1-3a52-4585-9b55-f9bf78b43305 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.566367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766b6b1-3a52-4585-9b55-f9bf78b43305 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.568365 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 819/1634] 10.222.0.64 () {54 vars in 912 bytes} [Fri Jul 15 15:25:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:25:39.576849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766b6b1-3a52-4585-9b55-f9bf78b43305 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:39.599715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766b6b1-3a52-4585-9b55-f9bf78b43305 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.605143 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a6938-046e-4676-9f89-bdc26e965c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.606068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a6938-046e-4676-9f89-bdc26e965c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.606358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a6938-046e-4676-9f89-bdc26e965c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.607361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a6938-046e-4676-9f89-bdc26e965c83 admin admin] PATH_INFO: `/v3/projects/5bf9e9af58bf4f3b88b9257f3e543e62/users/468afd3921a14a80b11eb2480e5bad94/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.628205 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:39.642255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:39.647550 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a6938-046e-4676-9f89-bdc26e965c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf9e9af58bf4f3b88b9257f3e543e62, user_id=468afd3921a14a80b11eb2480e5bad94, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:39.653005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a6938-046e-4676-9f89-bdc26e965c83 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:39.678781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 820/1635] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:39 2022] PUT /identity/v3/projects/5bf9e9af58bf4f3b88b9257f3e543e62/users/468afd3921a14a80b11eb2480e5bad94/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:39.680634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a6938-046e-4676-9f89-bdc26e965c83 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:39.688119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 816/1636] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:39.695802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ee352-0055-45fb-80d3-c320f9bde5b2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.697138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ee352-0055-45fb-80d3-c320f9bde5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.697551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ee352-0055-45fb-80d3-c320f9bde5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.723982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c35ee352-0055-45fb-80d3-c320f9bde5b2 None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:39.725891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c35ee352-0055-45fb-80d3-c320f9bde5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:39.792211 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a6938-046e-4676-9f89-bdc26e965c83 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.800154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543c2d8-9abe-453f-96fb-44562b9b69e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.801056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543c2d8-9abe-453f-96fb-44562b9b69e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.801818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543c2d8-9abe-453f-96fb-44562b9b69e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.802217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543c2d8-9abe-453f-96fb-44562b9b69e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.806393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543c2d8-9abe-453f-96fb-44562b9b69e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:39.812311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543c2d8-9abe-453f-96fb-44562b9b69e8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:39.846527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 821/1637] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:39.847893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543c2d8-9abe-453f-96fb-44562b9b69e8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:39.862752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543c2d8-9abe-453f-96fb-44562b9b69e8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.867590 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 817/1638] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:25:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:39.868853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ee352-0055-45fb-80d3-c320f9bde5b2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:39.882053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022911b-db14-437d-88c2-1663a1378290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.882943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022911b-db14-437d-88c2-1663a1378290 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.883292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022911b-db14-437d-88c2-1663a1378290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.883619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022911b-db14-437d-88c2-1663a1378290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.889139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022911b-db14-437d-88c2-1663a1378290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:39.889139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022911b-db14-437d-88c2-1663a1378290 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:39.913383 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 822/1639] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:39.915251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022911b-db14-437d-88c2-1663a1378290 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:39.932466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022911b-db14-437d-88c2-1663a1378290 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.939561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94876f-89b5-401a-9c37-142be4be6a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.941052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94876f-89b5-401a-9c37-142be4be6a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.941564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94876f-89b5-401a-9c37-142be4be6a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.942035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94876f-89b5-401a-9c37-142be4be6a19 admin admin] PATH_INFO: `/v3/projects/f38fff7bca1e4f0795b2deefeda78a71/users/46396aa4f551445d9825d24f81a0a457/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.945765 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ee352-0055-45fb-80d3-c320f9bde5b2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:39.950991 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee41ea-4f3c-42c8-ada3-68e78e83cf98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:39.951872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee41ea-4f3c-42c8-ada3-68e78e83cf98 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:39.952273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee41ea-4f3c-42c8-ada3-68e78e83cf98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:39.952699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee41ea-4f3c-42c8-ada3-68e78e83cf98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:39.977387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94876f-89b5-401a-9c37-142be4be6a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38fff7bca1e4f0795b2deefeda78a71, user_id=46396aa4f551445d9825d24f81a0a457, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:39.983250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94876f-89b5-401a-9c37-142be4be6a19 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:40.005731 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 823/1640] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:39 2022] PUT /identity/v3/projects/f38fff7bca1e4f0795b2deefeda78a71/users/46396aa4f551445d9825d24f81a0a457/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:40.010183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94876f-89b5-401a-9c37-142be4be6a19 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:40.034071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee41ea-4f3c-42c8-ada3-68e78e83cf98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:40.036028 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee41ea-4f3c-42c8-ada3-68e78e83cf98 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:40.049344 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 818/1641] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:40.050440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee41ea-4f3c-42c8-ada3-68e78e83cf98 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:40.064103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee41ea-4f3c-42c8-ada3-68e78e83cf98 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:40.087539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:40.122128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94876f-89b5-401a-9c37-142be4be6a19 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:40.135380 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dee75-c66c-4b15-b685-706085974a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:40.136138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905d52b-c854-430e-aa99-c29ed43a9419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:40.136781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dee75-c66c-4b15-b685-706085974a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:40.136919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905d52b-c854-430e-aa99-c29ed43a9419 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:40.137300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dee75-c66c-4b15-b685-706085974a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:40.137477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905d52b-c854-430e-aa99-c29ed43a9419 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:40.137761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905d52b-c854-430e-aa99-c29ed43a9419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:40.137963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dee75-c66c-4b15-b685-706085974a08 admin admin] PATH_INFO: `/v3/projects/5bf9e9af58bf4f3b88b9257f3e543e62/users/468afd3921a14a80b11eb2480e5bad94/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:40.140571 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dee75-c66c-4b15-b685-706085974a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf9e9af58bf4f3b88b9257f3e543e62, user_id=468afd3921a14a80b11eb2480e5bad94, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:40.144323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dee75-c66c-4b15-b685-706085974a08 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:40.159687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 819/1642] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:40 2022] PUT /identity/v3/projects/5bf9e9af58bf4f3b88b9257f3e543e62/users/468afd3921a14a80b11eb2480e5bad94/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:40.161500 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d29aab-2cb2-48a1-a9b9-ae01e3b3b7a3 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:40.161867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d29aab-2cb2-48a1-a9b9-ae01e3b3b7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:40.162222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d29aab-2cb2-48a1-a9b9-ae01e3b3b7a3 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:40.164559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 820/1643] 10.222.0.64 () {54 vars in 912 bytes} [Fri Jul 15 15:25:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:25:40.165516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d29aab-2cb2-48a1-a9b9-ae01e3b3b7a3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:40.329885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:40.338917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d29aab-2cb2-48a1-a9b9-ae01e3b3b7a3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:40.362472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f89a5-86a0-49cc-8320-7b6a94f9c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:40.366654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f89a5-86a0-49cc-8320-7b6a94f9c1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:40.367122 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f89a5-86a0-49cc-8320-7b6a94f9c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:40.367643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f89a5-86a0-49cc-8320-7b6a94f9c1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:40.370236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f89a5-86a0-49cc-8320-7b6a94f9c1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:40.375893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f89a5-86a0-49cc-8320-7b6a94f9c1c9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:40.380214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905d52b-c854-430e-aa99-c29ed43a9419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:40.386621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905d52b-c854-430e-aa99-c29ed43a9419 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:40.410865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 821/1644] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:40.413156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f89a5-86a0-49cc-8320-7b6a94f9c1c9 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:40.427030 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 824/1645] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:40.428739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061a85c-e797-40c0-a905-2ee51aa9f0c7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:40.430483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061a85c-e797-40c0-a905-2ee51aa9f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:40.431175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061a85c-e797-40c0-a905-2ee51aa9f0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:40.478834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0061a85c-e797-40c0-a905-2ee51aa9f0c7 None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:40.481127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0061a85c-e797-40c0-a905-2ee51aa9f0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:40.550361 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f89a5-86a0-49cc-8320-7b6a94f9c1c9 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:40.555388 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedfe29-d8e6-44c8-81ad-bab3af143696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:40.557159 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedfe29-d8e6-44c8-81ad-bab3af143696 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:40.557700 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedfe29-d8e6-44c8-81ad-bab3af143696 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:40.558258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedfe29-d8e6-44c8-81ad-bab3af143696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:40.659906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 825/1646] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:25:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:40.661468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f71a1-926c-46c6-89cc-c4b89f4828c1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:40.661909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f71a1-926c-46c6-89cc-c4b89f4828c1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:40.662197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f71a1-926c-46c6-89cc-c4b89f4828c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:40.706788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedfe29-d8e6-44c8-81ad-bab3af143696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:40.708418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedfe29-d8e6-44c8-81ad-bab3af143696 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:40.728752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-125f71a1-926c-46c6-89cc-c4b89f4828c1 None None] MFA Rules not processed for user `468afd3921a14a80b11eb2480e5bad94`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:40.731604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-125f71a1-926c-46c6-89cc-c4b89f4828c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:40.732322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 822/1647] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:40.734257 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedfe29-d8e6-44c8-81ad-bab3af143696 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:40.775793 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedfe29-d8e6-44c8-81ad-bab3af143696 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:40.797211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d68b72-633a-4fb0-95c6-10b277bee016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:40.798361 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d68b72-633a-4fb0-95c6-10b277bee016 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:40.798652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d68b72-633a-4fb0-95c6-10b277bee016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:40.798992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d68b72-633a-4fb0-95c6-10b277bee016 admin admin] PATH_INFO: `/v3/projects/f38fff7bca1e4f0795b2deefeda78a71/users/46396aa4f551445d9825d24f81a0a457/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:40.804914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d68b72-633a-4fb0-95c6-10b277bee016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38fff7bca1e4f0795b2deefeda78a71, user_id=46396aa4f551445d9825d24f81a0a457, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:40.808221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d68b72-633a-4fb0-95c6-10b277bee016 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:40.810869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:40.837893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 823/1648] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:40 2022] PUT /identity/v3/projects/f38fff7bca1e4f0795b2deefeda78a71/users/46396aa4f551445d9825d24f81a0a457/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:40.935858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 826/1649] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:40 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:41.537573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d68b72-633a-4fb0-95c6-10b277bee016 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:41.724977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d68b72-633a-4fb0-95c6-10b277bee016 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:41.738651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdf13b-8181-4d47-8ead-59a2f13c2d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:41.739334 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdf13b-8181-4d47-8ead-59a2f13c2d15 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:41.739623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdf13b-8181-4d47-8ead-59a2f13c2d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:41.740369 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdf13b-8181-4d47-8ead-59a2f13c2d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:41.741349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f71a1-926c-46c6-89cc-c4b89f4828c1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:41.758616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f71a1-926c-46c6-89cc-c4b89f4828c1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:41.767214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a063a-296f-4acd-8772-40918abf6b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:41.768580 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a063a-296f-4acd-8772-40918abf6b63 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:41.768871 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a063a-296f-4acd-8772-40918abf6b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:41.771564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a063a-296f-4acd-8772-40918abf6b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:41.909997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdf13b-8181-4d47-8ead-59a2f13c2d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:41.913164 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdf13b-8181-4d47-8ead-59a2f13c2d15 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:41.952552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 824/1650] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:25:42.077220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a063a-296f-4acd-8772-40918abf6b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:42.088438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a063a-296f-4acd-8772-40918abf6b63 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:42.107441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:42.134211 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 827/1651] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:41 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:25:42.433726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdf13b-8181-4d47-8ead-59a2f13c2d15 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:42.448365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdf13b-8181-4d47-8ead-59a2f13c2d15 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:42.448521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a063a-296f-4acd-8772-40918abf6b63 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:42.486382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17322d55-2501-4ebf-bfcd-d1b4757d44d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:42.486382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17322d55-2501-4ebf-bfcd-d1b4757d44d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:42.486382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17322d55-2501-4ebf-bfcd-d1b4757d44d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:42.486382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17322d55-2501-4ebf-bfcd-d1b4757d44d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:42.612066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17322d55-2501-4ebf-bfcd-d1b4757d44d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:42.616019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a063a-296f-4acd-8772-40918abf6b63 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:42.617470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17322d55-2501-4ebf-bfcd-d1b4757d44d9 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:42.630499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:42.631409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:42.631692 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:42.631984 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] PATH_INFO: `/v3/users/57a22b28dadc4360bdf01dbf5fcc67ef` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:42.637261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 825/1652] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:42 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:42.637769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a22b28dadc4360bdf01dbf5fcc67ef)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:42.639976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:42.728295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a22b28dadc4360bdf01dbf5fcc67ef'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:42.754510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a22b28dadc4360bdf01dbf5fcc67ef'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:42.767687 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a22b28dadc4360bdf01dbf5fcc67ef'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:42.784363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a22b28dadc4360bdf01dbf5fcc67ef'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:42.785303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a22b28dadc4360bdf01dbf5fcc67ef'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:42.807672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 828/1653] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:25:42 2022] DELETE /identity/v3/users/57a22b28dadc4360bdf01dbf5fcc67ef => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:25:42.810570 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38178c1-2786-4a77-92b6-48f8f3ae5e79 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:42.810925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38178c1-2786-4a77-92b6-48f8f3ae5e79 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:42.811308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38178c1-2786-4a77-92b6-48f8f3ae5e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:42.851483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c38178c1-2786-4a77-92b6-48f8f3ae5e79 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:42.856065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c38178c1-2786-4a77-92b6-48f8f3ae5e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:42.935340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:43.019824 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 826/1654] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:25:43.078236 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:43.079718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:43.194019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baaaa9-d495-427d-b403-fc274a824dfd admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:43.201088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3857114-e479-4695-8095-74a4e2b765ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:43.202031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3857114-e479-4695-8095-74a4e2b765ab service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:43.202258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3857114-e479-4695-8095-74a4e2b765ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:43.202535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3857114-e479-4695-8095-74a4e2b765ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:43.217149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3857114-e479-4695-8095-74a4e2b765ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:43.218856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3857114-e479-4695-8095-74a4e2b765ab service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:43.237866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 829/1655] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:43.547473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83169d00-fd39-4d3a-86c6-2fa705853b2e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:43.549143 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83169d00-fd39-4d3a-86c6-2fa705853b2e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:43.549905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83169d00-fd39-4d3a-86c6-2fa705853b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:43.649925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-83169d00-fd39-4d3a-86c6-2fa705853b2e None None] MFA Rules not processed for user `46396aa4f551445d9825d24f81a0a457`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:43.651328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-83169d00-fd39-4d3a-86c6-2fa705853b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:43.901338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 827/1656] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:44.650376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3857114-e479-4695-8095-74a4e2b765ab service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:44.652420 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b3857114-e479-4695-8095-74a4e2b765ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:44.688256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3857114-e479-4695-8095-74a4e2b765ab service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:44.709357 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:44.710263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:44.710576 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:44.710991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] PATH_INFO: `/v3/projects/d048351d2ed44ed3a793e9d405936c6d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:44.718235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d048351d2ed44ed3a793e9d405936c6d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:44.719697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:25:44.719697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 15 15:25:44.719697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: Jul 15 15:25:44.721007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:44.781523 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:44.879604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd048351d2ed44ed3a793e9d405936c6d', 'request_id': 'req-6912ba08-6725-4802-b5ab-efc635106179'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:44.915593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd048351d2ed44ed3a793e9d405936c6d', 'request_id': 'req-6912ba08-6725-4802-b5ab-efc635106179'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:44.930497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd048351d2ed44ed3a793e9d405936c6d', 'request_id': 'req-6912ba08-6725-4802-b5ab-efc635106179'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:44.986227 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] The token cache is being invalidate because project d048351d2ed44ed3a793e9d405936c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:25:44.986698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:44.990880 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6912ba08-6725-4802-b5ab-efc635106179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:44.998650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 830/1657] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:25:44 2022] DELETE /identity/v3/projects/d048351d2ed44ed3a793e9d405936c6d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:25:45.003563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ccad7-d456-41de-aad3-1c5935e5a683 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:45.004104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ccad7-d456-41de-aad3-1c5935e5a683 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:45.004182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ccad7-d456-41de-aad3-1c5935e5a683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:45.092279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ca5ccad7-d456-41de-aad3-1c5935e5a683 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:45.093653 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ca5ccad7-d456-41de-aad3-1c5935e5a683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:45.364665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 828/1658] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:45.375084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb57711-9d86-4967-a358-8fe3f76532ef None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:45.375699 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb57711-9d86-4967-a358-8fe3f76532ef None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:45.375995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb57711-9d86-4967-a358-8fe3f76532ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:45.433366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fcb57711-9d86-4967-a358-8fe3f76532ef None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:45.437938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fcb57711-9d86-4967-a358-8fe3f76532ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:45.461603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ccad7-d456-41de-aad3-1c5935e5a683 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:45.461965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 831/1659] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:45.479516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ccad7-d456-41de-aad3-1c5935e5a683 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:45.507368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aa785-df60-41cb-be6d-4c452051ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:45.513315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aa785-df60-41cb-be6d-4c452051ad20 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:45.513740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aa785-df60-41cb-be6d-4c452051ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:45.514121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aa785-df60-41cb-be6d-4c452051ad20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:45.514996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aa785-df60-41cb-be6d-4c452051ad20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:25:45.515329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aa785-df60-41cb-be6d-4c452051ad20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:45.522744 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aa785-df60-41cb-be6d-4c452051ad20 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:45.558706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 829/1660] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:25:45.559139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb57711-9d86-4967-a358-8fe3f76532ef None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:45.571775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb57711-9d86-4967-a358-8fe3f76532ef None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:45.586223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43020cd8-5c00-4378-97fd-abcbebfce87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:45.587681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43020cd8-5c00-4378-97fd-abcbebfce87e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:45.588055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43020cd8-5c00-4378-97fd-abcbebfce87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:45.588590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43020cd8-5c00-4378-97fd-abcbebfce87e admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:45.589528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43020cd8-5c00-4378-97fd-abcbebfce87e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:45.592006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43020cd8-5c00-4378-97fd-abcbebfce87e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:45.697507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 832/1661] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:45 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:25:45.699798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aa785-df60-41cb-be6d-4c452051ad20 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:45.725572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aa785-df60-41cb-be6d-4c452051ad20 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:45.945443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:46.047254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88730bbb-2e12-4912-9220-4cdc8c1ddb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:46.050773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88730bbb-2e12-4912-9220-4cdc8c1ddb05 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:46.052494 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88730bbb-2e12-4912-9220-4cdc8c1ddb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:46.055123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88730bbb-2e12-4912-9220-4cdc8c1ddb05 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:46.058726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88730bbb-2e12-4912-9220-4cdc8c1ddb05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:46.067785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88730bbb-2e12-4912-9220-4cdc8c1ddb05 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:46.140777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 830/1662] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:45 2022] POST /identity/v3/users => generated 291 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:46.146154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43020cd8-5c00-4378-97fd-abcbebfce87e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:46.204929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43020cd8-5c00-4378-97fd-abcbebfce87e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:46.246606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8a073-2541-4654-8c00-f519ec33fb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:46.247536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8a073-2541-4654-8c00-f519ec33fb18 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:46.248297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8a073-2541-4654-8c00-f519ec33fb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:46.249228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8a073-2541-4654-8c00-f519ec33fb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:46.256427 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8a073-2541-4654-8c00-f519ec33fb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:46.281306 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8a073-2541-4654-8c00-f519ec33fb18 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:46.328091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 833/1663] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:46.332093 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88730bbb-2e12-4912-9220-4cdc8c1ddb05 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:46.349756 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88730bbb-2e12-4912-9220-4cdc8c1ddb05 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:46.369616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0db4b-10f7-4558-8911-f2939da1f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:46.371099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0db4b-10f7-4558-8911-f2939da1f1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:46.371382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0db4b-10f7-4558-8911-f2939da1f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:46.373530 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0db4b-10f7-4558-8911-f2939da1f1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:46.375067 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0db4b-10f7-4558-8911-f2939da1f1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:46.386322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0db4b-10f7-4558-8911-f2939da1f1bc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:46.407626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 831/1664] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:46.412587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8a073-2541-4654-8c00-f519ec33fb18 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:46.434592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8a073-2541-4654-8c00-f519ec33fb18 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:46.453930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc711ec-772c-45e4-b67e-a548b998fcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:46.455824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc711ec-772c-45e4-b67e-a548b998fcf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:46.456424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc711ec-772c-45e4-b67e-a548b998fcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:46.457078 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc711ec-772c-45e4-b67e-a548b998fcf5 admin admin] PATH_INFO: `/v3/projects/a7563a942ff4426c9389176a4cf84d58/users/64c90e104cab4e29be7452e1cd9c0513/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:46.540815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc711ec-772c-45e4-b67e-a548b998fcf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7563a942ff4426c9389176a4cf84d58, user_id=64c90e104cab4e29be7452e1cd9c0513, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:46.548133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc711ec-772c-45e4-b67e-a548b998fcf5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:46.586469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 834/1665] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:46 2022] PUT /identity/v3/projects/a7563a942ff4426c9389176a4cf84d58/users/64c90e104cab4e29be7452e1cd9c0513/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:46.602960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327c759-a950-46de-98d2-5c507e907b36 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:46.603253 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327c759-a950-46de-98d2-5c507e907b36 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:46.603707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327c759-a950-46de-98d2-5c507e907b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:46.709755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0327c759-a950-46de-98d2-5c507e907b36 None None] MFA Rules not processed for user `64c90e104cab4e29be7452e1cd9c0513`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:46.711075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0327c759-a950-46de-98d2-5c507e907b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:46.993477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 832/1666] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:46.995834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc711ec-772c-45e4-b67e-a548b998fcf5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:47.296677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc711ec-772c-45e4-b67e-a548b998fcf5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:47.316716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59facf05-61b9-4216-9c06-9412288fb0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:47.317447 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59facf05-61b9-4216-9c06-9412288fb0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:47.317734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59facf05-61b9-4216-9c06-9412288fb0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:47.318010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59facf05-61b9-4216-9c06-9412288fb0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:47.327797 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59facf05-61b9-4216-9c06-9412288fb0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:47.343628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59facf05-61b9-4216-9c06-9412288fb0c7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:47.452490 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 835/1667] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:46 2022] POST /identity/v3/projects => generated 381 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:47.458510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327c759-a950-46de-98d2-5c507e907b36 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:47.478445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327c759-a950-46de-98d2-5c507e907b36 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:47.488084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59facf05-61b9-4216-9c06-9412288fb0c7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:47.490986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-59facf05-61b9-4216-9c06-9412288fb0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:47.620007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:47.736996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf24dd-9879-4d0d-bb66-832f44fedaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:47.737850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf24dd-9879-4d0d-bb66-832f44fedaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:47.740373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf24dd-9879-4d0d-bb66-832f44fedaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:47.740731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf24dd-9879-4d0d-bb66-832f44fedaf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:47.741543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf24dd-9879-4d0d-bb66-832f44fedaf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:47.750949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf24dd-9879-4d0d-bb66-832f44fedaf1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:47.775604 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59facf05-61b9-4216-9c06-9412288fb0c7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:47.789493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:47.791436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:47.791720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:47.792003 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] PATH_INFO: `/v3/users/a0362afd4064418e9cd9e43e0ec93f0c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:47.796361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0362afd4064418e9cd9e43e0ec93f0c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:47.802448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:47.809675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 833/1668] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:47 2022] POST /identity/v3/users => generated 297 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:47.813409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf24dd-9879-4d0d-bb66-832f44fedaf1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:47.835630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf24dd-9879-4d0d-bb66-832f44fedaf1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:47.859830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c235f-ceab-41ef-a93f-78d070ff1138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:47.860641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c235f-ceab-41ef-a93f-78d070ff1138 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:47.860955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c235f-ceab-41ef-a93f-78d070ff1138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:47.862295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c235f-ceab-41ef-a93f-78d070ff1138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:47.869388 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c235f-ceab-41ef-a93f-78d070ff1138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:47.875939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c235f-ceab-41ef-a93f-78d070ff1138 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:47.962187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 834/1669] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:47.964916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c235f-ceab-41ef-a93f-78d070ff1138 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:48.019463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c235f-ceab-41ef-a93f-78d070ff1138 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:48.042607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfb4cf-2d0d-4761-8c46-669c76a21e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:48.044982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfb4cf-2d0d-4761-8c46-669c76a21e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:48.045373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfb4cf-2d0d-4761-8c46-669c76a21e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:48.045835 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfb4cf-2d0d-4761-8c46-669c76a21e29 admin admin] PATH_INFO: `/v3/projects/8871ac34b9474f87a8ba2032e484e4f6/users/4ac860da49f249cfb08ceb7f78b1ae53/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:48.047497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0362afd4064418e9cd9e43e0ec93f0c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:48.119606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0362afd4064418e9cd9e43e0ec93f0c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:48.149800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfb4cf-2d0d-4761-8c46-669c76a21e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8871ac34b9474f87a8ba2032e484e4f6, user_id=4ac860da49f249cfb08ceb7f78b1ae53, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:48.160552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0362afd4064418e9cd9e43e0ec93f0c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:48.175633 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfb4cf-2d0d-4761-8c46-669c76a21e29 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:48.190907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0362afd4064418e9cd9e43e0ec93f0c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:48.193374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0362afd4064418e9cd9e43e0ec93f0c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:48.221079 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 835/1670] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:47 2022] PUT /identity/v3/projects/8871ac34b9474f87a8ba2032e484e4f6/users/4ac860da49f249cfb08ceb7f78b1ae53/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:48.226595 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39dae4-cdd0-4e18-9272-1f29bf258a90 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:48.227527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39dae4-cdd0-4e18-9272-1f29bf258a90 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:48.227870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39dae4-cdd0-4e18-9272-1f29bf258a90 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:48.233015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 836/1671] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:25:47 2022] DELETE /identity/v3/users/a0362afd4064418e9cd9e43e0ec93f0c => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:25:48.236358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 836/1672] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:25:48 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:25:48.237829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:48.238508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a8e0b-be04-4e1f-a09e-f70dd6d17886 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:48.240934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a8e0b-be04-4e1f-a09e-f70dd6d17886 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:48.241424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a8e0b-be04-4e1f-a09e-f70dd6d17886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:48.245844 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:48.316008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6f6a8e0b-be04-4e1f-a09e-f70dd6d17886 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:48.331251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6f6a8e0b-be04-4e1f-a09e-f70dd6d17886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:48.349046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:48.544708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 837/1673] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:48.546360 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3070-d5ff-439e-8a7e-ef081a27583a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:48.546667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3070-d5ff-439e-8a7e-ef081a27583a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:48.547110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3070-d5ff-439e-8a7e-ef081a27583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:48.556949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae236e-da3f-4f2a-a218-255ffed5171e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:48.568984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1d6b3070-d5ff-439e-8a7e-ef081a27583a None None] MFA Rules not processed for user `3ba61318896f43e5a68e80f38ae5f3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:48.570611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1d6b3070-d5ff-439e-8a7e-ef081a27583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:48.591787 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e5d7a-3c34-45df-a5f9-b48373298712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:48.592502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e5d7a-3c34-45df-a5f9-b48373298712 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:48.592792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e5d7a-3c34-45df-a5f9-b48373298712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:48.593126 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e5d7a-3c34-45df-a5f9-b48373298712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:48.593872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e5d7a-3c34-45df-a5f9-b48373298712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:48.605792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e5d7a-3c34-45df-a5f9-b48373298712 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:48.640985 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 837/1674] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:48.642433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e5d7a-3c34-45df-a5f9-b48373298712 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:48.647525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-182e5d7a-3c34-45df-a5f9-b48373298712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:48.682791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e5d7a-3c34-45df-a5f9-b48373298712 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:48.701570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:48.702491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:48.702785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:48.703069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] PATH_INFO: `/v3/users/7e3bf11d825d4ce3a4acf1f40b3b9bd9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:48.706366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3bf11d825d4ce3a4acf1f40b3b9bd9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:48.708581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:48.751199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 838/1675] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:48.752739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b3070-d5ff-439e-8a7e-ef081a27583a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:48.759814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1d6b3070-d5ff-439e-8a7e-ef081a27583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:48.821526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:48.844920 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3bf11d825d4ce3a4acf1f40b3b9bd9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:48.881221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3bf11d825d4ce3a4acf1f40b3b9bd9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:48.921238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3bf11d825d4ce3a4acf1f40b3b9bd9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:48.941722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3bf11d825d4ce3a4acf1f40b3b9bd9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:48.946832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3bf11d825d4ce3a4acf1f40b3b9bd9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:48.967765 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b3070-d5ff-439e-8a7e-ef081a27583a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:48.976696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 838/1676] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:25:48 2022] DELETE /identity/v3/users/7e3bf11d825d4ce3a4acf1f40b3b9bd9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:48.979973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:48.990478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:49.068266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945a535-1692-44fe-afd2-263466bafbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:49.069572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945a535-1692-44fe-afd2-263466bafbfc service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:49.069572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945a535-1692-44fe-afd2-263466bafbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:49.070549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945a535-1692-44fe-afd2-263466bafbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:49.072928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9945a535-1692-44fe-afd2-263466bafbfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:49.091520 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:49.186428 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bf817-4862-46e1-bf9a-6ba432ea7eab admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:49.201932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c819c1-d9f4-49d1-919c-73343448ba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:49.202149 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945a535-1692-44fe-afd2-263466bafbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:49.203210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c819c1-d9f4-49d1-919c-73343448ba3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:49.203658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c819c1-d9f4-49d1-919c-73343448ba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:49.204090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c819c1-d9f4-49d1-919c-73343448ba3d admin admin] PATH_INFO: `/v3/projects/8871ac34b9474f87a8ba2032e484e4f6/users/4ac860da49f249cfb08ceb7f78b1ae53/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:49.206071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945a535-1692-44fe-afd2-263466bafbfc service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:49.209549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c819c1-d9f4-49d1-919c-73343448ba3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8871ac34b9474f87a8ba2032e484e4f6, user_id=4ac860da49f249cfb08ceb7f78b1ae53, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:49.212754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c819c1-d9f4-49d1-919c-73343448ba3d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:49.228529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 839/1677] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:49.230654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf286755-12ac-4e3c-a27a-4b20e767e311 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:49.231768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf286755-12ac-4e3c-a27a-4b20e767e311 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:49.232349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf286755-12ac-4e3c-a27a-4b20e767e311 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:49.239118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 839/1678] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:48 2022] PUT /identity/v3/projects/8871ac34b9474f87a8ba2032e484e4f6/users/4ac860da49f249cfb08ceb7f78b1ae53/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:49.240721 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49510109-a831-4a95-b9cd-61829fe8a028 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:49.241208 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49510109-a831-4a95-b9cd-61829fe8a028 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:49.242181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49510109-a831-4a95-b9cd-61829fe8a028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:49.243702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 840/1679] 10.222.0.64 () {54 vars in 960 bytes} [Fri Jul 15 15:25:49 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:25:49.245412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebb69d-6834-447a-b88f-a03149897e95 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:49.245874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebb69d-6834-447a-b88f-a03149897e95 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:49.247091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebb69d-6834-447a-b88f-a03149897e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:49.283865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a7ebb69d-6834-447a-b88f-a03149897e95 None None] MFA Rules not processed for user `3ba61318896f43e5a68e80f38ae5f3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:49.285817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a7ebb69d-6834-447a-b88f-a03149897e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:49.302010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-49510109-a831-4a95-b9cd-61829fe8a028 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:49.307258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-49510109-a831-4a95-b9cd-61829fe8a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:49.514972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 840/1680] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:49.522747 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8033fd-b398-4046-8d98-9b70133d4123 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:49.523973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8033fd-b398-4046-8d98-9b70133d4123 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:49.525488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8033fd-b398-4046-8d98-9b70133d4123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:49.527434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 841/1681] 10.222.0.64 () {58 vars in 1057 bytes} [Fri Jul 15 15:25:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:49.533420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebb69d-6834-447a-b88f-a03149897e95 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:49.538001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a7ebb69d-6834-447a-b88f-a03149897e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:49.635122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5c8033fd-b398-4046-8d98-9b70133d4123 None None] MFA Rules not processed for user `4ac860da49f249cfb08ceb7f78b1ae53`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:49.636558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5c8033fd-b398-4046-8d98-9b70133d4123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:49.738288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebb69d-6834-447a-b88f-a03149897e95 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:49.748583 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:49.754189 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46018d-225b-482f-89e1-3fa9da5f7cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:49.757664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46018d-225b-482f-89e1-3fa9da5f7cab service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:49.761970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46018d-225b-482f-89e1-3fa9da5f7cab service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:49.763583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46018d-225b-482f-89e1-3fa9da5f7cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:49.800647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46018d-225b-482f-89e1-3fa9da5f7cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:49.804280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46018d-225b-482f-89e1-3fa9da5f7cab service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:49.838519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 842/1682] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:49.840042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46018d-225b-482f-89e1-3fa9da5f7cab service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:49.860304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 841/1683] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:49.874647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8033fd-b398-4046-8d98-9b70133d4123 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:49.877721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46018d-225b-482f-89e1-3fa9da5f7cab service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:49.878884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5c8033fd-b398-4046-8d98-9b70133d4123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:49.908252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e74009-6dd8-4f99-a064-ce84de5ce8a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba61318896f43e5a68e80f38ae5f3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:49.909048 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e74009-6dd8-4f99-a064-ce84de5ce8a5 service placement] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:49.909768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e74009-6dd8-4f99-a064-ce84de5ce8a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:49.909768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e74009-6dd8-4f99-a064-ce84de5ce8a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:49.918199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-57e74009-6dd8-4f99-a064-ce84de5ce8a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:49.965463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e74009-6dd8-4f99-a064-ce84de5ce8a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:49.976167 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e74009-6dd8-4f99-a064-ce84de5ce8a5 service placement] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:50.032020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 843/1684] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:50.110425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8033fd-b398-4046-8d98-9b70133d4123 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:50.127323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a01f6-3eb1-48f3-9986-f09839415f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:50.129430 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a01f6-3eb1-48f3-9986-f09839415f48 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:50.131198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a01f6-3eb1-48f3-9986-f09839415f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:50.131667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a01f6-3eb1-48f3-9986-f09839415f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:50.182753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a01f6-3eb1-48f3-9986-f09839415f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:50.184169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a01f6-3eb1-48f3-9986-f09839415f48 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:50.231127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 842/1685] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:50.352223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e74009-6dd8-4f99-a064-ce84de5ce8a5 service placement] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:50.365757 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e74009-6dd8-4f99-a064-ce84de5ce8a5 service placement] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:50.388979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e413c78-21db-4adf-a0c7-07f8a37dde45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:50.389833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e413c78-21db-4adf-a0c7-07f8a37dde45 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:50.390126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e413c78-21db-4adf-a0c7-07f8a37dde45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:50.390430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e413c78-21db-4adf-a0c7-07f8a37dde45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:50.392904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9e413c78-21db-4adf-a0c7-07f8a37dde45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:50.492746 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:50.545492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e413c78-21db-4adf-a0c7-07f8a37dde45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:50.547316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e413c78-21db-4adf-a0c7-07f8a37dde45 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:50.559152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 844/1686] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:25:51.754746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a01f6-3eb1-48f3-9986-f09839415f48 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:51.756641 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0f4a01f6-3eb1-48f3-9986-f09839415f48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:51.783943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a01f6-3eb1-48f3-9986-f09839415f48 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:51.795064 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:51.796052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:51.796938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:51.797262 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] PATH_INFO: `/v3/projects/37455dda66e94faba63f2583e81202e2` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:51.800182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=37455dda66e94faba63f2583e81202e2)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:51.807555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:51.973467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e413c78-21db-4adf-a0c7-07f8a37dde45 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:51.975222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9e413c78-21db-4adf-a0c7-07f8a37dde45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:52.019927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e413c78-21db-4adf-a0c7-07f8a37dde45 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:52.032548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37455dda66e94faba63f2583e81202e2', 'request_id': 'req-936766a0-800a-4814-bd69-55890e63c0fd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.059885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37455dda66e94faba63f2583e81202e2', 'request_id': 'req-936766a0-800a-4814-bd69-55890e63c0fd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.095194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37455dda66e94faba63f2583e81202e2', 'request_id': 'req-936766a0-800a-4814-bd69-55890e63c0fd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.118864 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] The token cache is being invalidate because project 37455dda66e94faba63f2583e81202e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:25:52.119166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.122823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.135662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 843/1687] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:25:51 2022] DELETE /identity/v3/projects/37455dda66e94faba63f2583e81202e2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:52.136974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:52.145992 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:52.278096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:52.278898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:52.283581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:52.284232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] PATH_INFO: `/v3/projects/e3f2046e3edc444eb1035a384e54787c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:52.295105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f2046e3edc444eb1035a384e54787c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:52.304615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:52.454245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936766a0-800a-4814-bd69-55890e63c0fd admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:52.476630 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:52.505004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f2046e3edc444eb1035a384e54787c', 'request_id': 'req-5220c886-45ed-45c8-9a76-a88618d1e8d6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.549328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f2046e3edc444eb1035a384e54787c', 'request_id': 'req-5220c886-45ed-45c8-9a76-a88618d1e8d6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.586529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f2046e3edc444eb1035a384e54787c', 'request_id': 'req-5220c886-45ed-45c8-9a76-a88618d1e8d6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.647223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] The token cache is being invalidate because project e3f2046e3edc444eb1035a384e54787c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:25:52.647986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.650433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.653482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 845/1688] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:25:51 2022] DELETE /identity/v3/projects/e3f2046e3edc444eb1035a384e54787c => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:25:52.669882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:52.675215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:52.731728 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a4818-2675-428d-8c9c-6b127f3d9a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:52.733166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4818-2675-428d-8c9c-6b127f3d9a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:52.733704 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4818-2675-428d-8c9c-6b127f3d9a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:52.734197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4818-2675-428d-8c9c-6b127f3d9a7b admin admin] PATH_INFO: `/v3/users/52bdac6f66c642ea9c4bcba52317d1ae` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:52.738196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a4818-2675-428d-8c9c-6b127f3d9a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=52bdac6f66c642ea9c4bcba52317d1ae)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:52.740693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a4818-2675-428d-8c9c-6b127f3d9a7b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:52.841355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220c886-45ed-45c8-9a76-a88618d1e8d6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:52.849710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7f1a4818-2675-428d-8c9c-6b127f3d9a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52bdac6f66c642ea9c4bcba52317d1ae'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.873478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:52.877637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:52.878337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:52.878695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] PATH_INFO: `/v3/users/252502cd22264ce99d942048de462454` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:52.884879 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252502cd22264ce99d942048de462454)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:52.885987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:25:52.885987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 15 15:25:52.885987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: Jul 15 15:25:52.894169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7f1a4818-2675-428d-8c9c-6b127f3d9a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52bdac6f66c642ea9c4bcba52317d1ae'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.895045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:52.921356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:52.939163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7f1a4818-2675-428d-8c9c-6b127f3d9a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52bdac6f66c642ea9c4bcba52317d1ae'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.963562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7f1a4818-2675-428d-8c9c-6b127f3d9a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52bdac6f66c642ea9c4bcba52317d1ae'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.965770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7f1a4818-2675-428d-8c9c-6b127f3d9a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52bdac6f66c642ea9c4bcba52317d1ae'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:52.991092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 844/1689] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:25:52 2022] DELETE /identity/v3/users/52bdac6f66c642ea9c4bcba52317d1ae => generated 0 bytes in 855 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:53.011579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4604b-938c-42d7-ba85-7ee6355c6aff None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:53.020000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4604b-938c-42d7-ba85-7ee6355c6aff None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:53.020539 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4604b-938c-42d7-ba85-7ee6355c6aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:53.066211 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-10c4604b-938c-42d7-ba85-7ee6355c6aff None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:53.068139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-10c4604b-938c-42d7-ba85-7ee6355c6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:53.127345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252502cd22264ce99d942048de462454'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:53.210044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252502cd22264ce99d942048de462454'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:53.252703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 845/1690] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:53.262080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252502cd22264ce99d942048de462454'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:53.269182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552a5db-0578-45a2-a098-abfbc9603476 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:53.269805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552a5db-0578-45a2-a098-abfbc9603476 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:53.271427 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552a5db-0578-45a2-a098-abfbc9603476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:53.286446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252502cd22264ce99d942048de462454'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:53.289704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252502cd22264ce99d942048de462454'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:53.341758 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 846/1691] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:25:52 2022] DELETE /identity/v3/users/252502cd22264ce99d942048de462454 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:53.356599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a552a5db-0578-45a2-a098-abfbc9603476 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:53.359440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a552a5db-0578-45a2-a098-abfbc9603476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:53.430482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:53.567696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 846/1692] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:25:53.572444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:53.593867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d168c-1de6-440d-8ca0-c51386c6bbb6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:53.610122 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65257c20-5602-4d38-b037-d09218846173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:53.611235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65257c20-5602-4d38-b037-d09218846173 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:53.611907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65257c20-5602-4d38-b037-d09218846173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:53.612608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65257c20-5602-4d38-b037-d09218846173 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:53.614843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65257c20-5602-4d38-b037-d09218846173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:25:53.615462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65257c20-5602-4d38-b037-d09218846173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:53.622029 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65257c20-5602-4d38-b037-d09218846173 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:53.663181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 847/1693] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:25:53.668082 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552a5db-0578-45a2-a098-abfbc9603476 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:53.684989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af135b-af76-4b4d-8664-7b4b63c327c6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:53.685488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af135b-af76-4b4d-8664-7b4b63c327c6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:53.685907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af135b-af76-4b4d-8664-7b4b63c327c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:53.691977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552a5db-0578-45a2-a098-abfbc9603476 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:53.703522 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26eefa-1df7-4d8c-b2a6-563a7f5dcfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:53.705251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26eefa-1df7-4d8c-b2a6-563a7f5dcfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:53.705718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26eefa-1df7-4d8c-b2a6-563a7f5dcfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:53.706134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26eefa-1df7-4d8c-b2a6-563a7f5dcfb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:53.707488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26eefa-1df7-4d8c-b2a6-563a7f5dcfb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:53.710672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26eefa-1df7-4d8c-b2a6-563a7f5dcfb9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:53.768299 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-54af135b-af76-4b4d-8664-7b4b63c327c6 None None] MFA Rules not processed for user `29b465d5c26f4071a88eb65d73edac2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:53.772511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-54af135b-af76-4b4d-8664-7b4b63c327c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:53.788657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 847/1694] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:53 2022] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:53.790339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26eefa-1df7-4d8c-b2a6-563a7f5dcfb9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:53.952257 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 848/1695] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:53.966124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14dc85-6776-469b-8e7e-c521fe22cd5f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:53.966662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14dc85-6776-469b-8e7e-c521fe22cd5f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:53.967324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14dc85-6776-469b-8e7e-c521fe22cd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:54.003788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-fa14dc85-6776-469b-8e7e-c521fe22cd5f None None] MFA Rules not processed for user `29b465d5c26f4071a88eb65d73edac2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:54.013848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fa14dc85-6776-469b-8e7e-c521fe22cd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:54.022009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26eefa-1df7-4d8c-b2a6-563a7f5dcfb9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:54.037782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bf4fe-b4ce-4e33-baac-93827ed55f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:54.045168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bf4fe-b4ce-4e33-baac-93827ed55f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:54.045470 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bf4fe-b4ce-4e33-baac-93827ed55f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:54.045759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bf4fe-b4ce-4e33-baac-93827ed55f15 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:54.046615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bf4fe-b4ce-4e33-baac-93827ed55f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:54.051253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bf4fe-b4ce-4e33-baac-93827ed55f15 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:54.134459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 848/1696] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:53 2022] POST /identity/v3/users => generated 282 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:54.136595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bf4fe-b4ce-4e33-baac-93827ed55f15 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:54.139363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2e1bf4fe-b4ce-4e33-baac-93827ed55f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:54.195879 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bf4fe-b4ce-4e33-baac-93827ed55f15 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:54.209876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:54.213876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:54.214306 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:54.214551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] PATH_INFO: `/v3/projects/e45aae614bf845459cf519c39842abc0` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:54.218686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45aae614bf845459cf519c39842abc0)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:54.227085 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:54.270832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 849/1697] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:54.271930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14dc85-6776-469b-8e7e-c521fe22cd5f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:54.276795 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fa14dc85-6776-469b-8e7e-c521fe22cd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:54.309809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14dc85-6776-469b-8e7e-c521fe22cd5f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:54.319482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:54.320454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:54.320783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:54.321083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] PATH_INFO: `/v3/projects/1c192a53b9ef4d45bd84ffe7dd7b1126` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:54.322568 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c192a53b9ef4d45bd84ffe7dd7b1126)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:54.328654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:54.330732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:54.383314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45aae614bf845459cf519c39842abc0', 'request_id': 'req-e225b859-034c-47f9-bd2c-9e87702a8504'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:54.399952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45aae614bf845459cf519c39842abc0', 'request_id': 'req-e225b859-034c-47f9-bd2c-9e87702a8504'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:54.414809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45aae614bf845459cf519c39842abc0', 'request_id': 'req-e225b859-034c-47f9-bd2c-9e87702a8504'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:54.466195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] The token cache is being invalidate because project e45aae614bf845459cf519c39842abc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:25:54.466509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:54.477785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:54.482817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 849/1698] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:25:54 2022] DELETE /identity/v3/projects/e45aae614bf845459cf519c39842abc0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:54.483796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:54.486376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:54.487812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c192a53b9ef4d45bd84ffe7dd7b1126', 'request_id': 'req-5e50f21a-773e-4bb0-93ca-46988fe66b59'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:54.502722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c192a53b9ef4d45bd84ffe7dd7b1126', 'request_id': 'req-5e50f21a-773e-4bb0-93ca-46988fe66b59'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:54.522128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c192a53b9ef4d45bd84ffe7dd7b1126', 'request_id': 'req-5e50f21a-773e-4bb0-93ca-46988fe66b59'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:54.548165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] The token cache is being invalidate because project 1c192a53b9ef4d45bd84ffe7dd7b1126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:25:54.548797 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:54.550986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:54.555742 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:54.559510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 850/1699] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:25:54 2022] DELETE /identity/v3/projects/1c192a53b9ef4d45bd84ffe7dd7b1126 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:54.562207 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:54.575112 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:54.689660 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225b859-034c-47f9-bd2c-9e87702a8504 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:54.827646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50f21a-773e-4bb0-93ca-46988fe66b59 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:54.848271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d88d64-bfda-402a-b2d5-a25a97f7dc8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:54.851320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d88d64-bfda-402a-b2d5-a25a97f7dc8d service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:54.851833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d88d64-bfda-402a-b2d5-a25a97f7dc8d service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:54.853095 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d88d64-bfda-402a-b2d5-a25a97f7dc8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:54.858789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c1d88d64-bfda-402a-b2d5-a25a97f7dc8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:54.904618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684066c-8161-42fe-a822-1d185953d65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:54.907339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684066c-8161-42fe-a822-1d185953d65a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:54.907832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684066c-8161-42fe-a822-1d185953d65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:54.908196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684066c-8161-42fe-a822-1d185953d65a admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:54.909264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684066c-8161-42fe-a822-1d185953d65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:54.920626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684066c-8161-42fe-a822-1d185953d65a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:54.967482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 850/1700] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:54.970513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684066c-8161-42fe-a822-1d185953d65a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:54.978986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c684066c-8161-42fe-a822-1d185953d65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:55.025634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684066c-8161-42fe-a822-1d185953d65a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:55.042333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae1101-3e0b-4c40-bf41-0e8d57ad5775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:55.044515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae1101-3e0b-4c40-bf41-0e8d57ad5775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:55.045213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae1101-3e0b-4c40-bf41-0e8d57ad5775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:55.045851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae1101-3e0b-4c40-bf41-0e8d57ad5775 admin admin] PATH_INFO: `/v3/users/46396aa4f551445d9825d24f81a0a457` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:55.050526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae1101-3e0b-4c40-bf41-0e8d57ad5775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46396aa4f551445d9825d24f81a0a457)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:55.054561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae1101-3e0b-4c40-bf41-0e8d57ad5775 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:55.078755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d88d64-bfda-402a-b2d5-a25a97f7dc8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:55.080494 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d88d64-bfda-402a-b2d5-a25a97f7dc8d service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:55.101575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 851/1701] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:55.118672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c628-1551-45e2-9e01-5c2ded277254 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:55.119199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c628-1551-45e2-9e01-5c2ded277254 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:55.119655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c628-1551-45e2-9e01-5c2ded277254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:55.148740 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-58ae1101-3e0b-4c40-bf41-0e8d57ad5775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46396aa4f551445d9825d24f81a0a457'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:55.153518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c4f9c628-1551-45e2-9e01-5c2ded277254 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:55.154784 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c4f9c628-1551-45e2-9e01-5c2ded277254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:55.163968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-58ae1101-3e0b-4c40-bf41-0e8d57ad5775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46396aa4f551445d9825d24f81a0a457'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:55.171914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-58ae1101-3e0b-4c40-bf41-0e8d57ad5775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46396aa4f551445d9825d24f81a0a457'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:55.181115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 852/1702] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:55.181829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c628-1551-45e2-9e01-5c2ded277254 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:55.183251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c4f9c628-1551-45e2-9e01-5c2ded277254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:55.190008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-58ae1101-3e0b-4c40-bf41-0e8d57ad5775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46396aa4f551445d9825d24f81a0a457'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:55.191900 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-58ae1101-3e0b-4c40-bf41-0e8d57ad5775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46396aa4f551445d9825d24f81a0a457'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:55.206443 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 851/1703] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:25:54 2022] DELETE /identity/v3/users/46396aa4f551445d9825d24f81a0a457 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:55.206443 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7509cc-d2ab-4f87-8f7b-7ba1b83293cd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:55.206741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c628-1551-45e2-9e01-5c2ded277254 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:55.214737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7509cc-d2ab-4f87-8f7b-7ba1b83293cd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:55.216414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7509cc-d2ab-4f87-8f7b-7ba1b83293cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:55.241957 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-bc7509cc-d2ab-4f87-8f7b-7ba1b83293cd None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:55.243711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bc7509cc-d2ab-4f87-8f7b-7ba1b83293cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:55.267158 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:55.334379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:55.366220 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff7089-f6e5-43e4-859c-6a0e309fa8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:55.367600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff7089-f6e5-43e4-859c-6a0e309fa8da admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:55.367962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff7089-f6e5-43e4-859c-6a0e309fa8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:55.368320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff7089-f6e5-43e4-859c-6a0e309fa8da admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:55.373166 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff7089-f6e5-43e4-859c-6a0e309fa8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:55.375030 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff7089-f6e5-43e4-859c-6a0e309fa8da admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:55.395529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 853/1704] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:55.396308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff7089-f6e5-43e4-859c-6a0e309fa8da admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:55.398308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-adff7089-f6e5-43e4-859c-6a0e309fa8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:55.411107 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 852/1705] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:55.412313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7509cc-d2ab-4f87-8f7b-7ba1b83293cd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:55.412429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff7089-f6e5-43e4-859c-6a0e309fa8da admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:55.417538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259c5ac-e834-4081-b908-61b5031c5d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:55.418622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259c5ac-e834-4081-b908-61b5031c5d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:55.419092 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259c5ac-e834-4081-b908-61b5031c5d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:55.419966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259c5ac-e834-4081-b908-61b5031c5d28 admin admin] PATH_INFO: `/v3/projects/f9025aa57fa6429a8c0e16b65888b64b/users/fc22bdfd2c644dbfa9e2ef2412b81c6b/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:55.424716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7509cc-d2ab-4f87-8f7b-7ba1b83293cd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:55.431310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313d266-7d6d-4072-be40-505120539b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:55.432266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313d266-7d6d-4072-be40-505120539b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:55.432691 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313d266-7d6d-4072-be40-505120539b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:55.435072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313d266-7d6d-4072-be40-505120539b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:55.439755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259c5ac-e834-4081-b908-61b5031c5d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9025aa57fa6429a8c0e16b65888b64b, user_id=fc22bdfd2c644dbfa9e2ef2412b81c6b, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:55.440140 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313d266-7d6d-4072-be40-505120539b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:25:55.440661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313d266-7d6d-4072-be40-505120539b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:55.442780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313d266-7d6d-4072-be40-505120539b51 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:55.443112 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259c5ac-e834-4081-b908-61b5031c5d28 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:55.469501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 854/1706] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:55 2022] PUT /identity/v3/projects/f9025aa57fa6429a8c0e16b65888b64b/users/fc22bdfd2c644dbfa9e2ef2412b81c6b/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:55.471421 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90defcd-b5ba-403d-8ccd-80b0d750700e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:55.471846 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90defcd-b5ba-403d-8ccd-80b0d750700e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:55.472244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90defcd-b5ba-403d-8ccd-80b0d750700e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:55.485176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 853/1707] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:25:55.492110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313d266-7d6d-4072-be40-505120539b51 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:55.505485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d90defcd-b5ba-403d-8ccd-80b0d750700e None None] MFA Rules not processed for user `fc22bdfd2c644dbfa9e2ef2412b81c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:55.507527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d90defcd-b5ba-403d-8ccd-80b0d750700e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:55.519867 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313d266-7d6d-4072-be40-505120539b51 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:55.633919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097e186-fee8-44cd-b692-f97255ff866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:55.634624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097e186-fee8-44cd-b692-f97255ff866e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:55.634908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097e186-fee8-44cd-b692-f97255ff866e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:55.635187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097e186-fee8-44cd-b692-f97255ff866e admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:55.635983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097e186-fee8-44cd-b692-f97255ff866e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:55.638148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097e186-fee8-44cd-b692-f97255ff866e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:55.678659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 854/1708] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:55 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:55.684051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097e186-fee8-44cd-b692-f97255ff866e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:55.694180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 855/1709] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:55.696027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90defcd-b5ba-403d-8ccd-80b0d750700e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:55.731646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90defcd-b5ba-403d-8ccd-80b0d750700e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:55.806368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097e186-fee8-44cd-b692-f97255ff866e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:55.808321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237644-32b1-4d27-a598-654c24e003d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:55.809364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237644-32b1-4d27-a598-654c24e003d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:55.809814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237644-32b1-4d27-a598-654c24e003d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:55.810170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237644-32b1-4d27-a598-654c24e003d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:55.811124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f237644-32b1-4d27-a598-654c24e003d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:55.813397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f237644-32b1-4d27-a598-654c24e003d7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:55.815206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f6665-2747-4216-be2e-43b4cd127be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:55.816129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f6665-2747-4216-be2e-43b4cd127be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:55.816592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f6665-2747-4216-be2e-43b4cd127be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:55.817131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f6665-2747-4216-be2e-43b4cd127be3 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:55.818495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f6665-2747-4216-be2e-43b4cd127be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:55.833701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f6665-2747-4216-be2e-43b4cd127be3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:55.858341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 856/1710] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:55 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:55.864226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237644-32b1-4d27-a598-654c24e003d7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:55.867857 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7f237644-32b1-4d27-a598-654c24e003d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:55.900331 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:55.901647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 855/1711] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:55 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:55.905821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f6665-2747-4216-be2e-43b4cd127be3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:55.931010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f6665-2747-4216-be2e-43b4cd127be3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:55.996652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:56.056038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183bfab-5dd7-485b-8d98-b7804d402d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:56.057945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183bfab-5dd7-485b-8d98-b7804d402d01 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:56.058537 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183bfab-5dd7-485b-8d98-b7804d402d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:56.058960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183bfab-5dd7-485b-8d98-b7804d402d01 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:56.059826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183bfab-5dd7-485b-8d98-b7804d402d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:56.064425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183bfab-5dd7-485b-8d98-b7804d402d01 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:56.068232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237644-32b1-4d27-a598-654c24e003d7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:56.085527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:56.086492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:56.086782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:56.087063 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa admin admin] PATH_INFO: `/v3/projects/f38fff7bca1e4f0795b2deefeda78a71` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:56.088470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38fff7bca1e4f0795b2deefeda78a71)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:56.090597 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:56.115891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 856/1712] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:55 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:56.129239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183bfab-5dd7-485b-8d98-b7804d402d01 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:56.159817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183bfab-5dd7-485b-8d98-b7804d402d01 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:56.172781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5ba57-e288-455d-9d70-cd537c23a7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:56.175532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5ba57-e288-455d-9d70-cd537c23a7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:56.177419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5ba57-e288-455d-9d70-cd537c23a7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:56.177961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5ba57-e288-455d-9d70-cd537c23a7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:56.181250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5ba57-e288-455d-9d70-cd537c23a7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:56.186320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5ba57-e288-455d-9d70-cd537c23a7a9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:56.202758 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 857/1713] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:56.203989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5ba57-e288-455d-9d70-cd537c23a7a9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:56.214676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38fff7bca1e4f0795b2deefeda78a71', 'request_id': 'req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:56.231957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38fff7bca1e4f0795b2deefeda78a71', 'request_id': 'req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:56.247203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38fff7bca1e4f0795b2deefeda78a71', 'request_id': 'req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:56.251052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5ba57-e288-455d-9d70-cd537c23a7a9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:56.286952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa admin admin] The token cache is being invalidate because project f38fff7bca1e4f0795b2deefeda78a71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:25:56.287363 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:56.288767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c0db1568-6a4e-49fa-b72e-4b934b8fe4aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:25:56.292278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 857/1714] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:25:55 2022] DELETE /identity/v3/projects/f38fff7bca1e4f0795b2deefeda78a71 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:56.298340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45bedb-d286-4780-bda2-850c571c8516 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:56.298340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45bedb-d286-4780-bda2-850c571c8516 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:56.298743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45bedb-d286-4780-bda2-850c571c8516 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:56.306475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 858/1715] 10.222.0.64 () {54 vars in 912 bytes} [Fri Jul 15 15:25:56 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:25:56.309419 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45bedb-d286-4780-bda2-850c571c8516 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:56.313703 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1d45bedb-d286-4780-bda2-850c571c8516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:56.468982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8488d-237b-4347-bbc4-3f2e0895ac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:56.473617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8488d-237b-4347-bbc4-3f2e0895ac25 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:56.474349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8488d-237b-4347-bbc4-3f2e0895ac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:56.474349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8488d-237b-4347-bbc4-3f2e0895ac25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:56.475139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8488d-237b-4347-bbc4-3f2e0895ac25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:56.477441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8488d-237b-4347-bbc4-3f2e0895ac25 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:56.506394 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 858/1716] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:56.508001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55937b-b4ea-426b-b2f4-175905b7eae8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:56.508304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55937b-b4ea-426b-b2f4-175905b7eae8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:56.508598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55937b-b4ea-426b-b2f4-175905b7eae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:56.542757 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45bedb-d286-4780-bda2-850c571c8516 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:56.569813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfe0b7-4448-40e4-aed0-af90abe89298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:56.575616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfe0b7-4448-40e4-aed0-af90abe89298 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:56.575950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfe0b7-4448-40e4-aed0-af90abe89298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:56.576241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfe0b7-4448-40e4-aed0-af90abe89298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:56.577275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfe0b7-4448-40e4-aed0-af90abe89298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:56.580913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3e55937b-b4ea-426b-b2f4-175905b7eae8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:56.583566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3e55937b-b4ea-426b-b2f4-175905b7eae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:56.588532 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfe0b7-4448-40e4-aed0-af90abe89298 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:56.624746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 859/1717] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:56.629783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bbdb7-6d68-4684-9ee0-36eeb54a1542 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:56.630211 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bbdb7-6d68-4684-9ee0-36eeb54a1542 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:56.633020 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bbdb7-6d68-4684-9ee0-36eeb54a1542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:56.639254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 859/1718] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:56.640752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfe0b7-4448-40e4-aed0-af90abe89298 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:56.647557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-72cfe0b7-4448-40e4-aed0-af90abe89298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:56.693660 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfe0b7-4448-40e4-aed0-af90abe89298 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:56.700376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066970f7-e008-42d7-a9c2-11a70ef577f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:56.701377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066970f7-e008-42d7-a9c2-11a70ef577f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:56.701669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066970f7-e008-42d7-a9c2-11a70ef577f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:56.702029 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066970f7-e008-42d7-a9c2-11a70ef577f1 admin admin] PATH_INFO: `/v3/projects/00bebb43d8cf4dd6984553e1c3e6f005/users/63dc7da4b72d4241bf48366d0da3f300/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:56.751657 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066970f7-e008-42d7-a9c2-11a70ef577f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00bebb43d8cf4dd6984553e1c3e6f005, user_id=63dc7da4b72d4241bf48366d0da3f300, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:56.764878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066970f7-e008-42d7-a9c2-11a70ef577f1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:56.781087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-763bbdb7-6d68-4684-9ee0-36eeb54a1542 None None] MFA Rules not processed for user `88518fe83a7c4fbdb3088bb2daf04239`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:56.790882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-763bbdb7-6d68-4684-9ee0-36eeb54a1542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:56.802496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 860/1719] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:56 2022] PUT /identity/v3/projects/00bebb43d8cf4dd6984553e1c3e6f005/users/63dc7da4b72d4241bf48366d0da3f300/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:56.808096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d8b27-d1d6-44ca-a69d-9509f6a9c41a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:56.808709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d8b27-d1d6-44ca-a69d-9509f6a9c41a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:56.809165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d8b27-d1d6-44ca-a69d-9509f6a9c41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:56.908431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5e0d8b27-d1d6-44ca-a69d-9509f6a9c41a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:56.937268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5e0d8b27-d1d6-44ca-a69d-9509f6a9c41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:56.956912 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:57.008455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 860/1720] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:25:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:57.016653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bbdb7-6d68-4684-9ee0-36eeb54a1542 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:57.197274 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:57.229706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 861/1721] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:57.230700 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d8b27-d1d6-44ca-a69d-9509f6a9c41a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:57.244601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bbdb7-6d68-4684-9ee0-36eeb54a1542 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:57.254623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d8b27-d1d6-44ca-a69d-9509f6a9c41a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:57.257595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e16e8-0b4a-4b12-a465-e47ea49c5225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:57.259622 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e16e8-0b4a-4b12-a465-e47ea49c5225 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:57.260925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621186f-e472-4816-92d6-a5fd8a3129fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:57.262436 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621186f-e472-4816-92d6-a5fd8a3129fd admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:57.262814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621186f-e472-4816-92d6-a5fd8a3129fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:57.262922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e16e8-0b4a-4b12-a465-e47ea49c5225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:57.263356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e16e8-0b4a-4b12-a465-e47ea49c5225 admin admin] PATH_INFO: `/v3/projects/88992af645d54bb1828c36a38a36f23e/users/9daab7a53d0147868fc1b8528168f3f6/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:57.263592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621186f-e472-4816-92d6-a5fd8a3129fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:57.264828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621186f-e472-4816-92d6-a5fd8a3129fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:57.271108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621186f-e472-4816-92d6-a5fd8a3129fd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:57.290649 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 862/1722] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:57.292164 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621186f-e472-4816-92d6-a5fd8a3129fd admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:57.295552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1621186f-e472-4816-92d6-a5fd8a3129fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:57.341672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e16e8-0b4a-4b12-a465-e47ea49c5225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88992af645d54bb1828c36a38a36f23e, user_id=9daab7a53d0147868fc1b8528168f3f6, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:57.344648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e16e8-0b4a-4b12-a465-e47ea49c5225 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:57.360713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621186f-e472-4816-92d6-a5fd8a3129fd admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:57.376668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 861/1723] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:57 2022] PUT /identity/v3/projects/88992af645d54bb1828c36a38a36f23e/users/9daab7a53d0147868fc1b8528168f3f6/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:57.377888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e16e8-0b4a-4b12-a465-e47ea49c5225 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:57.530891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a0371-8019-460a-afa2-cd1b73e82835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:57.530891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a0371-8019-460a-afa2-cd1b73e82835 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:57.530891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a0371-8019-460a-afa2-cd1b73e82835 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:57.530891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a0371-8019-460a-afa2-cd1b73e82835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:57.547009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a0371-8019-460a-afa2-cd1b73e82835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:57.548332 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a0371-8019-460a-afa2-cd1b73e82835 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:57.564490 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e16e8-0b4a-4b12-a465-e47ea49c5225 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:57.568503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 863/1724] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:57.570400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a0371-8019-460a-afa2-cd1b73e82835 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:57.580658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed80bc-8ff7-49c9-8274-e3283aeb0a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:57.582585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed80bc-8ff7-49c9-8274-e3283aeb0a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:57.582952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed80bc-8ff7-49c9-8274-e3283aeb0a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:57.583254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed80bc-8ff7-49c9-8274-e3283aeb0a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:57.584705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed80bc-8ff7-49c9-8274-e3283aeb0a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:25:57.584705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed80bc-8ff7-49c9-8274-e3283aeb0a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:57.598663 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed80bc-8ff7-49c9-8274-e3283aeb0a76 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:57.614205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a0371-8019-460a-afa2-cd1b73e82835 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:57.624935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 862/1725] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:25:57.627027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0c94b-4e5f-4374-8406-1dabd7e336e3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:57.627414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0c94b-4e5f-4374-8406-1dabd7e336e3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:57.627782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0c94b-4e5f-4374-8406-1dabd7e336e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:57.631607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c492e2a-5296-4fc2-99f8-a4ba3a2cd4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:57.632736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c492e2a-5296-4fc2-99f8-a4ba3a2cd4de admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:57.633153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c492e2a-5296-4fc2-99f8-a4ba3a2cd4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:57.633553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c492e2a-5296-4fc2-99f8-a4ba3a2cd4de admin admin] PATH_INFO: `/v3/projects/00bebb43d8cf4dd6984553e1c3e6f005/users/63dc7da4b72d4241bf48366d0da3f300/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:57.640776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c492e2a-5296-4fc2-99f8-a4ba3a2cd4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=00bebb43d8cf4dd6984553e1c3e6f005, user_id=63dc7da4b72d4241bf48366d0da3f300, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:57.646995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c492e2a-5296-4fc2-99f8-a4ba3a2cd4de admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:57.671829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 864/1726] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:57 2022] PUT /identity/v3/projects/00bebb43d8cf4dd6984553e1c3e6f005/users/63dc7da4b72d4241bf48366d0da3f300/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:57.673818 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6097860-da67-4d11-a915-41c93f88fb6a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:57.674234 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6097860-da67-4d11-a915-41c93f88fb6a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:57.674628 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6097860-da67-4d11-a915-41c93f88fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:57.722985 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c5f0c94b-4e5f-4374-8406-1dabd7e336e3 None None] MFA Rules not processed for user `9daab7a53d0147868fc1b8528168f3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:57.724257 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c5f0c94b-4e5f-4374-8406-1dabd7e336e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:57.735583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a6097860-da67-4d11-a915-41c93f88fb6a None None] MFA Rules not processed for user `0383866c48dc4e6a99608d3079d15ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:57.737535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a6097860-da67-4d11-a915-41c93f88fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:57.842330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 865/1727] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:57.843246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6097860-da67-4d11-a915-41c93f88fb6a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:57.870574 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 863/1728] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:57.874454 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc83f6-159c-4e8d-8f35-8c20b9976a7a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:57.874845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc83f6-159c-4e8d-8f35-8c20b9976a7a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:57.875228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc83f6-159c-4e8d-8f35-8c20b9976a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:57.890404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:57.922179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-13dc83f6-159c-4e8d-8f35-8c20b9976a7a None None] MFA Rules not processed for user `63dc7da4b72d4241bf48366d0da3f300`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:57.924206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-13dc83f6-159c-4e8d-8f35-8c20b9976a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:57.974003 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:57.988854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6097860-da67-4d11-a915-41c93f88fb6a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:58.008546 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fbd4c-59d6-493f-ac58-be38f4cd6b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:58.009225 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fbd4c-59d6-493f-ac58-be38f4cd6b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:58.009513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fbd4c-59d6-493f-ac58-be38f4cd6b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:58.009800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fbd4c-59d6-493f-ac58-be38f4cd6b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:58.011575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9fbd4c-59d6-493f-ac58-be38f4cd6b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:58.013497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9fbd4c-59d6-493f-ac58-be38f4cd6b0a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:58.047067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 864/1729] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:58.047067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc83f6-159c-4e8d-8f35-8c20b9976a7a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:58.049351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-13dc83f6-159c-4e8d-8f35-8c20b9976a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:58.084912 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 866/1730] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:57 2022] POST /identity/v3/projects => generated 367 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:58.086555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fbd4c-59d6-493f-ac58-be38f4cd6b0a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:58.189667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fbd4c-59d6-493f-ac58-be38f4cd6b0a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:58.212620 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dd6bb-338e-4fce-8773-e20ee111a1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:58.213347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd6bb-338e-4fce-8773-e20ee111a1dc admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:58.213637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd6bb-338e-4fce-8773-e20ee111a1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:58.213925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd6bb-338e-4fce-8773-e20ee111a1dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:58.216402 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dd6bb-338e-4fce-8773-e20ee111a1dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:58.219249 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dd6bb-338e-4fce-8773-e20ee111a1dc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:58.250638 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc83f6-159c-4e8d-8f35-8c20b9976a7a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:58.282402 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 867/1731] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:25:58 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:58.283854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41c41e-6bd7-4ab4-b9a8-9e1bd5166ce2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:58.287297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41c41e-6bd7-4ab4-b9a8-9e1bd5166ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:58.287996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41c41e-6bd7-4ab4-b9a8-9e1bd5166ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:58.356831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3e41c41e-6bd7-4ab4-b9a8-9e1bd5166ce2 None None] MFA Rules not processed for user `0c4b2c84be7d4670a7232ae93db14740`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:58.360092 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3e41c41e-6bd7-4ab4-b9a8-9e1bd5166ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:58.400021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da801ff3-d4d8-4a23-b447-1ad26a3b7670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:58.400845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da801ff3-d4d8-4a23-b447-1ad26a3b7670 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:58.401176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da801ff3-d4d8-4a23-b447-1ad26a3b7670 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:58.401463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da801ff3-d4d8-4a23-b447-1ad26a3b7670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:58.587747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 868/1732] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:25:58.588535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da801ff3-d4d8-4a23-b447-1ad26a3b7670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:58.588706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41c41e-6bd7-4ab4-b9a8-9e1bd5166ce2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:58.596608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3e41c41e-6bd7-4ab4-b9a8-9e1bd5166ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:58.603076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da801ff3-d4d8-4a23-b447-1ad26a3b7670 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:58.619305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 865/1733] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:58.621620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da801ff3-d4d8-4a23-b447-1ad26a3b7670 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:58.643048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da801ff3-d4d8-4a23-b447-1ad26a3b7670 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:58.650141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:58.663700 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:58.770217 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41c41e-6bd7-4ab4-b9a8-9e1bd5166ce2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:58.779960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ff4e1-3398-4d54-a5ee-24a7c4db0495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:58.781185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ff4e1-3398-4d54-a5ee-24a7c4db0495 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:58.781740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ff4e1-3398-4d54-a5ee-24a7c4db0495 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:58.782272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ff4e1-3398-4d54-a5ee-24a7c4db0495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:58.784659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c09b1-deea-456d-afa4-40ca901e3c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:58.785907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c09b1-deea-456d-afa4-40ca901e3c33 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:58.786213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c09b1-deea-456d-afa4-40ca901e3c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:58.786497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c09b1-deea-456d-afa4-40ca901e3c33 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:58.787225 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c09b1-deea-456d-afa4-40ca901e3c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:58.790341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c09b1-deea-456d-afa4-40ca901e3c33 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:58.832015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 866/1734] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:58 2022] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:58.833278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c09b1-deea-456d-afa4-40ca901e3c33 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:58.850847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c09b1-deea-456d-afa4-40ca901e3c33 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:58.858905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17f682-2b3f-456b-80ab-d1a24fdeeda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:58.859618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17f682-2b3f-456b-80ab-d1a24fdeeda8 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:58.859908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17f682-2b3f-456b-80ab-d1a24fdeeda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:58.860188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17f682-2b3f-456b-80ab-d1a24fdeeda8 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:58.860922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17f682-2b3f-456b-80ab-d1a24fdeeda8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:58.864101 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17f682-2b3f-456b-80ab-d1a24fdeeda8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:58.945311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 867/1735] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:25:58 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:25:58.949026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17f682-2b3f-456b-80ab-d1a24fdeeda8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:58.955879 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6f17f682-2b3f-456b-80ab-d1a24fdeeda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:58.967377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ff4e1-3398-4d54-a5ee-24a7c4db0495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:58.973381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ff4e1-3398-4d54-a5ee-24a7c4db0495 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:59.004245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 869/1736] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:59.005223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ff4e1-3398-4d54-a5ee-24a7c4db0495 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:59.031487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ff4e1-3398-4d54-a5ee-24a7c4db0495 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:59.053329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51e7d4-819d-4271-b0c6-8865b3769134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:59.056173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51e7d4-819d-4271-b0c6-8865b3769134 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:59.056521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51e7d4-819d-4271-b0c6-8865b3769134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:59.056955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51e7d4-819d-4271-b0c6-8865b3769134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:59.063693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51e7d4-819d-4271-b0c6-8865b3769134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:59.065989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51e7d4-819d-4271-b0c6-8865b3769134 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:59.092234 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 870/1737] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:59.094581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51e7d4-819d-4271-b0c6-8865b3769134 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:59.100533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ce51e7d4-819d-4271-b0c6-8865b3769134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:59.182929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17f682-2b3f-456b-80ab-d1a24fdeeda8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:59.204264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681b26b-87dc-4e65-ac74-d6bd96521644 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba61318896f43e5a68e80f38ae5f3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:59.205974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b26b-87dc-4e65-ac74-d6bd96521644 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:59.206304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b26b-87dc-4e65-ac74-d6bd96521644 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:59.208781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b26b-87dc-4e65-ac74-d6bd96521644 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:59.217445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4681b26b-87dc-4e65-ac74-d6bd96521644 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:25:59.287179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681b26b-87dc-4e65-ac74-d6bd96521644 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:59.296009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681b26b-87dc-4e65-ac74-d6bd96521644 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:59.334037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 868/1738] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:59.338473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681b26b-87dc-4e65-ac74-d6bd96521644 service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:59.374292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681b26b-87dc-4e65-ac74-d6bd96521644 service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:59.400303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e15a1-b0ba-4184-b448-c0261449d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:59.402644 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e15a1-b0ba-4184-b448-c0261449d729 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:59.402933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e15a1-b0ba-4184-b448-c0261449d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:59.403220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e15a1-b0ba-4184-b448-c0261449d729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:59.407315 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e15a1-b0ba-4184-b448-c0261449d729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:59.411702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e15a1-b0ba-4184-b448-c0261449d729 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:59.428488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51e7d4-819d-4271-b0c6-8865b3769134 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:59.440013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 869/1739] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:59.442008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e15a1-b0ba-4184-b448-c0261449d729 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:59.457095 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe25f7a-4256-4cfb-a1b6-42fba267493f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:59.458005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe25f7a-4256-4cfb-a1b6-42fba267493f service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:59.458405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe25f7a-4256-4cfb-a1b6-42fba267493f service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:59.458807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe25f7a-4256-4cfb-a1b6-42fba267493f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:59.471366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e15a1-b0ba-4184-b448-c0261449d729 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:59.483845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01e3d9-8b61-4702-b39f-e77a2ec1c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:59.485600 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01e3d9-8b61-4702-b39f-e77a2ec1c5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:59.486804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01e3d9-8b61-4702-b39f-e77a2ec1c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:59.488130 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01e3d9-8b61-4702-b39f-e77a2ec1c5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:59.490442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01e3d9-8b61-4702-b39f-e77a2ec1c5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:59.496528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01e3d9-8b61-4702-b39f-e77a2ec1c5c1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:59.502218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe25f7a-4256-4cfb-a1b6-42fba267493f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:59.510519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe25f7a-4256-4cfb-a1b6-42fba267493f service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:59.526028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 870/1740] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:25:59.527890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01e3d9-8b61-4702-b39f-e77a2ec1c5c1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:59.542176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01e3d9-8b61-4702-b39f-e77a2ec1c5c1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:59.548704 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e935a-0a02-4a82-8120-13068673aa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:59.549883 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e935a-0a02-4a82-8120-13068673aa9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:59.550277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e935a-0a02-4a82-8120-13068673aa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:59.550631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e935a-0a02-4a82-8120-13068673aa9f admin admin] PATH_INFO: `/v3/projects/ef12fc02a2d6487f870192f1a28aec67/users/e6e4565bdbb3433e92a11d4b4b28ed5d/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:59.560736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 871/1741] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:25:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:25:59.570625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe25f7a-4256-4cfb-a1b6-42fba267493f service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:59.575005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e935a-0a02-4a82-8120-13068673aa9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef12fc02a2d6487f870192f1a28aec67, user_id=e6e4565bdbb3433e92a11d4b4b28ed5d, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:59.578511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e935a-0a02-4a82-8120-13068673aa9f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:59.604784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 871/1742] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:59 2022] PUT /identity/v3/projects/ef12fc02a2d6487f870192f1a28aec67/users/e6e4565bdbb3433e92a11d4b4b28ed5d/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:59.606012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e935a-0a02-4a82-8120-13068673aa9f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:59.668982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:59.678341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe25f7a-4256-4cfb-a1b6-42fba267493f service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:59.743414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e935a-0a02-4a82-8120-13068673aa9f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:59.755492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1929bc-aae7-46b2-ba82-d530e3a4cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:59.756489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1929bc-aae7-46b2-ba82-d530e3a4cc3f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:59.757395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1929bc-aae7-46b2-ba82-d530e3a4cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:59.758475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1929bc-aae7-46b2-ba82-d530e3a4cc3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:59.762202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1929bc-aae7-46b2-ba82-d530e3a4cc3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:59.765536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1929bc-aae7-46b2-ba82-d530e3a4cc3f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:59.781295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 872/1743] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:25:59.787147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1929bc-aae7-46b2-ba82-d530e3a4cc3f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:25:59.813371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1929bc-aae7-46b2-ba82-d530e3a4cc3f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:25:59.822861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34c7b5-f83f-49f8-82fb-d8848d651afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:25:59.824304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34c7b5-f83f-49f8-82fb-d8848d651afb admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:59.825018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34c7b5-f83f-49f8-82fb-d8848d651afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:59.825868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34c7b5-f83f-49f8-82fb-d8848d651afb admin admin] PATH_INFO: `/v3/projects/ef12fc02a2d6487f870192f1a28aec67/users/e6e4565bdbb3433e92a11d4b4b28ed5d/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:59.829682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34c7b5-f83f-49f8-82fb-d8848d651afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef12fc02a2d6487f870192f1a28aec67, user_id=e6e4565bdbb3433e92a11d4b4b28ed5d, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:25:59.833762 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34c7b5-f83f-49f8-82fb-d8848d651afb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:25:59.856778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 873/1744] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:59 2022] PUT /identity/v3/projects/ef12fc02a2d6487f870192f1a28aec67/users/e6e4565bdbb3433e92a11d4b4b28ed5d/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:25:59.868916 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8809083-db0f-4943-9485-3ff4e8315dd7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:25:59.870152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8809083-db0f-4943-9485-3ff4e8315dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:25:59.870647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8809083-db0f-4943-9485-3ff4e8315dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:25:59.954058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:25:59.962348 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c8809083-db0f-4943-9485-3ff4e8315dd7 None None] MFA Rules not processed for user `e6e4565bdbb3433e92a11d4b4b28ed5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:25:59.965385 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c8809083-db0f-4943-9485-3ff4e8315dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:00.026285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89014961-0bc2-4244-b131-68225e3c709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:00.030540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89014961-0bc2-4244-b131-68225e3c709d admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:00.032934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89014961-0bc2-4244-b131-68225e3c709d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:00.033438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89014961-0bc2-4244-b131-68225e3c709d admin admin] PATH_INFO: `/v3/projects/45514c81945b4d47884eb130f668872c/users/9579cde5b8a84dd680dffb1698e7fb03/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:00.087930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89014961-0bc2-4244-b131-68225e3c709d admin admin] RBAC: Authorizing `identity:create_grant(project_id=45514c81945b4d47884eb130f668872c, user_id=9579cde5b8a84dd680dffb1698e7fb03, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:00.096450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89014961-0bc2-4244-b131-68225e3c709d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:00.157801 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 872/1745] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:25:59 2022] PUT /identity/v3/projects/45514c81945b4d47884eb130f668872c/users/9579cde5b8a84dd680dffb1698e7fb03/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:00.170459 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699ff5-e346-482c-b174-b39f3fe8997c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:00.170994 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699ff5-e346-482c-b174-b39f3fe8997c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:00.171456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699ff5-e346-482c-b174-b39f3fe8997c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:00.260111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 874/1746] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:25:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:26:00.270621 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f1699ff5-e346-482c-b174-b39f3fe8997c None None] MFA Rules not processed for user `9579cde5b8a84dd680dffb1698e7fb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:00.272346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f1699ff5-e346-482c-b174-b39f3fe8997c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:00.302141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8809083-db0f-4943-9485-3ff4e8315dd7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:00.465401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8809083-db0f-4943-9485-3ff4e8315dd7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:00.489903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 873/1747] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:00.492015 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1699ff5-e346-482c-b174-b39f3fe8997c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:00.630072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:00.646652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d4d3f-3d87-4360-aa20-c44002292821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:00.650261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d4d3f-3d87-4360-aa20-c44002292821 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:00.652098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d4d3f-3d87-4360-aa20-c44002292821 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:00.654495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d4d3f-3d87-4360-aa20-c44002292821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:00.732603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1699ff5-e346-482c-b174-b39f3fe8997c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:00.739887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55c53f-0a4d-4fb5-bf47-a748d1f3edc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:00.740919 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55c53f-0a4d-4fb5-bf47-a748d1f3edc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:00.742002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55c53f-0a4d-4fb5-bf47-a748d1f3edc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:00.742427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55c53f-0a4d-4fb5-bf47-a748d1f3edc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:00.743302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55c53f-0a4d-4fb5-bf47-a748d1f3edc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:00.747918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55c53f-0a4d-4fb5-bf47-a748d1f3edc4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:00.839100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 874/1748] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:00 2022] POST /identity/v3/projects => generated 367 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:00.843988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55c53f-0a4d-4fb5-bf47-a748d1f3edc4 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:00.895441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d4d3f-3d87-4360-aa20-c44002292821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:00.902606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d4d3f-3d87-4360-aa20-c44002292821 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:00.943020 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 875/1749] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:00.946967 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d4d3f-3d87-4360-aa20-c44002292821 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:00.978951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d4d3f-3d87-4360-aa20-c44002292821 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:00.989126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:01.064982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55c53f-0a4d-4fb5-bf47-a748d1f3edc4 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:01.086780 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:01.088146 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:01.088643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:01.089326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] PATH_INFO: `/v3/users/fc22bdfd2c644dbfa9e2ef2412b81c6b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:01.093268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc22bdfd2c644dbfa9e2ef2412b81c6b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:01.095955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:01.207765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dc254-9bc8-49d0-9cf6-3afa5a12b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:01.209114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dc254-9bc8-49d0-9cf6-3afa5a12b0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:01.209114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dc254-9bc8-49d0-9cf6-3afa5a12b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:01.209310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dc254-9bc8-49d0-9cf6-3afa5a12b0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:01.211272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dc254-9bc8-49d0-9cf6-3afa5a12b0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:01.212512 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dc254-9bc8-49d0-9cf6-3afa5a12b0c5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:01.318011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc22bdfd2c644dbfa9e2ef2412b81c6b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:01.330241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 876/1750] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:00 2022] POST /identity/v3/users => generated 290 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:01.333767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dc254-9bc8-49d0-9cf6-3afa5a12b0c5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:01.375549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dc254-9bc8-49d0-9cf6-3afa5a12b0c5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:01.385251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc22bdfd2c644dbfa9e2ef2412b81c6b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:01.394065 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:01.398102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:01.402375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:01.402786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] PATH_INFO: `/v3/users/9daab7a53d0147868fc1b8528168f3f6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:01.405972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9daab7a53d0147868fc1b8528168f3f6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:01.416322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc22bdfd2c644dbfa9e2ef2412b81c6b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:01.417614 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:01.444144 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc22bdfd2c644dbfa9e2ef2412b81c6b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:01.445973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc22bdfd2c644dbfa9e2ef2412b81c6b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:01.480635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 875/1751] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:00 2022] DELETE /identity/v3/users/fc22bdfd2c644dbfa9e2ef2412b81c6b => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:01.485782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:01.494926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:01.607315 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9daab7a53d0147868fc1b8528168f3f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:01.656808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9daab7a53d0147868fc1b8528168f3f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:01.686563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9daab7a53d0147868fc1b8528168f3f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:01.714018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9daab7a53d0147868fc1b8528168f3f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:01.714768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9daab7a53d0147868fc1b8528168f3f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:01.716556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:01.736356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 877/1752] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:01 2022] DELETE /identity/v3/users/9daab7a53d0147868fc1b8528168f3f6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:01.739339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:01.742019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:01.753631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930c4e9-8917-434a-b105-c9eee8bbdc9c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:01.917439 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ae474-ff8c-446a-b553-315d8343beeb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:01.930096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb55f05-2c1a-4814-9ae7-b0d2260ced2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:01.930810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb55f05-2c1a-4814-9ae7-b0d2260ced2c admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:01.931563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb55f05-2c1a-4814-9ae7-b0d2260ced2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:01.931563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb55f05-2c1a-4814-9ae7-b0d2260ced2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:01.935646 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:01.937220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:01.938642 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:01.939291 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] PATH_INFO: `/v3/users/64c90e104cab4e29be7452e1cd9c0513` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:01.941625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb55f05-2c1a-4814-9ae7-b0d2260ced2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:01.942752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c90e104cab4e29be7452e1cd9c0513)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:01.943718 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb55f05-2c1a-4814-9ae7-b0d2260ced2c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:01.952311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:01.970992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 876/1753] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:01.970992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ff82e-6503-445c-876b-282cdf5ded18 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:01.970992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ff82e-6503-445c-876b-282cdf5ded18 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:01.970992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ff82e-6503-445c-876b-282cdf5ded18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:01.981331 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:02.039498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-973ff82e-6503-445c-876b-282cdf5ded18 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:02.040993 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-973ff82e-6503-445c-876b-282cdf5ded18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:02.086451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 877/1754] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:02.088309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b198c0-7068-479a-a040-9f5958fa3fd1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:02.088653 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b198c0-7068-479a-a040-9f5958fa3fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:02.089869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b198c0-7068-479a-a040-9f5958fa3fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:02.098369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c90e104cab4e29be7452e1cd9c0513'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:02.122810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c90e104cab4e29be7452e1cd9c0513'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:02.143462 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c90e104cab4e29be7452e1cd9c0513'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:02.161757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c90e104cab4e29be7452e1cd9c0513'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:02.163054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c90e104cab4e29be7452e1cd9c0513'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:02.173688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-11b198c0-7068-479a-a040-9f5958fa3fd1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:02.175004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-11b198c0-7068-479a-a040-9f5958fa3fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:02.190595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 878/1755] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:01 2022] DELETE /identity/v3/users/64c90e104cab4e29be7452e1cd9c0513 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:02.191955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:02.221269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:02.359683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 878/1756] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:02.360948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b198c0-7068-479a-a040-9f5958fa3fd1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:02.369350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-11b198c0-7068-479a-a040-9f5958fa3fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:02.513194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b198c0-7068-479a-a040-9f5958fa3fd1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:02.524187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3ecae-92ce-4786-ab64-b7f4636958e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:02.544280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3ecae-92ce-4786-ab64-b7f4636958e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:02.544622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3ecae-92ce-4786-ab64-b7f4636958e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:02.544922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3ecae-92ce-4786-ab64-b7f4636958e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:02.557892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f9a3ecae-92ce-4786-ab64-b7f4636958e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:02.570168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc54b3-2442-4974-9765-d9c8a0bcc002 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:02.594867 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89f91f-00ef-4dc6-93e8-2af30de5bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:02.619178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3ecae-92ce-4786-ab64-b7f4636958e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:02.620670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3ecae-92ce-4786-ab64-b7f4636958e6 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:02.621433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89f91f-00ef-4dc6-93e8-2af30de5bb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:02.621801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89f91f-00ef-4dc6-93e8-2af30de5bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:02.622091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89f91f-00ef-4dc6-93e8-2af30de5bb07 admin admin] PATH_INFO: `/v3/projects/e9d608c8cfdb402cae304e650e3953d0/users/c44638b526ab430b97d58afa1d4dd4ec/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:02.649452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 879/1757] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:02.650661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780470e8-f34b-4556-bf0b-24b522dacdc3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:02.650939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780470e8-f34b-4556-bf0b-24b522dacdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:02.651224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780470e8-f34b-4556-bf0b-24b522dacdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:02.703475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-780470e8-f34b-4556-bf0b-24b522dacdc3 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:02.704811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-780470e8-f34b-4556-bf0b-24b522dacdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:02.705013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89f91f-00ef-4dc6-93e8-2af30de5bb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d608c8cfdb402cae304e650e3953d0, user_id=c44638b526ab430b97d58afa1d4dd4ec, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:02.743616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89f91f-00ef-4dc6-93e8-2af30de5bb07 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:02.762233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 880/1758] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:02.764468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780470e8-f34b-4556-bf0b-24b522dacdc3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:02.767824 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-780470e8-f34b-4556-bf0b-24b522dacdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:02.776324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:02.795413 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 879/1759] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:02 2022] PUT /identity/v3/projects/e9d608c8cfdb402cae304e650e3953d0/users/c44638b526ab430b97d58afa1d4dd4ec/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:02.800149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89f91f-00ef-4dc6-93e8-2af30de5bb07 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:02.823209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780470e8-f34b-4556-bf0b-24b522dacdc3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:02.979350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89f91f-00ef-4dc6-93e8-2af30de5bb07 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:02.996846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c1ace-81bd-40ac-bf07-2855c730c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:02.997832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c1ace-81bd-40ac-bf07-2855c730c93a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:02.997832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c1ace-81bd-40ac-bf07-2855c730c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:02.998104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c1ace-81bd-40ac-bf07-2855c730c93a admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:02.998857 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c1ace-81bd-40ac-bf07-2855c730c93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:03.000515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c1ace-81bd-40ac-bf07-2855c730c93a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:03.027186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab210-bcce-4db1-9e3e-1d53e893115a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:03.028154 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab210-bcce-4db1-9e3e-1d53e893115a service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:03.028452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab210-bcce-4db1-9e3e-1d53e893115a service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:03.029649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 880/1760] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:03.030652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c1ace-81bd-40ac-bf07-2855c730c93a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:03.031102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab210-bcce-4db1-9e3e-1d53e893115a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:03.054112 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c1ace-81bd-40ac-bf07-2855c730c93a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:03.055272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab210-bcce-4db1-9e3e-1d53e893115a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:03.062783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab210-bcce-4db1-9e3e-1d53e893115a service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:03.065673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1077cf-aaf7-4296-8f8a-7de77102a723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:03.066361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1077cf-aaf7-4296-8f8a-7de77102a723 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:03.066646 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1077cf-aaf7-4296-8f8a-7de77102a723 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:03.066924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1077cf-aaf7-4296-8f8a-7de77102a723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:03.095076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 881/1761] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:03.096030 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab210-bcce-4db1-9e3e-1d53e893115a service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:03.120654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab210-bcce-4db1-9e3e-1d53e893115a service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:03.124402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1077cf-aaf7-4296-8f8a-7de77102a723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:03.125232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1077cf-aaf7-4296-8f8a-7de77102a723 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:03.143641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dae99-cc52-4be1-997d-4de1d875f7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:03.144570 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dae99-cc52-4be1-997d-4de1d875f7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:03.144904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dae99-cc52-4be1-997d-4de1d875f7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:03.145236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dae99-cc52-4be1-997d-4de1d875f7d5 admin admin] PATH_INFO: `/v3/projects/e9d608c8cfdb402cae304e650e3953d0/users/c44638b526ab430b97d58afa1d4dd4ec/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:03.153778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81dae99-cc52-4be1-997d-4de1d875f7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d608c8cfdb402cae304e650e3953d0, user_id=c44638b526ab430b97d58afa1d4dd4ec, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:03.158992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81dae99-cc52-4be1-997d-4de1d875f7d5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:03.164495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 881/1762] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:03.179399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 882/1763] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:03 2022] PUT /identity/v3/projects/e9d608c8cfdb402cae304e650e3953d0/users/c44638b526ab430b97d58afa1d4dd4ec/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:03.190176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341c7b4-7ba3-406e-ae81-c419e573f22d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:03.190487 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341c7b4-7ba3-406e-ae81-c419e573f22d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:03.190742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341c7b4-7ba3-406e-ae81-c419e573f22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:03.228687 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9341c7b4-7ba3-406e-ae81-c419e573f22d None None] MFA Rules not processed for user `c44638b526ab430b97d58afa1d4dd4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:03.230500 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9341c7b4-7ba3-406e-ae81-c419e573f22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:03.415340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7738-975f-4caf-b932-859e12e8b40e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:03.415639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7738-975f-4caf-b932-859e12e8b40e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:03.415922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7738-975f-4caf-b932-859e12e8b40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:03.436831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 882/1764] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:03.450591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341c7b4-7ba3-406e-ae81-c419e573f22d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:03.465401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9341c7b4-7ba3-406e-ae81-c419e573f22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:03.472594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-04db7738-975f-4caf-b932-859e12e8b40e None None] MFA Rules not processed for user `0383866c48dc4e6a99608d3079d15ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:03.473865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-04db7738-975f-4caf-b932-859e12e8b40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:03.524897 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:03.636669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 883/1765] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:03.638412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a23a0-cddb-4a81-82df-07dcb9c5ae20 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:03.638860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a23a0-cddb-4a81-82df-07dcb9c5ae20 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:03.639315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a23a0-cddb-4a81-82df-07dcb9c5ae20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:03.698125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341c7b4-7ba3-406e-ae81-c419e573f22d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:03.717961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7707-1ab7-4308-b994-1e4fced9412e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:03.718715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7707-1ab7-4308-b994-1e4fced9412e service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:03.718940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7707-1ab7-4308-b994-1e4fced9412e service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:03.719225 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7707-1ab7-4308-b994-1e4fced9412e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:03.751751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b7707-1ab7-4308-b994-1e4fced9412e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:03.753268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b7707-1ab7-4308-b994-1e4fced9412e service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:03.786118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 883/1766] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:03.800251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ce5a23a0-cddb-4a81-82df-07dcb9c5ae20 None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:03.802272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ce5a23a0-cddb-4a81-82df-07dcb9c5ae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:03.967793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7707-1ab7-4308-b994-1e4fced9412e service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:03.986338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7707-1ab7-4308-b994-1e4fced9412e service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:04.006400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824875b1-6b0b-4730-912a-ba3d0a55a84e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:04.007898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824875b1-6b0b-4730-912a-ba3d0a55a84e service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:04.007898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824875b1-6b0b-4730-912a-ba3d0a55a84e service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:04.008186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824875b1-6b0b-4730-912a-ba3d0a55a84e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:04.017418 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-824875b1-6b0b-4730-912a-ba3d0a55a84e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:04.037590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:04.057104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 884/1767] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:26:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:04.072605 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a23a0-cddb-4a81-82df-07dcb9c5ae20 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:04.075634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ce5a23a0-cddb-4a81-82df-07dcb9c5ae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:04.153648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824875b1-6b0b-4730-912a-ba3d0a55a84e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:04.157435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824875b1-6b0b-4730-912a-ba3d0a55a84e service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:04.199660 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 884/1768] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:04.221640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a23a0-cddb-4a81-82df-07dcb9c5ae20 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:04.229805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b085bc7-a77f-476e-8c51-8c37c39c5c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:04.230336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b085bc7-a77f-476e-8c51-8c37c39c5c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:04.230627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b085bc7-a77f-476e-8c51-8c37c39c5c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:04.230914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b085bc7-a77f-476e-8c51-8c37c39c5c6a admin admin] PATH_INFO: `/v3/users/3a314122deb44fc8b1be75e6b0311451` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:04.236914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b085bc7-a77f-476e-8c51-8c37c39c5c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a314122deb44fc8b1be75e6b0311451)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:04.243374 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b085bc7-a77f-476e-8c51-8c37c39c5c6a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:04.337050 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824875b1-6b0b-4730-912a-ba3d0a55a84e service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:04.338681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-824875b1-6b0b-4730-912a-ba3d0a55a84e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:04.356216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:04.373626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2b085bc7-a77f-476e-8c51-8c37c39c5c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a314122deb44fc8b1be75e6b0311451'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:04.406858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2b085bc7-a77f-476e-8c51-8c37c39c5c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a314122deb44fc8b1be75e6b0311451'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:04.424135 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2b085bc7-a77f-476e-8c51-8c37c39c5c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a314122deb44fc8b1be75e6b0311451'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:04.439982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2b085bc7-a77f-476e-8c51-8c37c39c5c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a314122deb44fc8b1be75e6b0311451'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:04.441230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2b085bc7-a77f-476e-8c51-8c37c39c5c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a314122deb44fc8b1be75e6b0311451'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:04.458705 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 885/1769] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:04 2022] DELETE /identity/v3/users/3a314122deb44fc8b1be75e6b0311451 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:04.467617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a0efb-dd2b-4cdf-a7cc-2f4582922b59 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:04.468405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a0efb-dd2b-4cdf-a7cc-2f4582922b59 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:04.468905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a0efb-dd2b-4cdf-a7cc-2f4582922b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:04.524672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3f6a0efb-dd2b-4cdf-a7cc-2f4582922b59 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:04.526855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3f6a0efb-dd2b-4cdf-a7cc-2f4582922b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:04.566625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824875b1-6b0b-4730-912a-ba3d0a55a84e service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:04.778448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 886/1770] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:04.779543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a0efb-dd2b-4cdf-a7cc-2f4582922b59 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:04.781486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3f6a0efb-dd2b-4cdf-a7cc-2f4582922b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:04.784385 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002266f-1b4b-47bc-9a81-9035ea64eb67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:04.786300 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002266f-1b4b-47bc-9a81-9035ea64eb67 service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:04.786727 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002266f-1b4b-47bc-9a81-9035ea64eb67 service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:04.787295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002266f-1b4b-47bc-9a81-9035ea64eb67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:04.796794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4002266f-1b4b-47bc-9a81-9035ea64eb67 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:04.803557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a0efb-dd2b-4cdf-a7cc-2f4582922b59 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:04.809235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:04.810185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:04.811315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:04.811672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] PATH_INFO: `/v3/projects/88992af645d54bb1828c36a38a36f23e` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:04.821800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=88992af645d54bb1828c36a38a36f23e)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:04.823933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:04.913789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:04.936932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88992af645d54bb1828c36a38a36f23e', 'request_id': 'req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:04.963372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88992af645d54bb1828c36a38a36f23e', 'request_id': 'req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:04.972295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88992af645d54bb1828c36a38a36f23e', 'request_id': 'req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:04.975785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002266f-1b4b-47bc-9a81-9035ea64eb67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:04.978182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002266f-1b4b-47bc-9a81-9035ea64eb67 service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:04.992295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 885/1771] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:26:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 15:26:04.994289 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002266f-1b4b-47bc-9a81-9035ea64eb67 service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:04.998649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4002266f-1b4b-47bc-9a81-9035ea64eb67 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:05.018129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002266f-1b4b-47bc-9a81-9035ea64eb67 service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:05.022174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] The token cache is being invalidate because project 88992af645d54bb1828c36a38a36f23e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:05.022717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:05.024854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:05.029722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 887/1772] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:04 2022] DELETE /identity/v3/projects/88992af645d54bb1828c36a38a36f23e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:05.029722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:05.031826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:05.138249 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:05.177161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4a9f0-7ed9-4af6-bb21-e81e6c1ad45b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:05.200090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571a54a-b79d-48ab-8304-8cbd8381d140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:05.211437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571a54a-b79d-48ab-8304-8cbd8381d140 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:05.226144 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571a54a-b79d-48ab-8304-8cbd8381d140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:05.229411 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571a54a-b79d-48ab-8304-8cbd8381d140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:05.242965 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8571a54a-b79d-48ab-8304-8cbd8381d140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:05.256106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:05.260369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:05.260369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:05.261672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] PATH_INFO: `/v3/projects/a7563a942ff4426c9389176a4cf84d58` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:05.267568 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7563a942ff4426c9389176a4cf84d58)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:05.278352 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:05.278788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571a54a-b79d-48ab-8304-8cbd8381d140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:05.280838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571a54a-b79d-48ab-8304-8cbd8381d140 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:05.314064 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 888/1773] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:05.315707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571a54a-b79d-48ab-8304-8cbd8381d140 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:05.317492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8571a54a-b79d-48ab-8304-8cbd8381d140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:05.367490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571a54a-b79d-48ab-8304-8cbd8381d140 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:05.392445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:05.394292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:05.394883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:05.395976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] PATH_INFO: `/v3/users/e6e4565bdbb3433e92a11d4b4b28ed5d` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:05.399872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e4565bdbb3433e92a11d4b4b28ed5d)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:05.414267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:05.492597 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7563a942ff4426c9389176a4cf84d58', 'request_id': 'req-2be81656-8b92-44f8-8143-a3ba36765a96'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:05.516782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7563a942ff4426c9389176a4cf84d58', 'request_id': 'req-2be81656-8b92-44f8-8143-a3ba36765a96'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:05.539017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7563a942ff4426c9389176a4cf84d58', 'request_id': 'req-2be81656-8b92-44f8-8143-a3ba36765a96'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:05.596359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] The token cache is being invalidate because project a7563a942ff4426c9389176a4cf84d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:05.597750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:05.600283 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:05.610348 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 886/1774] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:04 2022] DELETE /identity/v3/projects/a7563a942ff4426c9389176a4cf84d58 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:05.615703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:05.617181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e4565bdbb3433e92a11d4b4b28ed5d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:05.618894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:05.695733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e4565bdbb3433e92a11d4b4b28ed5d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:05.717423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e4565bdbb3433e92a11d4b4b28ed5d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:05.745393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e4565bdbb3433e92a11d4b4b28ed5d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:05.746257 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e4565bdbb3433e92a11d4b4b28ed5d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:05.789950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 889/1775] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:05 2022] DELETE /identity/v3/users/e6e4565bdbb3433e92a11d4b4b28ed5d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:05.864758 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be81656-8b92-44f8-8143-a3ba36765a96 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:05.899588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:06.054550 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:06.055498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:06.055824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:06.056171 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] PATH_INFO: `/v3/users/4ac860da49f249cfb08ceb7f78b1ae53` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:06.066328 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac860da49f249cfb08ceb7f78b1ae53)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:06.074309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:06.227001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac860da49f249cfb08ceb7f78b1ae53'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:06.253831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac860da49f249cfb08ceb7f78b1ae53'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:06.264589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac860da49f249cfb08ceb7f78b1ae53'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:06.277539 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac860da49f249cfb08ceb7f78b1ae53'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:06.278176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac860da49f249cfb08ceb7f78b1ae53'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:06.294331 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 887/1776] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:05 2022] DELETE /identity/v3/users/4ac860da49f249cfb08ceb7f78b1ae53 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:06.594300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:06.599908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:06.635608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69795d-6f12-4316-afca-5b48a5b3ab68 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:06.825439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:06.829317 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:06.829890 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:06.830418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de admin admin] PATH_INFO: `/v3/projects/eaa930186f1447c6a945a70a7a66a4ea` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:06.842803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa930186f1447c6a945a70a7a66a4ea)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:06.845162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:07.005255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa930186f1447c6a945a70a7a66a4ea', 'request_id': 'req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.028344 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa930186f1447c6a945a70a7a66a4ea', 'request_id': 'req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.032005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:07.043209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa930186f1447c6a945a70a7a66a4ea', 'request_id': 'req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.062241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de admin admin] The token cache is being invalidate because project eaa930186f1447c6a945a70a7a66a4ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:07.062692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.063498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3b63b22b-15f7-4f0d-b0ee-55e41c6f32de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.066236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 890/1777] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:06 2022] DELETE /identity/v3/projects/eaa930186f1447c6a945a70a7a66a4ea => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:07.070799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:07.072702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:07.112716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1e4ed-559a-44f6-9832-a1e7d7450f57 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:07.224115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088db0b-6bd1-4057-b5de-cd3512dc7b98 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:07.224455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088db0b-6bd1-4057-b5de-cd3512dc7b98 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:07.224745 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088db0b-6bd1-4057-b5de-cd3512dc7b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:07.259275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:07.262354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:07.262927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:07.265489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] PATH_INFO: `/v3/users/468afd3921a14a80b11eb2480e5bad94` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:07.267454 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=468afd3921a14a80b11eb2480e5bad94)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:07.268074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2088db0b-6bd1-4057-b5de-cd3512dc7b98 None None] MFA Rules not processed for user `0c4b2c84be7d4670a7232ae93db14740`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:07.269371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2088db0b-6bd1-4057-b5de-cd3512dc7b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:07.274498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:07.390359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:07.424488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468afd3921a14a80b11eb2480e5bad94'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.444663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 891/1778] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:07.446632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088db0b-6bd1-4057-b5de-cd3512dc7b98 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:07.448313 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2088db0b-6bd1-4057-b5de-cd3512dc7b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:07.460717 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468afd3921a14a80b11eb2480e5bad94'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.494953 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468afd3921a14a80b11eb2480e5bad94'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.498669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088db0b-6bd1-4057-b5de-cd3512dc7b98 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:07.503874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe9adb-c176-40a0-91d9-2c9d20448848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:07.504760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe9adb-c176-40a0-91d9-2c9d20448848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:07.505084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe9adb-c176-40a0-91d9-2c9d20448848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:07.505358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe9adb-c176-40a0-91d9-2c9d20448848 admin admin] PATH_INFO: `/v3/projects/ef12fc02a2d6487f870192f1a28aec67` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:07.508186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe9adb-c176-40a0-91d9-2c9d20448848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef12fc02a2d6487f870192f1a28aec67)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:07.509056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468afd3921a14a80b11eb2480e5bad94'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.510179 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe9adb-c176-40a0-91d9-2c9d20448848 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:07.511065 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468afd3921a14a80b11eb2480e5bad94'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.535102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 888/1779] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:07 2022] DELETE /identity/v3/users/468afd3921a14a80b11eb2480e5bad94 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:07.537612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:07.540834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:07.610244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-73fe9adb-c176-40a0-91d9-2c9d20448848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef12fc02a2d6487f870192f1a28aec67', 'request_id': 'req-73fe9adb-c176-40a0-91d9-2c9d20448848'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.637202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-73fe9adb-c176-40a0-91d9-2c9d20448848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef12fc02a2d6487f870192f1a28aec67', 'request_id': 'req-73fe9adb-c176-40a0-91d9-2c9d20448848'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.680115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-73fe9adb-c176-40a0-91d9-2c9d20448848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef12fc02a2d6487f870192f1a28aec67', 'request_id': 'req-73fe9adb-c176-40a0-91d9-2c9d20448848'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.704556 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-73fe9adb-c176-40a0-91d9-2c9d20448848 admin admin] The token cache is being invalidate because project ef12fc02a2d6487f870192f1a28aec67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:07.705983 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-73fe9adb-c176-40a0-91d9-2c9d20448848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.708323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-73fe9adb-c176-40a0-91d9-2c9d20448848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:07.721960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 892/1780] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:07 2022] DELETE /identity/v3/projects/ef12fc02a2d6487f870192f1a28aec67 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:07.729802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330556-b97f-4080-9bf6-6f5ad2fdaa9b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:07.732417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330556-b97f-4080-9bf6-6f5ad2fdaa9b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:07.732628 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330556-b97f-4080-9bf6-6f5ad2fdaa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:07.765119 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd0b9-12a4-4c07-a812-e68f55cddf04 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:07.777220 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8a330556-b97f-4080-9bf6-6f5ad2fdaa9b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:07.778738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8a330556-b97f-4080-9bf6-6f5ad2fdaa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:07.933725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1efac-8176-4d74-9d4f-f91f600e01fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:07.935786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1efac-8176-4d74-9d4f-f91f600e01fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:07.937324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1efac-8176-4d74-9d4f-f91f600e01fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:07.937887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1efac-8176-4d74-9d4f-f91f600e01fe admin admin] PATH_INFO: `/v3/projects/8871ac34b9474f87a8ba2032e484e4f6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:07.942235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1efac-8176-4d74-9d4f-f91f600e01fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8871ac34b9474f87a8ba2032e484e4f6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:07.949702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1efac-8176-4d74-9d4f-f91f600e01fe admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:08.055181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 893/1781] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:08.063675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d687d-ffae-475e-a92e-7a4056f20c2a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:08.064031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d687d-ffae-475e-a92e-7a4056f20c2a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:08.065857 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d687d-ffae-475e-a92e-7a4056f20c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:08.079936 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c2d1efac-8176-4d74-9d4f-f91f600e01fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8871ac34b9474f87a8ba2032e484e4f6', 'request_id': 'req-c2d1efac-8176-4d74-9d4f-f91f600e01fe'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:08.098037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c2d1efac-8176-4d74-9d4f-f91f600e01fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8871ac34b9474f87a8ba2032e484e4f6', 'request_id': 'req-c2d1efac-8176-4d74-9d4f-f91f600e01fe'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:08.107333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:08.112588 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ff9d687d-ffae-475e-a92e-7a4056f20c2a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:08.115404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c2d1efac-8176-4d74-9d4f-f91f600e01fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8871ac34b9474f87a8ba2032e484e4f6', 'request_id': 'req-c2d1efac-8176-4d74-9d4f-f91f600e01fe'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:08.120739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ff9d687d-ffae-475e-a92e-7a4056f20c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:08.144655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c2d1efac-8176-4d74-9d4f-f91f600e01fe admin admin] The token cache is being invalidate because project 8871ac34b9474f87a8ba2032e484e4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:08.145292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c2d1efac-8176-4d74-9d4f-f91f600e01fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:08.147889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c2d1efac-8176-4d74-9d4f-f91f600e01fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:08.148510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:08.161251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 889/1782] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:07 2022] DELETE /identity/v3/projects/8871ac34b9474f87a8ba2032e484e4f6 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:08.163416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe2f22-c2d1-426b-8a64-6603cdf4b427 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:08.163805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe2f22-c2d1-426b-8a64-6603cdf4b427 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:08.164166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe2f22-c2d1-426b-8a64-6603cdf4b427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:08.233865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-60fe2f22-c2d1-426b-8a64-6603cdf4b427 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:08.235132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-60fe2f22-c2d1-426b-8a64-6603cdf4b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:08.362699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 894/1783] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:08.368918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d687d-ffae-475e-a92e-7a4056f20c2a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:08.394839 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d687d-ffae-475e-a92e-7a4056f20c2a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:08.426785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b854c-b979-4f57-949b-efe8480f80d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:08.427590 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b854c-b979-4f57-949b-efe8480f80d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:08.427870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b854c-b979-4f57-949b-efe8480f80d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:08.428166 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b854c-b979-4f57-949b-efe8480f80d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:08.429018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b854c-b979-4f57-949b-efe8480f80d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:08.429357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b854c-b979-4f57-949b-efe8480f80d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:08.443472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b854c-b979-4f57-949b-efe8480f80d6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:08.509825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 895/1784] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:08.514043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b854c-b979-4f57-949b-efe8480f80d6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:08.540095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 890/1785] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:08.563137 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e40d0b-eaf5-4312-9ef8-e2a0fe098101 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:08.568023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e40d0b-eaf5-4312-9ef8-e2a0fe098101 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:08.571445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e40d0b-eaf5-4312-9ef8-e2a0fe098101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:08.573161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b854c-b979-4f57-949b-efe8480f80d6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:08.586222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bde64e-bf29-4e42-8102-cace7dd93e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:08.586755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde64e-bf29-4e42-8102-cace7dd93e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:08.587049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde64e-bf29-4e42-8102-cace7dd93e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:08.587322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde64e-bf29-4e42-8102-cace7dd93e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:08.588030 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bde64e-bf29-4e42-8102-cace7dd93e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:08.599587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bde64e-bf29-4e42-8102-cace7dd93e5e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:08.654844 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-00e40d0b-eaf5-4312-9ef8-e2a0fe098101 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:08.656333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-00e40d0b-eaf5-4312-9ef8-e2a0fe098101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:08.674083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 891/1786] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:08.675338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e40d0b-eaf5-4312-9ef8-e2a0fe098101 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:08.678920 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-00e40d0b-eaf5-4312-9ef8-e2a0fe098101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:08.704538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e40d0b-eaf5-4312-9ef8-e2a0fe098101 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:08.714973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:08.717914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:08.718423 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:08.718861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] PATH_INFO: `/v3/projects/5bf9e9af58bf4f3b88b9257f3e543e62` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:08.729042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf9e9af58bf4f3b88b9257f3e543e62)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:08.732412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:08.756753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 896/1787] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:08 2022] POST /identity/v3/projects => generated 389 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:08.757804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bde64e-bf29-4e42-8102-cace7dd93e5e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:08.868222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf9e9af58bf4f3b88b9257f3e543e62', 'request_id': 'req-253f3c03-590f-4e02-90ab-2337befe1b76'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:08.889828 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf9e9af58bf4f3b88b9257f3e543e62', 'request_id': 'req-253f3c03-590f-4e02-90ab-2337befe1b76'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:08.916270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf9e9af58bf4f3b88b9257f3e543e62', 'request_id': 'req-253f3c03-590f-4e02-90ab-2337befe1b76'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:08.963455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] The token cache is being invalidate because project 5bf9e9af58bf4f3b88b9257f3e543e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:08.963666 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:08.966270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:08.971020 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 892/1788] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:08 2022] DELETE /identity/v3/projects/5bf9e9af58bf4f3b88b9257f3e543e62 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:08.973921 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:08.980785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:09.008121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bde64e-bf29-4e42-8102-cace7dd93e5e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:09.129533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44af0b7-0406-4899-a0e5-cb2f38014319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:09.130143 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44af0b7-0406-4899-a0e5-cb2f38014319 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:09.130427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44af0b7-0406-4899-a0e5-cb2f38014319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:09.144107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44af0b7-0406-4899-a0e5-cb2f38014319 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:09.145128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44af0b7-0406-4899-a0e5-cb2f38014319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:09.145419 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44af0b7-0406-4899-a0e5-cb2f38014319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:09.159263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44af0b7-0406-4899-a0e5-cb2f38014319 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:09.188561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 897/1789] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:09.191562 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58230b99-c68d-4fcb-85ed-762d4bd61f09 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:09.191865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58230b99-c68d-4fcb-85ed-762d4bd61f09 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:09.192147 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58230b99-c68d-4fcb-85ed-762d4bd61f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:09.220938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-58230b99-c68d-4fcb-85ed-762d4bd61f09 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:09.221244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-58230b99-c68d-4fcb-85ed-762d4bd61f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:09.238592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 898/1790] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:09.238592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58230b99-c68d-4fcb-85ed-762d4bd61f09 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:09.246837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-58230b99-c68d-4fcb-85ed-762d4bd61f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:09.298606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f3c03-590f-4e02-90ab-2337befe1b76 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:09.316139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58230b99-c68d-4fcb-85ed-762d4bd61f09 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:09.320535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38194-33c7-4c9b-8bda-40a85fa950bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:09.321396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38194-33c7-4c9b-8bda-40a85fa950bf admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:09.323485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38194-33c7-4c9b-8bda-40a85fa950bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:09.325416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38194-33c7-4c9b-8bda-40a85fa950bf admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:09.329537 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38194-33c7-4c9b-8bda-40a85fa950bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:09.332218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3b83f-2e88-4554-a07c-79f30f673d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:09.333389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3b83f-2e88-4554-a07c-79f30f673d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:09.333780 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3b83f-2e88-4554-a07c-79f30f673d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:09.334075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3b83f-2e88-4554-a07c-79f30f673d84 admin admin] PATH_INFO: `/v3/projects/f9025aa57fa6429a8c0e16b65888b64b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:09.337973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38194-33c7-4c9b-8bda-40a85fa950bf admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:09.343396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3b83f-2e88-4554-a07c-79f30f673d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9025aa57fa6429a8c0e16b65888b64b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:09.353422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3b83f-2e88-4554-a07c-79f30f673d84 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:09.376215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:09.386064 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:09.416521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 893/1791] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:08 2022] POST /identity/v3/users => generated 295 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:09.416521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38194-33c7-4c9b-8bda-40a85fa950bf admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:09.420662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-70d38194-33c7-4c9b-8bda-40a85fa950bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:09.490533 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38194-33c7-4c9b-8bda-40a85fa950bf admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:09.509275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-90d3b83f-2e88-4554-a07c-79f30f673d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9025aa57fa6429a8c0e16b65888b64b', 'request_id': 'req-90d3b83f-2e88-4554-a07c-79f30f673d84'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:09.528226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-90d3b83f-2e88-4554-a07c-79f30f673d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9025aa57fa6429a8c0e16b65888b64b', 'request_id': 'req-90d3b83f-2e88-4554-a07c-79f30f673d84'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:09.538652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-90d3b83f-2e88-4554-a07c-79f30f673d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9025aa57fa6429a8c0e16b65888b64b', 'request_id': 'req-90d3b83f-2e88-4554-a07c-79f30f673d84'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:09.568959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-90d3b83f-2e88-4554-a07c-79f30f673d84 admin admin] The token cache is being invalidate because project f9025aa57fa6429a8c0e16b65888b64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:09.570005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-90d3b83f-2e88-4554-a07c-79f30f673d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:09.572818 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-90d3b83f-2e88-4554-a07c-79f30f673d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:09.580949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 899/1792] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:09 2022] DELETE /identity/v3/projects/f9025aa57fa6429a8c0e16b65888b64b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:09.581157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a5e2-ce61-4352-9720-8cd0e59a36bf None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:09.581447 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a5e2-ce61-4352-9720-8cd0e59a36bf None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:09.582322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a5e2-ce61-4352-9720-8cd0e59a36bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:09.656283 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c447a5e2-ce61-4352-9720-8cd0e59a36bf None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:09.663065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c447a5e2-ce61-4352-9720-8cd0e59a36bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:09.875708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46027bf7-c72c-4897-a09b-d5fb364ddab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:09.880372 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46027bf7-c72c-4897-a09b-d5fb364ddab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:09.884061 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46027bf7-c72c-4897-a09b-d5fb364ddab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:09.884680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46027bf7-c72c-4897-a09b-d5fb364ddab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:09.893711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46027bf7-c72c-4897-a09b-d5fb364ddab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:09.898274 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46027bf7-c72c-4897-a09b-d5fb364ddab5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:09.982098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 894/1793] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:09 2022] POST /identity/v3/projects => generated 401 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:09.985623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ab8a5-dfb8-4f1f-a5ec-e759b0e7e0f1 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:09.985948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ab8a5-dfb8-4f1f-a5ec-e759b0e7e0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:09.986800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ab8a5-dfb8-4f1f-a5ec-e759b0e7e0f1 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:10.002302 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 895/1794] 10.222.0.64 () {54 vars in 912 bytes} [Fri Jul 15 15:26:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:26:10.003180 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ab8a5-dfb8-4f1f-a5ec-e759b0e7e0f1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:10.009372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 900/1795] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:10.010401 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447a5e2-ce61-4352-9720-8cd0e59a36bf None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:10.020058 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-596ab8a5-dfb8-4f1f-a5ec-e759b0e7e0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:10.021595 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c447a5e2-ce61-4352-9720-8cd0e59a36bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:10.063244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447a5e2-ce61-4352-9720-8cd0e59a36bf None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:10.254312 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:10.255368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:10.255739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:10.256448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] PATH_INFO: `/v3/users/63dc7da4b72d4241bf48366d0da3f300` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:10.259084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] RBAC: Authorizing `identity:delete_user(user_id=63dc7da4b72d4241bf48366d0da3f300)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:10.266062 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:10.368157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ab8a5-dfb8-4f1f-a5ec-e759b0e7e0f1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:10.394800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b8920-da43-443b-8ab2-85d9f546431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:10.398809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b8920-da43-443b-8ab2-85d9f546431f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:10.399340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b8920-da43-443b-8ab2-85d9f546431f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:10.401436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b8920-da43-443b-8ab2-85d9f546431f admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:10.403587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b8920-da43-443b-8ab2-85d9f546431f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:10.410778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b8920-da43-443b-8ab2-85d9f546431f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:10.435034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:10.462809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 896/1796] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:10.465013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63dc7da4b72d4241bf48366d0da3f300'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:10.469118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b8920-da43-443b-8ab2-85d9f546431f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:10.473999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a89b8920-da43-443b-8ab2-85d9f546431f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:10.515663 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b8920-da43-443b-8ab2-85d9f546431f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:10.538725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63dc7da4b72d4241bf48366d0da3f300'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:10.542298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beed406-666a-4df1-acad-68a6ea2286b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:10.543427 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beed406-666a-4df1-acad-68a6ea2286b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:10.544484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beed406-666a-4df1-acad-68a6ea2286b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:10.550204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beed406-666a-4df1-acad-68a6ea2286b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:10.551484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beed406-666a-4df1-acad-68a6ea2286b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:10.554976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beed406-666a-4df1-acad-68a6ea2286b8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:10.561891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63dc7da4b72d4241bf48366d0da3f300'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:10.581833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63dc7da4b72d4241bf48366d0da3f300'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:10.583008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63dc7da4b72d4241bf48366d0da3f300'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:10.592825 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 897/1797] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:10 2022] POST /identity/v3/users => generated 301 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:10.594944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c741f-f30c-4248-9902-7aec7cf3221c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:10.595270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c741f-f30c-4248-9902-7aec7cf3221c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:10.595817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c741f-f30c-4248-9902-7aec7cf3221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:10.603213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 901/1798] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:10 2022] DELETE /identity/v3/users/63dc7da4b72d4241bf48366d0da3f300 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:10.604121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:10.605937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:10.630655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c01c741f-f30c-4248-9902-7aec7cf3221c None None] MFA Rules not processed for user `88518fe83a7c4fbdb3088bb2daf04239`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:10.633019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c01c741f-f30c-4248-9902-7aec7cf3221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:10.778943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 898/1799] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:26:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:10.787237 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2536a60-6ce7-44c7-8976-3d4b4a648156 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:10.794679 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2536a60-6ce7-44c7-8976-3d4b4a648156 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:10.796289 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2536a60-6ce7-44c7-8976-3d4b4a648156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:10.844370 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:10.877527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f2536a60-6ce7-44c7-8976-3d4b4a648156 None None] MFA Rules not processed for user `88518fe83a7c4fbdb3088bb2daf04239`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:10.882419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f2536a60-6ce7-44c7-8976-3d4b4a648156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:10.902047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb58b9f-fb43-4857-a0f6-a94913bf407c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:10.909275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7532755-06ff-46ad-b484-cc2a13c36a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:10.910268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7532755-06ff-46ad-b484-cc2a13c36a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:10.910925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7532755-06ff-46ad-b484-cc2a13c36a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:10.911444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7532755-06ff-46ad-b484-cc2a13c36a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:10.912432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7532755-06ff-46ad-b484-cc2a13c36a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:10.913098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7532755-06ff-46ad-b484-cc2a13c36a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:10.916087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7532755-06ff-46ad-b484-cc2a13c36a44 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:10.931766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 899/1800] 10.222.0.79 () {58 vars in 1015 bytes} [Fri Jul 15 15:26:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:10.934980 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2536a60-6ce7-44c7-8976-3d4b4a648156 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:10.937843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 902/1801] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:10.938945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7532755-06ff-46ad-b484-cc2a13c36a44 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:10.944585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f2536a60-6ce7-44c7-8976-3d4b4a648156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:10.947496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b7532755-06ff-46ad-b484-cc2a13c36a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:10.998145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2536a60-6ce7-44c7-8976-3d4b4a648156 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:11.005846 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7532755-06ff-46ad-b484-cc2a13c36a44 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:11.014561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d3043-5d45-46c1-9e0f-245a73b4a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:11.019192 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71a397-477c-4720-b576-13ae171a5eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:11.019952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71a397-477c-4720-b576-13ae171a5eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:11.020288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71a397-477c-4720-b576-13ae171a5eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:11.020530 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71a397-477c-4720-b576-13ae171a5eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:11.021321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71a397-477c-4720-b576-13ae171a5eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:11.030406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71a397-477c-4720-b576-13ae171a5eb3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:11.030806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d3043-5d45-46c1-9e0f-245a73b4a8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:11.032172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d3043-5d45-46c1-9e0f-245a73b4a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:11.033988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d3043-5d45-46c1-9e0f-245a73b4a8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:11.036938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d3043-5d45-46c1-9e0f-245a73b4a8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:11.044033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d3043-5d45-46c1-9e0f-245a73b4a8f7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:11.063217 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 903/1802] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:11.069600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d3043-5d45-46c1-9e0f-245a73b4a8f7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:11.071629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-202d3043-5d45-46c1-9e0f-245a73b4a8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:11.075714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 900/1803] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:11.076807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71a397-477c-4720-b576-13ae171a5eb3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:11.089729 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71a397-477c-4720-b576-13ae171a5eb3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:11.108009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d3043-5d45-46c1-9e0f-245a73b4a8f7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:11.108371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785c4a2-b33e-4fc6-932e-b169318c711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:11.108371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785c4a2-b33e-4fc6-932e-b169318c711c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:11.108371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785c4a2-b33e-4fc6-932e-b169318c711c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:11.108371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785c4a2-b33e-4fc6-932e-b169318c711c admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:11.109002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785c4a2-b33e-4fc6-932e-b169318c711c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:11.114839 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e292b3-9505-4fb0-8cbc-ebe320e76331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:11.115470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e292b3-9505-4fb0-8cbc-ebe320e76331 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:11.115756 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e292b3-9505-4fb0-8cbc-ebe320e76331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:11.116089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e292b3-9505-4fb0-8cbc-ebe320e76331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:11.118333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785c4a2-b33e-4fc6-932e-b169318c711c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:11.189986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e292b3-9505-4fb0-8cbc-ebe320e76331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:11.193047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e292b3-9505-4fb0-8cbc-ebe320e76331 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:11.205492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 904/1804] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:11.207004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e292b3-9505-4fb0-8cbc-ebe320e76331 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:11.223149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 901/1805] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:11 2022] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:11.223618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785c4a2-b33e-4fc6-932e-b169318c711c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:11.235779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e292b3-9505-4fb0-8cbc-ebe320e76331 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:11.382618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cec2a-80dd-401d-941f-90ec6230bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:11.393358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cec2a-80dd-401d-941f-90ec6230bf3b admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:11.393710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cec2a-80dd-401d-941f-90ec6230bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:11.393940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cec2a-80dd-401d-941f-90ec6230bf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:11.394819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cec2a-80dd-401d-941f-90ec6230bf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:11.396386 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cec2a-80dd-401d-941f-90ec6230bf3b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:11.414253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785c4a2-b33e-4fc6-932e-b169318c711c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:11.417024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 905/1806] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:11.418031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cec2a-80dd-401d-941f-90ec6230bf3b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:11.420969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518da252-a546-4c7b-8a83-38f98d116ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:11.422822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da252-a546-4c7b-8a83-38f98d116ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:11.423415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da252-a546-4c7b-8a83-38f98d116ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:11.423972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da252-a546-4c7b-8a83-38f98d116ce9 admin admin] PATH_INFO: `/v3/projects/31169aba9608476b882e357299c3bf20/users/3469da4d5e4e446bb5b9acfd9bd27112/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:11.431011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cec2a-80dd-401d-941f-90ec6230bf3b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:11.437761 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171faeb7-6813-49b5-8310-270fe3847096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:11.438591 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171faeb7-6813-49b5-8310-270fe3847096 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:11.438880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171faeb7-6813-49b5-8310-270fe3847096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:11.439161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171faeb7-6813-49b5-8310-270fe3847096 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:11.439897 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171faeb7-6813-49b5-8310-270fe3847096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:11.442329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171faeb7-6813-49b5-8310-270fe3847096 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:11.488152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 906/1807] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:11 2022] POST /identity/v3/users => generated 282 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:11.488152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171faeb7-6813-49b5-8310-270fe3847096 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:11.490665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-171faeb7-6813-49b5-8310-270fe3847096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:11.491036 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518da252-a546-4c7b-8a83-38f98d116ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31169aba9608476b882e357299c3bf20, user_id=3469da4d5e4e446bb5b9acfd9bd27112, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:11.494439 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518da252-a546-4c7b-8a83-38f98d116ce9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:11.507716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171faeb7-6813-49b5-8310-270fe3847096 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:11.526813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:11.528074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:11.528344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 902/1808] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:11 2022] PUT /identity/v3/projects/31169aba9608476b882e357299c3bf20/users/3469da4d5e4e446bb5b9acfd9bd27112/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:11.529541 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518da252-a546-4c7b-8a83-38f98d116ce9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:11.533792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:11.534081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] PATH_INFO: `/v3/projects/00bebb43d8cf4dd6984553e1c3e6f005` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:11.535525 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=00bebb43d8cf4dd6984553e1c3e6f005)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:11.539373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:11.541934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:11.653197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00bebb43d8cf4dd6984553e1c3e6f005', 'request_id': 'req-b77c9413-9acf-4549-9bac-496e290bea4b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:11.667695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518da252-a546-4c7b-8a83-38f98d116ce9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:11.670193 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00bebb43d8cf4dd6984553e1c3e6f005', 'request_id': 'req-b77c9413-9acf-4549-9bac-496e290bea4b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:11.679259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00bebb43d8cf4dd6984553e1c3e6f005', 'request_id': 'req-b77c9413-9acf-4549-9bac-496e290bea4b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:11.691800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] The token cache is being invalidate because project 00bebb43d8cf4dd6984553e1c3e6f005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:11.692435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:11.692871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:11.695387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 907/1809] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:11 2022] DELETE /identity/v3/projects/00bebb43d8cf4dd6984553e1c3e6f005 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:11.696235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:11.697614 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:11.752480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:11.762129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76998d5-3167-4b16-9503-01692a8c2321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:11.763572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76998d5-3167-4b16-9503-01692a8c2321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:11.764428 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76998d5-3167-4b16-9503-01692a8c2321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:11.765049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76998d5-3167-4b16-9503-01692a8c2321 admin admin] PATH_INFO: `/v3/projects/d124406925184c2e8ac4f81b08684bfb/users/a24f8873e7eb4411a4cca651ea6234ad/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:11.788231 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76998d5-3167-4b16-9503-01692a8c2321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d124406925184c2e8ac4f81b08684bfb, user_id=a24f8873e7eb4411a4cca651ea6234ad, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:11.791029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76998d5-3167-4b16-9503-01692a8c2321 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:11.826590 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c9413-9acf-4549-9bac-496e290bea4b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:11.836351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 903/1810] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:11 2022] PUT /identity/v3/projects/d124406925184c2e8ac4f81b08684bfb/users/a24f8873e7eb4411a4cca651ea6234ad/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:11.841772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b657c0-f054-420a-8463-2af1bafa3e96 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:11.842166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b657c0-f054-420a-8463-2af1bafa3e96 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:11.843281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b657c0-f054-420a-8463-2af1bafa3e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:11.910635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f5b657c0-f054-420a-8463-2af1bafa3e96 None None] MFA Rules not processed for user `3469da4d5e4e446bb5b9acfd9bd27112`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:11.911904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f5b657c0-f054-420a-8463-2af1bafa3e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:11.986183 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbeb46-17e5-429c-b007-80520c509318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:11.986958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbeb46-17e5-429c-b007-80520c509318 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:11.988017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbeb46-17e5-429c-b007-80520c509318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:11.990274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbeb46-17e5-429c-b007-80520c509318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:11.993663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbeb46-17e5-429c-b007-80520c509318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:11.996484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbeb46-17e5-429c-b007-80520c509318 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:12.033107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 908/1811] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:12.033107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e20477-c02d-4ee6-8585-6585712f7c89 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.033853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e20477-c02d-4ee6-8585-6585712f7c89 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.033853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e20477-c02d-4ee6-8585-6585712f7c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.070767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b8e20477-c02d-4ee6-8585-6585712f7c89 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:12.072424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b8e20477-c02d-4ee6-8585-6585712f7c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:12.083712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 909/1812] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:12.086017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072894fd-050d-46ef-b58a-bfd1628c8e37 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.086255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072894fd-050d-46ef-b58a-bfd1628c8e37 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.086538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072894fd-050d-46ef-b58a-bfd1628c8e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.112400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 904/1813] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:12.113600 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b657c0-f054-420a-8463-2af1bafa3e96 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:12.139442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b657c0-f054-420a-8463-2af1bafa3e96 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:12.167741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-072894fd-050d-46ef-b58a-bfd1628c8e37 None None] MFA Rules not processed for user `a24f8873e7eb4411a4cca651ea6234ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:12.169134 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-072894fd-050d-46ef-b58a-bfd1628c8e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:12.176226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f83711-bf9c-440c-87f9-51f9da5c2f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:12.177333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83711-bf9c-440c-87f9-51f9da5c2f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.178381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83711-bf9c-440c-87f9-51f9da5c2f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.180483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83711-bf9c-440c-87f9-51f9da5c2f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.182769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f83711-bf9c-440c-87f9-51f9da5c2f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:12.192639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f83711-bf9c-440c-87f9-51f9da5c2f9f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:12.212721 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 905/1814] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:12.217577 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20c05-6fbb-4f4d-92c9-6ad23bc4c0f8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.219951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20c05-6fbb-4f4d-92c9-6ad23bc4c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.221030 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20c05-6fbb-4f4d-92c9-6ad23bc4c0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.222897 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:12.259510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1fa20c05-6fbb-4f4d-92c9-6ad23bc4c0f8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:12.261194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1fa20c05-6fbb-4f4d-92c9-6ad23bc4c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:12.278089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 906/1815] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:12.284944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa20c05-6fbb-4f4d-92c9-6ad23bc4c0f8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:12.290668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1fa20c05-6fbb-4f4d-92c9-6ad23bc4c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:12.306737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa20c05-6fbb-4f4d-92c9-6ad23bc4c0f8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:12.326349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71776c82-5665-4319-8bff-0e46e26245ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:12.326349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71776c82-5665-4319-8bff-0e46e26245ee admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.326349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71776c82-5665-4319-8bff-0e46e26245ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.326349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71776c82-5665-4319-8bff-0e46e26245ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.326740 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71776c82-5665-4319-8bff-0e46e26245ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:12.327146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71776c82-5665-4319-8bff-0e46e26245ee admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:12.361966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 910/1816] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:12.362929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072894fd-050d-46ef-b58a-bfd1628c8e37 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:12.366169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-072894fd-050d-46ef-b58a-bfd1628c8e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:12.383095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 907/1817] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:12 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:12.384788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71776c82-5665-4319-8bff-0e46e26245ee admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:12.406613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072894fd-050d-46ef-b58a-bfd1628c8e37 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:12.486405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71776c82-5665-4319-8bff-0e46e26245ee admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:12.492432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0b899-b2e8-4c2f-a3e8-41306b3bd625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:12.493280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:12.493902 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0b899-b2e8-4c2f-a3e8-41306b3bd625 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.494338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0b899-b2e8-4c2f-a3e8-41306b3bd625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.494740 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0b899-b2e8-4c2f-a3e8-41306b3bd625 admin admin] PATH_INFO: `/v3/projects/0717659d32c44a64a34aff8d81ca3a72/users/d52b6a7d4a15420f8b55f6a219caeba2/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.495657 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.495956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.496409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] PATH_INFO: `/v3/users/9579cde5b8a84dd680dffb1698e7fb03` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.502196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9579cde5b8a84dd680dffb1698e7fb03)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:12.504383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:12.523188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0b899-b2e8-4c2f-a3e8-41306b3bd625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0717659d32c44a64a34aff8d81ca3a72, user_id=d52b6a7d4a15420f8b55f6a219caeba2, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:12.527763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0b899-b2e8-4c2f-a3e8-41306b3bd625 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:12.549232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 908/1818] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:12 2022] PUT /identity/v3/projects/0717659d32c44a64a34aff8d81ca3a72/users/d52b6a7d4a15420f8b55f6a219caeba2/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:12.550509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0b899-b2e8-4c2f-a3e8-41306b3bd625 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:12.582893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:12.612089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9579cde5b8a84dd680dffb1698e7fb03'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:12.639951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9579cde5b8a84dd680dffb1698e7fb03'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:12.651174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9579cde5b8a84dd680dffb1698e7fb03'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:12.664243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0b899-b2e8-4c2f-a3e8-41306b3bd625 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:12.664547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9579cde5b8a84dd680dffb1698e7fb03'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:12.665502 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9579cde5b8a84dd680dffb1698e7fb03'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:12.670157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a905d-0bf6-46f1-8f51-35235fed67b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:12.671220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a905d-0bf6-46f1-8f51-35235fed67b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.671515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a905d-0bf6-46f1-8f51-35235fed67b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.671797 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a905d-0bf6-46f1-8f51-35235fed67b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.673115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a905d-0bf6-46f1-8f51-35235fed67b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:12.673263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 911/1819] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:12 2022] DELETE /identity/v3/users/9579cde5b8a84dd680dffb1698e7fb03 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:12.673363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a905d-0bf6-46f1-8f51-35235fed67b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:12.673443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:12.674513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a905d-0bf6-46f1-8f51-35235fed67b2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:12.676970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:12.688425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 909/1820] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:12.689712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a905d-0bf6-46f1-8f51-35235fed67b2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:12.691894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-989a905d-0bf6-46f1-8f51-35235fed67b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:12.714499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a905d-0bf6-46f1-8f51-35235fed67b2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:12.740967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:12.773199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d314-d8d9-4cc4-8c0d-19695903cc8e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:12.778191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed97feb-0889-4db4-b95e-29f85695b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:12.778878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed97feb-0889-4db4-b95e-29f85695b115 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.781417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed97feb-0889-4db4-b95e-29f85695b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.781417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed97feb-0889-4db4-b95e-29f85695b115 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.781417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed97feb-0889-4db4-b95e-29f85695b115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:12.782206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed97feb-0889-4db4-b95e-29f85695b115 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:12.804030 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc16b68-43aa-4b5f-b560-27513c645212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:12.805164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16b68-43aa-4b5f-b560-27513c645212 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.805507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16b68-43aa-4b5f-b560-27513c645212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.805783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16b68-43aa-4b5f-b560-27513c645212 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.806639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc16b68-43aa-4b5f-b560-27513c645212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:12.812862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc16b68-43aa-4b5f-b560-27513c645212 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:12.819995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 912/1821] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:12 2022] POST /identity/v3/projects => generated 401 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:12.819995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848bca6-dd73-444d-ab36-3cd25ae6b6ac None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.819995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848bca6-dd73-444d-ab36-3cd25ae6b6ac None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.819995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848bca6-dd73-444d-ab36-3cd25ae6b6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.836014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 910/1822] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:12 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:12.837200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013737e1-2e20-47f4-bff3-ea103ed6a90d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.837496 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013737e1-2e20-47f4-bff3-ea103ed6a90d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.837777 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013737e1-2e20-47f4-bff3-ea103ed6a90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.849299 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b848bca6-dd73-444d-ab36-3cd25ae6b6ac None None] MFA Rules not processed for user `d52b6a7d4a15420f8b55f6a219caeba2`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:12.850711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b848bca6-dd73-444d-ab36-3cd25ae6b6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:12.858023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-013737e1-2e20-47f4-bff3-ea103ed6a90d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:12.859275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-013737e1-2e20-47f4-bff3-ea103ed6a90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:12.932802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 913/1823] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:12.934002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848bca6-dd73-444d-ab36-3cd25ae6b6ac None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:12.936654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b848bca6-dd73-444d-ab36-3cd25ae6b6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:12.943931 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 911/1824] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:12.945816 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013737e1-2e20-47f4-bff3-ea103ed6a90d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:12.957820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848bca6-dd73-444d-ab36-3cd25ae6b6ac None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:12.963463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d40f8-d19c-4a95-bc6e-9e9985a1939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:12.964312 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d40f8-d19c-4a95-bc6e-9e9985a1939b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.964947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d40f8-d19c-4a95-bc6e-9e9985a1939b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.965398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d40f8-d19c-4a95-bc6e-9e9985a1939b admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.966784 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d40f8-d19c-4a95-bc6e-9e9985a1939b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:12.967327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013737e1-2e20-47f4-bff3-ea103ed6a90d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:12.968928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d40f8-d19c-4a95-bc6e-9e9985a1939b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:12.973414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e202d-4225-42e9-a693-9d6285eb3990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:12.974011 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e202d-4225-42e9-a693-9d6285eb3990 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:12.974308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e202d-4225-42e9-a693-9d6285eb3990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:12.974594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e202d-4225-42e9-a693-9d6285eb3990 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:12.975366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e202d-4225-42e9-a693-9d6285eb3990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:12.977607 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e202d-4225-42e9-a693-9d6285eb3990 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.003216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 914/1825] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:12 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:13.004533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d40f8-d19c-4a95-bc6e-9e9985a1939b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.011634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 912/1826] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:12 2022] POST /identity/v3/users => generated 307 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:13.011634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e202d-4225-42e9-a693-9d6285eb3990 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.018922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2f6e202d-4225-42e9-a693-9d6285eb3990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:13.033757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e202d-4225-42e9-a693-9d6285eb3990 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.094879 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:13.118805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d40f8-d19c-4a95-bc6e-9e9985a1939b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.125887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a76221-4780-48cb-91c1-3c86719dda9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.126612 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a76221-4780-48cb-91c1-3c86719dda9c admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.126907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a76221-4780-48cb-91c1-3c86719dda9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.127187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a76221-4780-48cb-91c1-3c86719dda9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.128002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a76221-4780-48cb-91c1-3c86719dda9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.129875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a76221-4780-48cb-91c1-3c86719dda9c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.155596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac563c4-e841-498e-bda7-821cb661c828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.156398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac563c4-e841-498e-bda7-821cb661c828 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.156758 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac563c4-e841-498e-bda7-821cb661c828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.157198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac563c4-e841-498e-bda7-821cb661c828 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.158013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac563c4-e841-498e-bda7-821cb661c828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.160077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac563c4-e841-498e-bda7-821cb661c828 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.173554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 915/1827] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:13.175724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a76221-4780-48cb-91c1-3c86719dda9c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.177980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a7a76221-4780-48cb-91c1-3c86719dda9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:13.192003 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 913/1828] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:13 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:13.193096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac563c4-e841-498e-bda7-821cb661c828 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.230037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:13.280762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a76221-4780-48cb-91c1-3c86719dda9c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.300711 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac563c4-e841-498e-bda7-821cb661c828 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.306327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e392c6-fa82-40fa-9bc2-aeb91f649a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.307046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e392c6-fa82-40fa-9bc2-aeb91f649a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.307340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e392c6-fa82-40fa-9bc2-aeb91f649a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.307625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e392c6-fa82-40fa-9bc2-aeb91f649a3c admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.308356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e392c6-fa82-40fa-9bc2-aeb91f649a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.310493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e392c6-fa82-40fa-9bc2-aeb91f649a3c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.352148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 914/1829] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:13 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:13.353625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e392c6-fa82-40fa-9bc2-aeb91f649a3c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.358926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd9421-8262-4747-b911-33a1502b7f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.359481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd9421-8262-4747-b911-33a1502b7f21 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.359788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd9421-8262-4747-b911-33a1502b7f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.360055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd9421-8262-4747-b911-33a1502b7f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.369340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e392c6-fa82-40fa-9bc2-aeb91f649a3c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.370922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd9421-8262-4747-b911-33a1502b7f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.373018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd9421-8262-4747-b911-33a1502b7f21 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.375529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fb87b-6311-4a52-83e9-0d1f665a2478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.376557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fb87b-6311-4a52-83e9-0d1f665a2478 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.376852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fb87b-6311-4a52-83e9-0d1f665a2478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.377328 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fb87b-6311-4a52-83e9-0d1f665a2478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.378148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fb87b-6311-4a52-83e9-0d1f665a2478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.380661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fb87b-6311-4a52-83e9-0d1f665a2478 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.384573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 916/1830] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:13.385746 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd9421-8262-4747-b911-33a1502b7f21 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.396486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd9421-8262-4747-b911-33a1502b7f21 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.402767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ebedb-6269-487e-94f7-f569143580da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.402987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 915/1831] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:13.403986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fb87b-6311-4a52-83e9-0d1f665a2478 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.404305 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ebedb-6269-487e-94f7-f569143580da admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.404609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ebedb-6269-487e-94f7-f569143580da admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.404868 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ebedb-6269-487e-94f7-f569143580da admin admin] PATH_INFO: `/v3/projects/6ecf18f020624eb581b5a24e446dfc20/users/7eb7c93f8bbf4092848ebf60817a84dc/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.420910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fb87b-6311-4a52-83e9-0d1f665a2478 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.424061 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ebedb-6269-487e-94f7-f569143580da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ecf18f020624eb581b5a24e446dfc20, user_id=7eb7c93f8bbf4092848ebf60817a84dc, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.427323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ebedb-6269-487e-94f7-f569143580da admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.427475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9e50e-43d2-4d47-9b11-7a491693a0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.428518 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9e50e-43d2-4d47-9b11-7a491693a0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.428811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9e50e-43d2-4d47-9b11-7a491693a0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.429169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9e50e-43d2-4d47-9b11-7a491693a0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.429891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9e50e-43d2-4d47-9b11-7a491693a0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.432862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9e50e-43d2-4d47-9b11-7a491693a0c5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.450674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 917/1832] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:13 2022] PUT /identity/v3/projects/6ecf18f020624eb581b5a24e446dfc20/users/7eb7c93f8bbf4092848ebf60817a84dc/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:13.452050 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ebedb-6269-487e-94f7-f569143580da admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.470932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 916/1833] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:13 2022] POST /identity/v3/users => generated 289 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:13.472730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9e50e-43d2-4d47-9b11-7a491693a0c5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.501580 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9e50e-43d2-4d47-9b11-7a491693a0c5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.585735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335982d4-c8ba-4499-84d1-ed28f8ddabcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.586667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335982d4-c8ba-4499-84d1-ed28f8ddabcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.586956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335982d4-c8ba-4499-84d1-ed28f8ddabcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.587238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335982d4-c8ba-4499-84d1-ed28f8ddabcb admin admin] PATH_INFO: `/v3/projects/8a852607384b4e3089a086853fb1f4db/users/e12d9a3253d245b9944bfe519ecd8604/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.607774 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:13.613584 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ebedb-6269-487e-94f7-f569143580da admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.615578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335982d4-c8ba-4499-84d1-ed28f8ddabcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a852607384b4e3089a086853fb1f4db, user_id=e12d9a3253d245b9944bfe519ecd8604, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.619699 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335982d4-c8ba-4499-84d1-ed28f8ddabcb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.622015 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f423a-fdd1-485e-87fe-0679bf591350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.622856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f423a-fdd1-485e-87fe-0679bf591350 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.623210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f423a-fdd1-485e-87fe-0679bf591350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.623581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f423a-fdd1-485e-87fe-0679bf591350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.624494 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f423a-fdd1-485e-87fe-0679bf591350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.626861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f423a-fdd1-485e-87fe-0679bf591350 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.643655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 917/1834] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:13 2022] PUT /identity/v3/projects/8a852607384b4e3089a086853fb1f4db/users/e12d9a3253d245b9944bfe519ecd8604/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:13.644979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335982d4-c8ba-4499-84d1-ed28f8ddabcb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.656474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 918/1835] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:13.657810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f423a-fdd1-485e-87fe-0679bf591350 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.671580 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f423a-fdd1-485e-87fe-0679bf591350 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.728862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335982d4-c8ba-4499-84d1-ed28f8ddabcb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.740381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c4187-3a44-4bc4-9ab9-7460c4c97baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.740867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:13.741183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c4187-3a44-4bc4-9ab9-7460c4c97baa admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.741513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c4187-3a44-4bc4-9ab9-7460c4c97baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.741800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c4187-3a44-4bc4-9ab9-7460c4c97baa admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.742606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c4187-3a44-4bc4-9ab9-7460c4c97baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.744790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c4187-3a44-4bc4-9ab9-7460c4c97baa admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.752358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb66e84-62f3-46ab-bb0f-92ba72013cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.754029 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb66e84-62f3-46ab-bb0f-92ba72013cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.754329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb66e84-62f3-46ab-bb0f-92ba72013cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.761808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 918/1836] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:13.761980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb66e84-62f3-46ab-bb0f-92ba72013cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.762247 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c4187-3a44-4bc4-9ab9-7460c4c97baa admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.769045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb66e84-62f3-46ab-bb0f-92ba72013cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.775615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb66e84-62f3-46ab-bb0f-92ba72013cb6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.778915 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c4187-3a44-4bc4-9ab9-7460c4c97baa admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.784895 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc4ad0-422c-41db-b512-e760d01a1f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.785722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc4ad0-422c-41db-b512-e760d01a1f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.786013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc4ad0-422c-41db-b512-e760d01a1f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.786488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 919/1837] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:13.787383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb66e84-62f3-46ab-bb0f-92ba72013cb6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.791498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc4ad0-422c-41db-b512-e760d01a1f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.791498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc4ad0-422c-41db-b512-e760d01a1f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.792848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc4ad0-422c-41db-b512-e760d01a1f3d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.801767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb66e84-62f3-46ab-bb0f-92ba72013cb6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.808185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f9b06-5913-48e8-a41c-ad920b5591ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.808850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f9b06-5913-48e8-a41c-ad920b5591ff admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.809360 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f9b06-5913-48e8-a41c-ad920b5591ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.814659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f9b06-5913-48e8-a41c-ad920b5591ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.814659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f9b06-5913-48e8-a41c-ad920b5591ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.814950 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 919/1838] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:13.815045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f9b06-5913-48e8-a41c-ad920b5591ff admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.815134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc4ad0-422c-41db-b512-e760d01a1f3d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.829803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc4ad0-422c-41db-b512-e760d01a1f3d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.831596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 920/1839] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:13.832683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f9b06-5913-48e8-a41c-ad920b5591ff admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.836915 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a73c0-dc88-47c0-be4d-8cf4a4ebc78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.837980 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a73c0-dc88-47c0-be4d-8cf4a4ebc78f admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.838271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a73c0-dc88-47c0-be4d-8cf4a4ebc78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.838623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a73c0-dc88-47c0-be4d-8cf4a4ebc78f admin admin] PATH_INFO: `/v3/projects/6ecf18f020624eb581b5a24e446dfc20/users/7eb7c93f8bbf4092848ebf60817a84dc/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.841321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a73c0-dc88-47c0-be4d-8cf4a4ebc78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ecf18f020624eb581b5a24e446dfc20, user_id=7eb7c93f8bbf4092848ebf60817a84dc, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.848348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f9b06-5913-48e8-a41c-ad920b5591ff admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:13.848595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a73c0-dc88-47c0-be4d-8cf4a4ebc78f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.853099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb894c-ffd3-4481-a09c-76a64857c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:13.854180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb894c-ffd3-4481-a09c-76a64857c568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:13.854620 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb894c-ffd3-4481-a09c-76a64857c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:13.855198 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb894c-ffd3-4481-a09c-76a64857c568 admin admin] PATH_INFO: `/v3/projects/574cf36d42314ffe8e9f4986e7e07361/users/1afba4964a7c449d9f1dc5842943e275/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:13.876421 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 920/1840] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:13 2022] PUT /identity/v3/projects/6ecf18f020624eb581b5a24e446dfc20/users/7eb7c93f8bbf4092848ebf60817a84dc/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:13.877397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb894c-ffd3-4481-a09c-76a64857c568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574cf36d42314ffe8e9f4986e7e07361, user_id=1afba4964a7c449d9f1dc5842943e275, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:13.880924 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb894c-ffd3-4481-a09c-76a64857c568 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:13.883375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a73c0-dc88-47c0-be4d-8cf4a4ebc78f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:13.910227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 921/1841] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:13 2022] PUT /identity/v3/projects/574cf36d42314ffe8e9f4986e7e07361/users/1afba4964a7c449d9f1dc5842943e275/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:13.911861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb894c-ffd3-4481-a09c-76a64857c568 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:14.120892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a73c0-dc88-47c0-be4d-8cf4a4ebc78f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:14.220667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb894c-ffd3-4481-a09c-76a64857c568 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:14.253957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ccde8-6a51-4956-a261-9f7853e91efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:14.255262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ccde8-6a51-4956-a261-9f7853e91efe admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:14.255578 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ccde8-6a51-4956-a261-9f7853e91efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:14.255862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ccde8-6a51-4956-a261-9f7853e91efe admin admin] PATH_INFO: `/v3/projects/08c15186a6774ebabe8fcff69d719dae/users/fe96cb98874a42b38268176a258d2764/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:14.342462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ccde8-6a51-4956-a261-9f7853e91efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c15186a6774ebabe8fcff69d719dae, user_id=fe96cb98874a42b38268176a258d2764, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:14.346348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ccde8-6a51-4956-a261-9f7853e91efe admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:14.355489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee654bb-3d28-4e66-a76e-87ccce238d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:14.359207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee654bb-3d28-4e66-a76e-87ccce238d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:14.360585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee654bb-3d28-4e66-a76e-87ccce238d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:14.361139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee654bb-3d28-4e66-a76e-87ccce238d73 admin admin] PATH_INFO: `/v3/projects/8a852607384b4e3089a086853fb1f4db/users/e12d9a3253d245b9944bfe519ecd8604/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:14.368253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee654bb-3d28-4e66-a76e-87ccce238d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a852607384b4e3089a086853fb1f4db, user_id=e12d9a3253d245b9944bfe519ecd8604, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:14.374372 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee654bb-3d28-4e66-a76e-87ccce238d73 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:14.375051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 922/1842] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:13 2022] PUT /identity/v3/projects/08c15186a6774ebabe8fcff69d719dae/users/fe96cb98874a42b38268176a258d2764/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:14.376750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642905a-5a30-4b54-8a63-9b70235d8578 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:14.377253 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642905a-5a30-4b54-8a63-9b70235d8578 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:14.377691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642905a-5a30-4b54-8a63-9b70235d8578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:14.434860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 921/1843] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:13 2022] PUT /identity/v3/projects/8a852607384b4e3089a086853fb1f4db/users/e12d9a3253d245b9944bfe519ecd8604/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:14.434860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee654bb-3d28-4e66-a76e-87ccce238d73 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:14.437445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:14.442242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5642905a-5a30-4b54-8a63-9b70235d8578 None None] MFA Rules not processed for user `7eb7c93f8bbf4092848ebf60817a84dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:14.445241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5642905a-5a30-4b54-8a63-9b70235d8578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:14.594552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee654bb-3d28-4e66-a76e-87ccce238d73 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:14.618749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09caeba-1643-4bcc-a848-1228f16424c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:14.619633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09caeba-1643-4bcc-a848-1228f16424c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:14.619934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09caeba-1643-4bcc-a848-1228f16424c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:14.620223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09caeba-1643-4bcc-a848-1228f16424c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:14.621111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09caeba-1643-4bcc-a848-1228f16424c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:14.627437 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09caeba-1643-4bcc-a848-1228f16424c3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:14.633705 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 923/1844] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:14.634312 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642905a-5a30-4b54-8a63-9b70235d8578 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:14.640312 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5642905a-5a30-4b54-8a63-9b70235d8578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:14.643482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 922/1845] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:14.645014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaa687-d1ae-41f7-a549-1995cb0a498c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:14.645615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaa687-d1ae-41f7-a549-1995cb0a498c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:14.645975 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaa687-d1ae-41f7-a549-1995cb0a498c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:14.683952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4edaa687-d1ae-41f7-a549-1995cb0a498c None None] MFA Rules not processed for user `fe96cb98874a42b38268176a258d2764`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:14.683952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4edaa687-d1ae-41f7-a549-1995cb0a498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:14.687662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642905a-5a30-4b54-8a63-9b70235d8578 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:14.694292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:14.696662 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:14.697309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:14.697795 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] PATH_INFO: `/v3/projects/45514c81945b4d47884eb130f668872c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:14.700294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45514c81945b4d47884eb130f668872c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:14.702494 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:14.730777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:14.800254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45514c81945b4d47884eb130f668872c', 'request_id': 'req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:14.827210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45514c81945b4d47884eb130f668872c', 'request_id': 'req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:14.843781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45514c81945b4d47884eb130f668872c', 'request_id': 'req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:14.876646 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 923/1846] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:14.878504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499fd4b-c241-4013-b05e-a9d65769886e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:14.879065 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499fd4b-c241-4013-b05e-a9d65769886e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:14.879585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499fd4b-c241-4013-b05e-a9d65769886e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:14.882089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] The token cache is being invalidate because project 45514c81945b4d47884eb130f668872c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:14.882604 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:14.896864 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:14.896864 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 924/1847] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:14 2022] DELETE /identity/v3/projects/45514c81945b4d47884eb130f668872c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:14.896864 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:14.902239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:14.934635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3499fd4b-c241-4013-b05e-a9d65769886e None None] MFA Rules not processed for user `e12d9a3253d245b9944bfe519ecd8604`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:14.937236 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3499fd4b-c241-4013-b05e-a9d65769886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:15.023068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a3435-8e4f-4ab5-abb8-5e4c6a54a298 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:15.030626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfe5f9-4699-4d2f-9e97-34386a714dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:15.032281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe5f9-4699-4d2f-9e97-34386a714dab admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:15.032627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe5f9-4699-4d2f-9e97-34386a714dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:15.033093 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe5f9-4699-4d2f-9e97-34386a714dab admin admin] PATH_INFO: `/v3/projects/574cf36d42314ffe8e9f4986e7e07361/users/1afba4964a7c449d9f1dc5842943e275/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:15.041806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfe5f9-4699-4d2f-9e97-34386a714dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=574cf36d42314ffe8e9f4986e7e07361, user_id=1afba4964a7c449d9f1dc5842943e275, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:15.045243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfe5f9-4699-4d2f-9e97-34386a714dab admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:15.062134 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 925/1848] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:14 2022] PUT /identity/v3/projects/574cf36d42314ffe8e9f4986e7e07361/users/1afba4964a7c449d9f1dc5842943e275/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:15.077695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfe5f9-4699-4d2f-9e97-34386a714dab admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:15.079553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a2dfe5f9-4699-4d2f-9e97-34386a714dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:15.081881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 924/1849] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:15.083001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499fd4b-c241-4013-b05e-a9d65769886e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:15.087444 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3499fd4b-c241-4013-b05e-a9d65769886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:15.119727 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499fd4b-c241-4013-b05e-a9d65769886e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:15.133623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:15.252913 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfe5f9-4699-4d2f-9e97-34386a714dab admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:15.287134 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845107a8-2594-4fe2-b6bc-587916dd3f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:15.288812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845107a8-2594-4fe2-b6bc-587916dd3f1b service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:15.289511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845107a8-2594-4fe2-b6bc-587916dd3f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:15.290403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845107a8-2594-4fe2-b6bc-587916dd3f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:15.290588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ede4fe-2d79-44d6-a45d-53c241cb45a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:15.291311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ede4fe-2d79-44d6-a45d-53c241cb45a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:15.291663 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ede4fe-2d79-44d6-a45d-53c241cb45a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:15.292040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ede4fe-2d79-44d6-a45d-53c241cb45a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:15.293492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ede4fe-2d79-44d6-a45d-53c241cb45a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:15.294658 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-845107a8-2594-4fe2-b6bc-587916dd3f1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:15.299869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ede4fe-2d79-44d6-a45d-53c241cb45a2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:15.377887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 925/1850] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:15 2022] POST /identity/v3/projects => generated 367 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:15.378743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ede4fe-2d79-44d6-a45d-53c241cb45a2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:15.380671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c4ede4fe-2d79-44d6-a45d-53c241cb45a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:15.428203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:15.474776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845107a8-2594-4fe2-b6bc-587916dd3f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:15.479284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845107a8-2594-4fe2-b6bc-587916dd3f1b service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:15.486312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ede4fe-2d79-44d6-a45d-53c241cb45a2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:15.492705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:15.493979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:15.494637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:15.494940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] PATH_INFO: `/v3/users/c44638b526ab430b97d58afa1d4dd4ec` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:15.496678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44638b526ab430b97d58afa1d4dd4ec)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:15.499404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:15.521095 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 926/1851] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:15.531386 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec6d16-3b5d-4185-b75a-51fb74bc59b4 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:15.531859 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec6d16-3b5d-4185-b75a-51fb74bc59b4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:15.532495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec6d16-3b5d-4185-b75a-51fb74bc59b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:15.599630 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44638b526ab430b97d58afa1d4dd4ec'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:15.618550 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44638b526ab430b97d58afa1d4dd4ec'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:15.638254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44638b526ab430b97d58afa1d4dd4ec'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:15.642456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-81ec6d16-3b5d-4185-b75a-51fb74bc59b4 None None] MFA Rules not processed for user `1afba4964a7c449d9f1dc5842943e275`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:15.643711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-81ec6d16-3b5d-4185-b75a-51fb74bc59b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:15.661204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44638b526ab430b97d58afa1d4dd4ec'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:15.661204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44638b526ab430b97d58afa1d4dd4ec'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:15.683735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 926/1852] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:15 2022] DELETE /identity/v3/users/c44638b526ab430b97d58afa1d4dd4ec => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:15.683735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:15.683983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:15.754115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:15.844823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef79945-d45a-4879-8ff6-b45b7b59457c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:15.852698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a0919-7371-4801-a9b0-c659fa6f1789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:15.854119 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a0919-7371-4801-a9b0-c659fa6f1789 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:15.854860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a0919-7371-4801-a9b0-c659fa6f1789 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:15.855406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a0919-7371-4801-a9b0-c659fa6f1789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:15.858489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2e9a0919-7371-4801-a9b0-c659fa6f1789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:15.873232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 927/1853] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:15.874655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec6d16-3b5d-4185-b75a-51fb74bc59b4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:15.876339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-81ec6d16-3b5d-4185-b75a-51fb74bc59b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:15.921311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec6d16-3b5d-4185-b75a-51fb74bc59b4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:15.986160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a0919-7371-4801-a9b0-c659fa6f1789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:15.987877 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a0919-7371-4801-a9b0-c659fa6f1789 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:16.020783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 927/1854] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:15 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:16.023182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a0919-7371-4801-a9b0-c659fa6f1789 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:16.054976 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2e9a0919-7371-4801-a9b0-c659fa6f1789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:16.055750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7687aab-6025-4ef5-8f54-9513780457b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:16.057840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7687aab-6025-4ef5-8f54-9513780457b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:16.058046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7687aab-6025-4ef5-8f54-9513780457b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:16.059823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7687aab-6025-4ef5-8f54-9513780457b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:16.060898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7687aab-6025-4ef5-8f54-9513780457b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:16.070332 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7687aab-6025-4ef5-8f54-9513780457b8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:16.127714 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 928/1855] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:15 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:16.129422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7687aab-6025-4ef5-8f54-9513780457b8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:16.130656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a0919-7371-4801-a9b0-c659fa6f1789 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:16.134383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c7687aab-6025-4ef5-8f54-9513780457b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:16.149333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:16.150818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:16.151318 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:16.155360 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] PATH_INFO: `/v3/users/3469da4d5e4e446bb5b9acfd9bd27112` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:16.157408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7687aab-6025-4ef5-8f54-9513780457b8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:16.157984 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3469da4d5e4e446bb5b9acfd9bd27112)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:16.160822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:16.161901 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a9558-f17b-44ab-8046-6c98c30d0c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:16.162801 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a9558-f17b-44ab-8046-6c98c30d0c11 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:16.163194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a9558-f17b-44ab-8046-6c98c30d0c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:16.163590 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a9558-f17b-44ab-8046-6c98c30d0c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:16.281783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3469da4d5e4e446bb5b9acfd9bd27112'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:16.296122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3469da4d5e4e446bb5b9acfd9bd27112'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:16.306048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3469da4d5e4e446bb5b9acfd9bd27112'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:16.307724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a9558-f17b-44ab-8046-6c98c30d0c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:16.311844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a9558-f17b-44ab-8046-6c98c30d0c11 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:16.322704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:16.331892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3469da4d5e4e446bb5b9acfd9bd27112'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:16.334071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 929/1856] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:16 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:16.341197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a9558-f17b-44ab-8046-6c98c30d0c11 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:16.346103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3469da4d5e4e446bb5b9acfd9bd27112'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:16.356877 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 928/1857] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:16 2022] DELETE /identity/v3/users/3469da4d5e4e446bb5b9acfd9bd27112 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:16.358228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:16.359499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a9558-f17b-44ab-8046-6c98c30d0c11 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:16.360169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:16.454840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:16.504880 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe5c88-18ed-4ba5-bdda-fdbf3ffa485f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:16.513792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa927153-ae44-4d06-a3a6-3836e27c7dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:16.514741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3a79-1cb3-41e5-bd0b-721ee88cbc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:16.515463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa927153-ae44-4d06-a3a6-3836e27c7dea service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:16.516751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3a79-1cb3-41e5-bd0b-721ee88cbc43 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:16.516997 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa927153-ae44-4d06-a3a6-3836e27c7dea service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:16.517401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa927153-ae44-4d06-a3a6-3836e27c7dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:16.517860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3a79-1cb3-41e5-bd0b-721ee88cbc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:16.518757 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3a79-1cb3-41e5-bd0b-721ee88cbc43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:16.520004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a3a79-1cb3-41e5-bd0b-721ee88cbc43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:16.521345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-aa927153-ae44-4d06-a3a6-3836e27c7dea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:16.524187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a3a79-1cb3-41e5-bd0b-721ee88cbc43 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:16.549779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 930/1858] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:16.549779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3a79-1cb3-41e5-bd0b-721ee88cbc43 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:16.558035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-608a3a79-1cb3-41e5-bd0b-721ee88cbc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:16.581788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3a79-1cb3-41e5-bd0b-721ee88cbc43 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:16.590586 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:16.592226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:16.592821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:16.593442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] PATH_INFO: `/v3/projects/e9d608c8cfdb402cae304e650e3953d0` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:16.595561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d608c8cfdb402cae304e650e3953d0)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:16.598981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:16.621894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa927153-ae44-4d06-a3a6-3836e27c7dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:16.623990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa927153-ae44-4d06-a3a6-3836e27c7dea service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:16.649916 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 929/1859] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:16.652299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2f794-f795-48b7-b103-bc4216986c94 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:16.653181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2f794-f795-48b7-b103-bc4216986c94 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:16.653824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2f794-f795-48b7-b103-bc4216986c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:16.692011 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-05e2f794-f795-48b7-b103-bc4216986c94 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:16.698956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-05e2f794-f795-48b7-b103-bc4216986c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:16.700341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d608c8cfdb402cae304e650e3953d0', 'request_id': 'req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:16.729178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d608c8cfdb402cae304e650e3953d0', 'request_id': 'req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:16.752969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d608c8cfdb402cae304e650e3953d0', 'request_id': 'req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:16.782412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] The token cache is being invalidate because project e9d608c8cfdb402cae304e650e3953d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:16.783048 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:16.784616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:16.792330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 931/1860] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:16 2022] DELETE /identity/v3/projects/e9d608c8cfdb402cae304e650e3953d0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:16.795053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:16.798719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:16.826785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 930/1861] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:16.826785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2f794-f795-48b7-b103-bc4216986c94 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:16.829932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-05e2f794-f795-48b7-b103-bc4216986c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:16.859264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2f794-f795-48b7-b103-bc4216986c94 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:16.869587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad313b1-2fa9-4878-8b8f-36591fb5f500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:16.870415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad313b1-2fa9-4878-8b8f-36591fb5f500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:16.882111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad313b1-2fa9-4878-8b8f-36591fb5f500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:16.882111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad313b1-2fa9-4878-8b8f-36591fb5f500 admin admin] PATH_INFO: `/v3/projects/3d8de917e11546d885678f1ca44f8fa6/users/b9282f60cad54178bf0c11ea35684424/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:16.891548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad313b1-2fa9-4878-8b8f-36591fb5f500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8de917e11546d885678f1ca44f8fa6, user_id=b9282f60cad54178bf0c11ea35684424, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:16.895210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad313b1-2fa9-4878-8b8f-36591fb5f500 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:16.916917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 931/1862] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:16 2022] PUT /identity/v3/projects/3d8de917e11546d885678f1ca44f8fa6/users/b9282f60cad54178bf0c11ea35684424/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:16.920228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6bf20-ea25-4016-8122-753541767e95 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:16.920484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6bf20-ea25-4016-8122-753541767e95 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:16.921131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6bf20-ea25-4016-8122-753541767e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:16.932673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa33e4-cbfe-486b-8d3e-2cc9d878b215 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:16.945964 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c5e6bf20-ea25-4016-8122-753541767e95 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:16.947269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c5e6bf20-ea25-4016-8122-753541767e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:16.977500 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:17.005488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cb2c2-1bf0-4ca5-8294-12a0f45034ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:17.006733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb2c2-1bf0-4ca5-8294-12a0f45034ce service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:17.007207 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb2c2-1bf0-4ca5-8294-12a0f45034ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:17.007686 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb2c2-1bf0-4ca5-8294-12a0f45034ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:17.011113 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b53cb2c2-1bf0-4ca5-8294-12a0f45034ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:17.036973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 932/1863] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:17.038869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6bf20-ea25-4016-8122-753541767e95 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:17.046341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c5e6bf20-ea25-4016-8122-753541767e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:17.069476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:17.116907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cb2c2-1bf0-4ca5-8294-12a0f45034ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:17.119995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cb2c2-1bf0-4ca5-8294-12a0f45034ce service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:17.155053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6bf20-ea25-4016-8122-753541767e95 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:17.156892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 932/1864] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:16 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:17.159023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cb2c2-1bf0-4ca5-8294-12a0f45034ce service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:17.161660 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6218bd-7f83-4552-8d6b-5d3396acf59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:17.162494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6218bd-7f83-4552-8d6b-5d3396acf59f service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:17.164215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6218bd-7f83-4552-8d6b-5d3396acf59f service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:17.164215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6218bd-7f83-4552-8d6b-5d3396acf59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:17.178527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6218bd-7f83-4552-8d6b-5d3396acf59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:17.180783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cb2c2-1bf0-4ca5-8294-12a0f45034ce service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:17.181314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6218bd-7f83-4552-8d6b-5d3396acf59f service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:17.189933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece02b2c-a193-420b-b017-49786e1dc323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:17.191737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece02b2c-a193-420b-b017-49786e1dc323 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:17.192113 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece02b2c-a193-420b-b017-49786e1dc323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:17.192654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece02b2c-a193-420b-b017-49786e1dc323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:17.194251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece02b2c-a193-420b-b017-49786e1dc323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:17.197415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece02b2c-a193-420b-b017-49786e1dc323 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:17.198503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 933/1865] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:17.200944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa688b-4e77-4fb5-aa60-b01d3f7a4f63 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:17.201657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa688b-4e77-4fb5-aa60-b01d3f7a4f63 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:17.202164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa688b-4e77-4fb5-aa60-b01d3f7a4f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:17.237293 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 933/1866] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:17.241580 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece02b2c-a193-420b-b017-49786e1dc323 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:17.248029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-26aa688b-4e77-4fb5-aa60-b01d3f7a4f63 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:17.250161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-26aa688b-4e77-4fb5-aa60-b01d3f7a4f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:17.274804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece02b2c-a193-420b-b017-49786e1dc323 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:17.286765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 934/1867] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:17.288192 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa688b-4e77-4fb5-aa60-b01d3f7a4f63 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:17.292218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6aa4a-4baa-4cce-8233-0aeac37b97c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:17.293265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6aa4a-4baa-4cce-8233-0aeac37b97c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:17.295992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6aa4a-4baa-4cce-8233-0aeac37b97c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:17.295992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6aa4a-4baa-4cce-8233-0aeac37b97c1 admin admin] PATH_INFO: `/v3/projects/3d8de917e11546d885678f1ca44f8fa6/users/b9282f60cad54178bf0c11ea35684424/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:17.300341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6aa4a-4baa-4cce-8233-0aeac37b97c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8de917e11546d885678f1ca44f8fa6, user_id=b9282f60cad54178bf0c11ea35684424, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:17.305117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa688b-4e77-4fb5-aa60-b01d3f7a4f63 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:17.305681 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6aa4a-4baa-4cce-8233-0aeac37b97c1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:17.323638 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4602715-e9b8-4f36-8300-7fb8d693fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:17.324480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4602715-e9b8-4f36-8300-7fb8d693fa93 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:17.324784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4602715-e9b8-4f36-8300-7fb8d693fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:17.325187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4602715-e9b8-4f36-8300-7fb8d693fa93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:17.326153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4602715-e9b8-4f36-8300-7fb8d693fa93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:17.326661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4602715-e9b8-4f36-8300-7fb8d693fa93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:17.328764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4602715-e9b8-4f36-8300-7fb8d693fa93 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:17.340798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 934/1868] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:17 2022] PUT /identity/v3/projects/3d8de917e11546d885678f1ca44f8fa6/users/b9282f60cad54178bf0c11ea35684424/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:17.354806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90576e6a-622a-412a-a15f-7bc51c5df68e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:17.355102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90576e6a-622a-412a-a15f-7bc51c5df68e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:17.355534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90576e6a-622a-412a-a15f-7bc51c5df68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:17.377103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 935/1869] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:26:17.380019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4602715-e9b8-4f36-8300-7fb8d693fa93 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:17.384539 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b4602715-e9b8-4f36-8300-7fb8d693fa93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:17.403362 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-90576e6a-622a-412a-a15f-7bc51c5df68e None None] MFA Rules not processed for user `b9282f60cad54178bf0c11ea35684424`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:17.405933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-90576e6a-622a-412a-a15f-7bc51c5df68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:17.412061 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4602715-e9b8-4f36-8300-7fb8d693fa93 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:17.531136 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f04549-5a5b-4afe-b00c-c56072dcd537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:17.532310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f04549-5a5b-4afe-b00c-c56072dcd537 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:17.532752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f04549-5a5b-4afe-b00c-c56072dcd537 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:17.533343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f04549-5a5b-4afe-b00c-c56072dcd537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:17.535608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-06f04549-5a5b-4afe-b00c-c56072dcd537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:17.550273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f04549-5a5b-4afe-b00c-c56072dcd537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:17.552338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f04549-5a5b-4afe-b00c-c56072dcd537 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:17.559948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 935/1870] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:17.559948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90576e6a-622a-412a-a15f-7bc51c5df68e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:17.572615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 936/1871] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:17.573936 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f04549-5a5b-4afe-b00c-c56072dcd537 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:17.644762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:17.666420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90576e6a-622a-412a-a15f-7bc51c5df68e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:17.673288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f04549-5a5b-4afe-b00c-c56072dcd537 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:17.675216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b7408-a30d-4984-8fd9-eaa6a2606865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:17.676169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b7408-a30d-4984-8fd9-eaa6a2606865 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:17.676551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b7408-a30d-4984-8fd9-eaa6a2606865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:17.677462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b7408-a30d-4984-8fd9-eaa6a2606865 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:17.680135 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b7408-a30d-4984-8fd9-eaa6a2606865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:17.682637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b7408-a30d-4984-8fd9-eaa6a2606865 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:17.689437 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18597d7-b666-484c-8edc-48f3ea725376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:17.690617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18597d7-b666-484c-8edc-48f3ea725376 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:17.691095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18597d7-b666-484c-8edc-48f3ea725376 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:17.691752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18597d7-b666-484c-8edc-48f3ea725376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:17.716789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18597d7-b666-484c-8edc-48f3ea725376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:17.719608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18597d7-b666-484c-8edc-48f3ea725376 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:17.733241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 936/1872] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:17 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:17.737235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b7408-a30d-4984-8fd9-eaa6a2606865 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:17.747593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 937/1873] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:17.921940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b7408-a30d-4984-8fd9-eaa6a2606865 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:17.940834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161eb54-98ac-4a89-8b72-c44e10fe8f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:17.941901 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161eb54-98ac-4a89-8b72-c44e10fe8f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:17.942190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161eb54-98ac-4a89-8b72-c44e10fe8f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:17.942470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161eb54-98ac-4a89-8b72-c44e10fe8f14 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:17.943187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161eb54-98ac-4a89-8b72-c44e10fe8f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:17.945563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161eb54-98ac-4a89-8b72-c44e10fe8f14 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:17.975000 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 937/1874] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:17 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:17.979941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18597d7-b666-484c-8edc-48f3ea725376 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:18.027571 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18597d7-b666-484c-8edc-48f3ea725376 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:18.039907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b7e31-6287-47a9-93a5-21539531b47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:18.041185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b7e31-6287-47a9-93a5-21539531b47e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:18.041795 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b7e31-6287-47a9-93a5-21539531b47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:18.042475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b7e31-6287-47a9-93a5-21539531b47e admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:18.043995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b7e31-6287-47a9-93a5-21539531b47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:18.049366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161eb54-98ac-4a89-8b72-c44e10fe8f14 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:18.053696 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8161eb54-98ac-4a89-8b72-c44e10fe8f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:18.056832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b7e31-6287-47a9-93a5-21539531b47e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:18.099808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 938/1875] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:18.105383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161eb54-98ac-4a89-8b72-c44e10fe8f14 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:18.109241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b7e31-6287-47a9-93a5-21539531b47e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:18.144214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:18.146933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:18.148184 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:18.153549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b7e31-6287-47a9-93a5-21539531b47e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:18.154408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] PATH_INFO: `/v3/projects/31169aba9608476b882e357299c3bf20` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:18.158372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31169aba9608476b882e357299c3bf20)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:18.168671 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:18.180602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ebe34-bad1-4e56-b078-4ef902d1a4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:18.184121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ebe34-bad1-4e56-b078-4ef902d1a4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:18.184578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ebe34-bad1-4e56-b078-4ef902d1a4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:18.185037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ebe34-bad1-4e56-b078-4ef902d1a4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:18.190374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ebe34-bad1-4e56-b078-4ef902d1a4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:18.196817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ebe34-bad1-4e56-b078-4ef902d1a4e6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:18.218719 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 939/1876] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:18.223458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ebe34-bad1-4e56-b078-4ef902d1a4e6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:18.270685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ebe34-bad1-4e56-b078-4ef902d1a4e6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:18.288983 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31169aba9608476b882e357299c3bf20', 'request_id': 'req-b7c93a4a-3e02-4bb5-a651-13455f330e79'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:18.325856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:18.341016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31169aba9608476b882e357299c3bf20', 'request_id': 'req-b7c93a4a-3e02-4bb5-a651-13455f330e79'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:18.389452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31169aba9608476b882e357299c3bf20', 'request_id': 'req-b7c93a4a-3e02-4bb5-a651-13455f330e79'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:18.453696 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] The token cache is being invalidate because project 31169aba9608476b882e357299c3bf20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:18.456952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:18.467675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:18.476418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 938/1877] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:18 2022] DELETE /identity/v3/projects/31169aba9608476b882e357299c3bf20 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:18.495467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:18.505698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:18.514786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a1bd4-2f10-4607-87e9-bbfeaf9af841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:18.516710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a1bd4-2f10-4607-87e9-bbfeaf9af841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:18.517221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a1bd4-2f10-4607-87e9-bbfeaf9af841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:18.517643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a1bd4-2f10-4607-87e9-bbfeaf9af841 admin admin] PATH_INFO: `/v3/projects/8797bce0a14443be9ffdf0cbc4fdd56d/users/55de86698dc84165acfcc788ddd82818/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:18.569690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c93a4a-3e02-4bb5-a651-13455f330e79 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:18.583857 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a1bd4-2f10-4607-87e9-bbfeaf9af841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8797bce0a14443be9ffdf0cbc4fdd56d, user_id=55de86698dc84165acfcc788ddd82818, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:18.594619 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:18.595128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a1bd4-2f10-4607-87e9-bbfeaf9af841 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:18.601436 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:18.601938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:18.602405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] PATH_INFO: `/v3/users/7eb7c93f8bbf4092848ebf60817a84dc` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:18.614830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb7c93f8bbf4092848ebf60817a84dc)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:18.616947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:18.664582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 940/1878] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:18 2022] PUT /identity/v3/projects/8797bce0a14443be9ffdf0cbc4fdd56d/users/55de86698dc84165acfcc788ddd82818/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:18.685581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eaa71-f8be-46f9-995e-a6021481ee3b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:18.685581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eaa71-f8be-46f9-995e-a6021481ee3b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:18.685581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eaa71-f8be-46f9-995e-a6021481ee3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:18.778573 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-260eaa71-f8be-46f9-995e-a6021481ee3b None None] MFA Rules not processed for user `55de86698dc84165acfcc788ddd82818`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:18.779901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-260eaa71-f8be-46f9-995e-a6021481ee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:18.836148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=82,keystone:INSERT=5,keystone:DELETE=13 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:18.866759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb7c93f8bbf4092848ebf60817a84dc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:18.935652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb7c93f8bbf4092848ebf60817a84dc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:18.968793 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb7c93f8bbf4092848ebf60817a84dc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:18.984958 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 941/1879] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:26:18.992918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260eaa71-f8be-46f9-995e-a6021481ee3b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:18.996307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-260eaa71-f8be-46f9-995e-a6021481ee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:19.009729 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb7c93f8bbf4092848ebf60817a84dc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:19.017627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb7c93f8bbf4092848ebf60817a84dc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:19.064973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 939/1880] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:18 2022] DELETE /identity/v3/users/7eb7c93f8bbf4092848ebf60817a84dc => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:19.196739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260eaa71-f8be-46f9-995e-a6021481ee3b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:19.377248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:19.494045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d7d5a-e056-4ef5-b2c6-ec3fad408345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:19.494727 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d7d5a-e056-4ef5-b2c6-ec3fad408345 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:19.495075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d7d5a-e056-4ef5-b2c6-ec3fad408345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:19.495296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d7d5a-e056-4ef5-b2c6-ec3fad408345 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:19.496016 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d7d5a-e056-4ef5-b2c6-ec3fad408345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:19.505139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d7d5a-e056-4ef5-b2c6-ec3fad408345 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:19.573249 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 942/1881] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:18 2022] POST /identity/v3/projects => generated 387 bytes in 578 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:19.574782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:19.582966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:19.620643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9085d69-e582-4c1d-ada6-e791e777a1a7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:19.762284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10fa90-a10f-4dc2-bc76-54b3d90969d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:19.763318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10fa90-a10f-4dc2-bc76-54b3d90969d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:19.763887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10fa90-a10f-4dc2-bc76-54b3d90969d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:19.764362 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10fa90-a10f-4dc2-bc76-54b3d90969d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:19.765357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10fa90-a10f-4dc2-bc76-54b3d90969d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:19.773233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10fa90-a10f-4dc2-bc76-54b3d90969d2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:19.813176 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 940/1882] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:19 2022] POST /identity/v3/users => generated 300 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:19.815013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d7d5a-e056-4ef5-b2c6-ec3fad408345 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:19.832714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d7d5a-e056-4ef5-b2c6-ec3fad408345 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:19.856690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cbb44-41c1-48b3-8d6c-ba646a27c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:19.859806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cbb44-41c1-48b3-8d6c-ba646a27c834 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:19.860282 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cbb44-41c1-48b3-8d6c-ba646a27c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:19.861020 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cbb44-41c1-48b3-8d6c-ba646a27c834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:19.862339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cbb44-41c1-48b3-8d6c-ba646a27c834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:19.864879 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cbb44-41c1-48b3-8d6c-ba646a27c834 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:19.903261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10fa90-a10f-4dc2-bc76-54b3d90969d2 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:19.904850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 943/1883] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:19.919039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10fa90-a10f-4dc2-bc76-54b3d90969d2 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:19.925820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb3f47-2c89-4663-a7bf-0a08504b2659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:19.927906 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb3f47-2c89-4663-a7bf-0a08504b2659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:19.928954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb3f47-2c89-4663-a7bf-0a08504b2659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:19.930485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb3f47-2c89-4663-a7bf-0a08504b2659 admin admin] PATH_INFO: `/v3/projects/d2c2d65e7c5049f3affc8a305012ebd1/users/decb0047eed94b64bd74c5d8acbe4b5b/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:19.958852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb3f47-2c89-4663-a7bf-0a08504b2659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c2d65e7c5049f3affc8a305012ebd1, user_id=decb0047eed94b64bd74c5d8acbe4b5b, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:19.975957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb3f47-2c89-4663-a7bf-0a08504b2659 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:20.009163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cbb44-41c1-48b3-8d6c-ba646a27c834 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:20.025199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 941/1884] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:19 2022] PUT /identity/v3/projects/d2c2d65e7c5049f3affc8a305012ebd1/users/decb0047eed94b64bd74c5d8acbe4b5b/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:20.025694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cbb44-41c1-48b3-8d6c-ba646a27c834 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:20.193758 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f94943-f450-4065-9818-17c72ca3c2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:20.196118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f94943-f450-4065-9818-17c72ca3c2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:20.196601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f94943-f450-4065-9818-17c72ca3c2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:20.196892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f94943-f450-4065-9818-17c72ca3c2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:20.199305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f94943-f450-4065-9818-17c72ca3c2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:20.229530 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f94943-f450-4065-9818-17c72ca3c2b5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:20.282453 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 944/1885] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:20.284075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb3f47-2c89-4663-a7bf-0a08504b2659 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:20.305106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb3f47-2c89-4663-a7bf-0a08504b2659 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:20.316582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc79c9-7411-4646-91a6-602b917cd669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:20.318618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc79c9-7411-4646-91a6-602b917cd669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:20.324096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc79c9-7411-4646-91a6-602b917cd669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:20.324953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc79c9-7411-4646-91a6-602b917cd669 admin admin] PATH_INFO: `/v3/projects/d2c2d65e7c5049f3affc8a305012ebd1/users/decb0047eed94b64bd74c5d8acbe4b5b/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:20.339977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c611-12d9-457f-b6f9-523a06b19d47 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:20.340466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c611-12d9-457f-b6f9-523a06b19d47 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:20.342974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c611-12d9-457f-b6f9-523a06b19d47 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:20.347194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 945/1886] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:26:20 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:26:20.351686 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc79c9-7411-4646-91a6-602b917cd669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c2d65e7c5049f3affc8a305012ebd1, user_id=decb0047eed94b64bd74c5d8acbe4b5b, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:20.360719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc79c9-7411-4646-91a6-602b917cd669 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:20.379155 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db809d-368f-4016-a186-786d4956b627 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:20.379473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db809d-368f-4016-a186-786d4956b627 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:20.379799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db809d-368f-4016-a186-786d4956b627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:20.419506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 942/1887] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:20 2022] PUT /identity/v3/projects/d2c2d65e7c5049f3affc8a305012ebd1/users/decb0047eed94b64bd74c5d8acbe4b5b/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:20.428075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c91daa-2f57-467d-a054-d9efdd670165 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:20.428531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d8db809d-368f-4016-a186-786d4956b627 None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:20.428696 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c91daa-2f57-467d-a054-d9efdd670165 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:20.428696 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c91daa-2f57-467d-a054-d9efdd670165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:20.429033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d8db809d-368f-4016-a186-786d4956b627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:20.510258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f2c91daa-2f57-467d-a054-d9efdd670165 None None] MFA Rules not processed for user `decb0047eed94b64bd74c5d8acbe4b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:20.511807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f2c91daa-2f57-467d-a054-d9efdd670165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:20.598217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 946/1888] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:20.667369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db809d-368f-4016-a186-786d4956b627 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:20.668968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d8db809d-368f-4016-a186-786d4956b627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:20.697864 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:20.700781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db809d-368f-4016-a186-786d4956b627 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:20.715435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 943/1889] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:20.724041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0300b5-ecac-4a1a-87cf-e206cde51d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:20.724041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0300b5-ecac-4a1a-87cf-e206cde51d3b service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:20.724041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0300b5-ecac-4a1a-87cf-e206cde51d3b service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:20.724041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0300b5-ecac-4a1a-87cf-e206cde51d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:20.748383 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0300b5-ecac-4a1a-87cf-e206cde51d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:20.750111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0300b5-ecac-4a1a-87cf-e206cde51d3b service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:20.780424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 947/1890] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:20.795943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c91daa-2f57-467d-a054-d9efdd670165 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:20.797927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f2c91daa-2f57-467d-a054-d9efdd670165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:20.969135 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c91daa-2f57-467d-a054-d9efdd670165 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:20.974127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dfe82-66bf-45fe-8fea-75ce28fb0116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:20.974866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dfe82-66bf-45fe-8fea-75ce28fb0116 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:20.975789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dfe82-66bf-45fe-8fea-75ce28fb0116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:20.976335 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dfe82-66bf-45fe-8fea-75ce28fb0116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:20.988756 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dfe82-66bf-45fe-8fea-75ce28fb0116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:20.991079 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dfe82-66bf-45fe-8fea-75ce28fb0116 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:21.020166 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 944/1891] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:21.410301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0300b5-ecac-4a1a-87cf-e206cde51d3b service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:21.414412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6b0300b5-ecac-4a1a-87cf-e206cde51d3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:21.488569 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:21.612359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0300b5-ecac-4a1a-87cf-e206cde51d3b service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:21.638477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed965fef-88dd-4d36-9b8d-b80291a841f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:21.642382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed965fef-88dd-4d36-9b8d-b80291a841f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:21.643813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed965fef-88dd-4d36-9b8d-b80291a841f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:21.644102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed965fef-88dd-4d36-9b8d-b80291a841f7 admin admin] PATH_INFO: `/v3/projects/6ecf18f020624eb581b5a24e446dfc20` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:21.647930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed965fef-88dd-4d36-9b8d-b80291a841f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ecf18f020624eb581b5a24e446dfc20)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:21.652441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed965fef-88dd-4d36-9b8d-b80291a841f7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:21.847642 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ed965fef-88dd-4d36-9b8d-b80291a841f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ecf18f020624eb581b5a24e446dfc20', 'request_id': 'req-ed965fef-88dd-4d36-9b8d-b80291a841f7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:21.876226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ed965fef-88dd-4d36-9b8d-b80291a841f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ecf18f020624eb581b5a24e446dfc20', 'request_id': 'req-ed965fef-88dd-4d36-9b8d-b80291a841f7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:21.898885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ed965fef-88dd-4d36-9b8d-b80291a841f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ecf18f020624eb581b5a24e446dfc20', 'request_id': 'req-ed965fef-88dd-4d36-9b8d-b80291a841f7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:21.959094 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ed965fef-88dd-4d36-9b8d-b80291a841f7 admin admin] The token cache is being invalidate because project 6ecf18f020624eb581b5a24e446dfc20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:21.960222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ed965fef-88dd-4d36-9b8d-b80291a841f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:21.963215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ed965fef-88dd-4d36-9b8d-b80291a841f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:21.970159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 948/1892] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:21 2022] DELETE /identity/v3/projects/6ecf18f020624eb581b5a24e446dfc20 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:21.975714 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92607b-3d25-4ce4-aa67-ff845487c9ec None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:21.976605 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92607b-3d25-4ce4-aa67-ff845487c9ec None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:21.976605 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92607b-3d25-4ce4-aa67-ff845487c9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:22.072647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-cc92607b-3d25-4ce4-aa67-ff845487c9ec None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:22.084219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cc92607b-3d25-4ce4-aa67-ff845487c9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:22.314856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 945/1893] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:22.325347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c20bb9-6ca3-4801-8e84-7dec5ecaca93 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:22.325924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c20bb9-6ca3-4801-8e84-7dec5ecaca93 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:22.326477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c20bb9-6ca3-4801-8e84-7dec5ecaca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:22.387516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b6c20bb9-6ca3-4801-8e84-7dec5ecaca93 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:22.390172 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b6c20bb9-6ca3-4801-8e84-7dec5ecaca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:22.404984 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 949/1894] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:26:22.410902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92607b-3d25-4ce4-aa67-ff845487c9ec None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:22.432490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92607b-3d25-4ce4-aa67-ff845487c9ec None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:22.439151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045526-2b10-48ad-9c40-3df4d5c6b654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:22.440138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045526-2b10-48ad-9c40-3df4d5c6b654 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:22.440585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045526-2b10-48ad-9c40-3df4d5c6b654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:22.441919 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045526-2b10-48ad-9c40-3df4d5c6b654 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:22.443171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045526-2b10-48ad-9c40-3df4d5c6b654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:22.443656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045526-2b10-48ad-9c40-3df4d5c6b654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:22.446832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045526-2b10-48ad-9c40-3df4d5c6b654 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:22.468481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 946/1895] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:22.481038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c20bb9-6ca3-4801-8e84-7dec5ecaca93 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:22.505427 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c20bb9-6ca3-4801-8e84-7dec5ecaca93 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:22.517990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7b132-921e-4b95-8eb6-3028263ca9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:22.519552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7b132-921e-4b95-8eb6-3028263ca9fd admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:22.520992 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7b132-921e-4b95-8eb6-3028263ca9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:22.521303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7b132-921e-4b95-8eb6-3028263ca9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:22.525418 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7b132-921e-4b95-8eb6-3028263ca9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:22.535158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7b132-921e-4b95-8eb6-3028263ca9fd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:22.632863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 950/1896] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:22 2022] POST /identity/v3/projects => generated 407 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:22.640936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045526-2b10-48ad-9c40-3df4d5c6b654 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:22.664865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045526-2b10-48ad-9c40-3df4d5c6b654 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:22.857167 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b66a2-81e4-4df2-889a-23796895498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:22.868485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b66a2-81e4-4df2-889a-23796895498e admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:22.868485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b66a2-81e4-4df2-889a-23796895498e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:22.868485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b66a2-81e4-4df2-889a-23796895498e admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:22.869641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b66a2-81e4-4df2-889a-23796895498e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:22.873476 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b66a2-81e4-4df2-889a-23796895498e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:22.925185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 947/1897] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:22 2022] POST /identity/v3/users => generated 304 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:22.930562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7b132-921e-4b95-8eb6-3028263ca9fd admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:22.963446 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7b132-921e-4b95-8eb6-3028263ca9fd admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:22.979926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07842d8e-f01c-4ab9-a160-80a6763c77a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:22.981483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07842d8e-f01c-4ab9-a160-80a6763c77a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:22.981975 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07842d8e-f01c-4ab9-a160-80a6763c77a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:22.984949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07842d8e-f01c-4ab9-a160-80a6763c77a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:22.986282 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07842d8e-f01c-4ab9-a160-80a6763c77a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:22.992256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07842d8e-f01c-4ab9-a160-80a6763c77a2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:23.028678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 951/1898] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:23.030534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b66a2-81e4-4df2-889a-23796895498e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:23.070731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b66a2-81e4-4df2-889a-23796895498e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:23.082864 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f4c90-1817-4373-abf6-c58afbac5dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:23.083882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f4c90-1817-4373-abf6-c58afbac5dae admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:23.084383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f4c90-1817-4373-abf6-c58afbac5dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:23.084896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f4c90-1817-4373-abf6-c58afbac5dae admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:23.086189 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f4c90-1817-4373-abf6-c58afbac5dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:23.088431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f4c90-1817-4373-abf6-c58afbac5dae admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:23.105376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 948/1899] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:23.111433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07842d8e-f01c-4ab9-a160-80a6763c77a2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:23.134536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07842d8e-f01c-4ab9-a160-80a6763c77a2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:23.143825 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8d0b0-c382-4c0d-b299-9eaeeb357597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:23.145434 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8d0b0-c382-4c0d-b299-9eaeeb357597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:23.145855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8d0b0-c382-4c0d-b299-9eaeeb357597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:23.146215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8d0b0-c382-4c0d-b299-9eaeeb357597 admin admin] PATH_INFO: `/v3/projects/e8b2b7c6e67d490080602cd1327e54c3/users/906706c9b6504f6690a458c8608c26b1/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:23.189277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8d0b0-c382-4c0d-b299-9eaeeb357597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b2b7c6e67d490080602cd1327e54c3, user_id=906706c9b6504f6690a458c8608c26b1, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:23.194411 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8d0b0-c382-4c0d-b299-9eaeeb357597 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:23.202480 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f4c90-1817-4373-abf6-c58afbac5dae admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:23.204879 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cf6f4c90-1817-4373-abf6-c58afbac5dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:23.229100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f4c90-1817-4373-abf6-c58afbac5dae admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:23.236044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:23.249615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 952/1900] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:23 2022] PUT /identity/v3/projects/e8b2b7c6e67d490080602cd1327e54c3/users/906706c9b6504f6690a458c8608c26b1/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:23.250849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8d0b0-c382-4c0d-b299-9eaeeb357597 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:23.259133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-91b8d0b0-c382-4c0d-b299-9eaeeb357597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:23.331177 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b650052-6523-4121-a45b-1e6703990055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:23.332218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650052-6523-4121-a45b-1e6703990055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:23.333213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650052-6523-4121-a45b-1e6703990055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:23.333761 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650052-6523-4121-a45b-1e6703990055 admin admin] PATH_INFO: `/v3/users/fe96cb98874a42b38268176a258d2764` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:23.336245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b650052-6523-4121-a45b-1e6703990055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe96cb98874a42b38268176a258d2764)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:23.338287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b650052-6523-4121-a45b-1e6703990055 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:23.360067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:23.402882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8d0b0-c382-4c0d-b299-9eaeeb357597 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:23.413956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:23.415782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:23.415782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:23.415973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] PATH_INFO: `/v3/users/a24f8873e7eb4411a4cca651ea6234ad` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:23.417869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-9b650052-6523-4121-a45b-1e6703990055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe96cb98874a42b38268176a258d2764'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:23.418045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24f8873e7eb4411a4cca651ea6234ad)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:23.421738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:23.446542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-9b650052-6523-4121-a45b-1e6703990055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe96cb98874a42b38268176a258d2764'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:23.464892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-9b650052-6523-4121-a45b-1e6703990055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe96cb98874a42b38268176a258d2764'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:23.491592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-9b650052-6523-4121-a45b-1e6703990055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe96cb98874a42b38268176a258d2764'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:23.493836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-9b650052-6523-4121-a45b-1e6703990055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe96cb98874a42b38268176a258d2764'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:23.517168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 949/1901] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:23 2022] DELETE /identity/v3/users/fe96cb98874a42b38268176a258d2764 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:23.517168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df852e4f-ef6d-4cae-b65d-427918628e7f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:23.517168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df852e4f-ef6d-4cae-b65d-427918628e7f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:23.517168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df852e4f-ef6d-4cae-b65d-427918628e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:23.548219 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24f8873e7eb4411a4cca651ea6234ad'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:23.566290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-df852e4f-ef6d-4cae-b65d-427918628e7f None None] MFA Rules not processed for user `906706c9b6504f6690a458c8608c26b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:23.568259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-df852e4f-ef6d-4cae-b65d-427918628e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:23.575650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24f8873e7eb4411a4cca651ea6234ad'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:23.595393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24f8873e7eb4411a4cca651ea6234ad'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:23.622480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24f8873e7eb4411a4cca651ea6234ad'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:23.624261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24f8873e7eb4411a4cca651ea6234ad'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:23.639859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 953/1902] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:23 2022] DELETE /identity/v3/users/a24f8873e7eb4411a4cca651ea6234ad => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:23.641834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:23.647441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:23.701414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 950/1903] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:23.701414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6aef6-9dc8-4100-825a-ab19d31bd211 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:23.701414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6aef6-9dc8-4100-825a-ab19d31bd211 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:23.701414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6aef6-9dc8-4100-825a-ab19d31bd211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:23.738346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-daa6aef6-9dc8-4100-825a-ab19d31bd211 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:23.740213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-daa6aef6-9dc8-4100-825a-ab19d31bd211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:23.762125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:23.820665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a5080-70ca-40dd-a7eb-4c3280b81cde admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:23.839856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:23.841243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:23.841601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:23.841907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] PATH_INFO: `/v3/users/55de86698dc84165acfcc788ddd82818` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:23.848221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55de86698dc84165acfcc788ddd82818)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:23.852333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:23.901255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 951/1904] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:23.901609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfca001-b2af-40af-a619-4fefc2231455 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:23.902422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfca001-b2af-40af-a619-4fefc2231455 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:23.903443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfca001-b2af-40af-a619-4fefc2231455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:23.947278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6bfca001-b2af-40af-a619-4fefc2231455 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:23.957357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6bfca001-b2af-40af-a619-4fefc2231455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:23.986223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 952/1905] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:23.988087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfca001-b2af-40af-a619-4fefc2231455 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:23.991366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6bfca001-b2af-40af-a619-4fefc2231455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:24.015684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfca001-b2af-40af-a619-4fefc2231455 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:24.026235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e50598-b6ec-45bf-a130-761e071d6952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:24.026376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55de86698dc84165acfcc788ddd82818'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:24.027856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e50598-b6ec-45bf-a130-761e071d6952 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:24.028447 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e50598-b6ec-45bf-a130-761e071d6952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:24.029046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e50598-b6ec-45bf-a130-761e071d6952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:24.030800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e50598-b6ec-45bf-a130-761e071d6952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:24.034566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e50598-b6ec-45bf-a130-761e071d6952 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:24.087277 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 953/1906] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:23 2022] POST /identity/v3/projects => generated 409 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:24.088846 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e50598-b6ec-45bf-a130-761e071d6952 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:24.088972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55de86698dc84165acfcc788ddd82818'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:24.091318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-66e50598-b6ec-45bf-a130-761e071d6952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:24.125557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55de86698dc84165acfcc788ddd82818'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:24.129276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:24.164073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55de86698dc84165acfcc788ddd82818'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:24.165050 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55de86698dc84165acfcc788ddd82818'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:24.181384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 954/1907] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:23 2022] DELETE /identity/v3/users/55de86698dc84165acfcc788ddd82818 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:24.181384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:24.181384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:24.191083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e50598-b6ec-45bf-a130-761e071d6952 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:24.336553 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15210d6-2c33-4220-bbb7-51a632d039b8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:24.349641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe2da2-654f-49fb-a6d1-4fa432c3dc4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:24.350581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682eee1-047a-4cf2-8034-a03f55cd4b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:24.351063 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2da2-654f-49fb-a6d1-4fa432c3dc4e service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:24.351647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2da2-654f-49fb-a6d1-4fa432c3dc4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:24.352227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2da2-654f-49fb-a6d1-4fa432c3dc4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:24.353159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682eee1-047a-4cf2-8034-a03f55cd4b08 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:24.353987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682eee1-047a-4cf2-8034-a03f55cd4b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:24.354745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682eee1-047a-4cf2-8034-a03f55cd4b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:24.355590 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fcfe2da2-654f-49fb-a6d1-4fa432c3dc4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:24.363276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b682eee1-047a-4cf2-8034-a03f55cd4b08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:24.486650 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:24.493283 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682eee1-047a-4cf2-8034-a03f55cd4b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:24.495589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682eee1-047a-4cf2-8034-a03f55cd4b08 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:24.496881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe2da2-654f-49fb-a6d1-4fa432c3dc4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:24.499546 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe2da2-654f-49fb-a6d1-4fa432c3dc4e service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:24.514109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 954/1908] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:24.515724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe2da2-654f-49fb-a6d1-4fa432c3dc4e service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:24.517944 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fcfe2da2-654f-49fb-a6d1-4fa432c3dc4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:24.519113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 955/1909] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:24.521375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861328ab-61c8-42f4-9311-87dd6a120089 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:24.521772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861328ab-61c8-42f4-9311-87dd6a120089 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:24.522737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861328ab-61c8-42f4-9311-87dd6a120089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:24.539207 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe2da2-654f-49fb-a6d1-4fa432c3dc4e service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:24.548231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826eaec-243b-404f-aba9-eaf6f8df58e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:24.549344 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826eaec-243b-404f-aba9-eaf6f8df58e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:24.549833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826eaec-243b-404f-aba9-eaf6f8df58e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:24.550160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826eaec-243b-404f-aba9-eaf6f8df58e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:24.550944 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826eaec-243b-404f-aba9-eaf6f8df58e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:24.551643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-861328ab-61c8-42f4-9311-87dd6a120089 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:24.553901 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826eaec-243b-404f-aba9-eaf6f8df58e7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:24.555045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-861328ab-61c8-42f4-9311-87dd6a120089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:24.584266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 956/1910] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:24.595443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 955/1911] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:24 2022] POST /identity/v3/users => generated 311 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:24.597513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861328ab-61c8-42f4-9311-87dd6a120089 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:24.610681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861328ab-61c8-42f4-9311-87dd6a120089 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:24.617724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bc9b9-ded6-43ff-b437-2612f3c9de87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:24.618567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc9b9-ded6-43ff-b437-2612f3c9de87 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:24.618865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc9b9-ded6-43ff-b437-2612f3c9de87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:24.619160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc9b9-ded6-43ff-b437-2612f3c9de87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:24.620751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bc9b9-ded6-43ff-b437-2612f3c9de87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:24.622405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bc9b9-ded6-43ff-b437-2612f3c9de87 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:24.627143 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826eaec-243b-404f-aba9-eaf6f8df58e7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:24.639977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 957/1912] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:24.644608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bc9b9-ded6-43ff-b437-2612f3c9de87 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:24.648634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826eaec-243b-404f-aba9-eaf6f8df58e7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:24.658182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bc9b9-ded6-43ff-b437-2612f3c9de87 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:24.660019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24d287-06e8-4e8f-ab5b-30ac3199c284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:24.660778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24d287-06e8-4e8f-ab5b-30ac3199c284 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:24.661224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24d287-06e8-4e8f-ab5b-30ac3199c284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:24.661516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24d287-06e8-4e8f-ab5b-30ac3199c284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:24.665838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8d52a-92b6-441f-8b16-5f3ea05cdb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:24.667126 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8d52a-92b6-441f-8b16-5f3ea05cdb53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:24.667705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8d52a-92b6-441f-8b16-5f3ea05cdb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:24.668252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8d52a-92b6-441f-8b16-5f3ea05cdb53 admin admin] PATH_INFO: `/v3/projects/d91b86f123b24fadb4bad3e135c0d928/users/b2d8f316cf2c446eab77bba24bbc640a/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:24.694736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8d52a-92b6-441f-8b16-5f3ea05cdb53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91b86f123b24fadb4bad3e135c0d928, user_id=b2d8f316cf2c446eab77bba24bbc640a, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:24.699764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8d52a-92b6-441f-8b16-5f3ea05cdb53 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:24.700933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24d287-06e8-4e8f-ab5b-30ac3199c284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:24.707478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24d287-06e8-4e8f-ab5b-30ac3199c284 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:24.760646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 956/1913] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:24.766557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 958/1914] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:24 2022] PUT /identity/v3/projects/d91b86f123b24fadb4bad3e135c0d928/users/b2d8f316cf2c446eab77bba24bbc640a/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:24.767708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f536c-e497-48e6-b9ef-26c5fe409fd0 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:24.768477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f536c-e497-48e6-b9ef-26c5fe409fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:24.769257 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f536c-e497-48e6-b9ef-26c5fe409fd0 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:24.771442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 957/1915] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:26:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:26:24.773043 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8d52a-92b6-441f-8b16-5f3ea05cdb53 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:24.806221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf8560-92fb-4850-a77b-bf9d7d563897 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:24.806583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf8560-92fb-4850-a77b-bf9d7d563897 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:24.807120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf8560-92fb-4850-a77b-bf9d7d563897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:24.869406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-28cf8560-92fb-4850-a77b-bf9d7d563897 None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:24.871962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-28cf8560-92fb-4850-a77b-bf9d7d563897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:24.983410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8d52a-92b6-441f-8b16-5f3ea05cdb53 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:24.994973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d89a-dc6a-45a2-9ebe-64e19c49892e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:24.995859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d89a-dc6a-45a2-9ebe-64e19c49892e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:24.996151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d89a-dc6a-45a2-9ebe-64e19c49892e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:24.996827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d89a-dc6a-45a2-9ebe-64e19c49892e admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:24.997708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d89a-dc6a-45a2-9ebe-64e19c49892e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:25.004063 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d89a-dc6a-45a2-9ebe-64e19c49892e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:25.011490 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:25.066419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 959/1916] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:25.067890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d89a-dc6a-45a2-9ebe-64e19c49892e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:25.138665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d89a-dc6a-45a2-9ebe-64e19c49892e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:25.172080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dff04-4ca8-4bf8-bebe-8ecf15522d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:25.172967 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dff04-4ca8-4bf8-bebe-8ecf15522d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:25.173318 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dff04-4ca8-4bf8-bebe-8ecf15522d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:25.173676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dff04-4ca8-4bf8-bebe-8ecf15522d16 admin admin] PATH_INFO: `/v3/projects/d91b86f123b24fadb4bad3e135c0d928/users/b2d8f316cf2c446eab77bba24bbc640a/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:25.182290 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dff04-4ca8-4bf8-bebe-8ecf15522d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91b86f123b24fadb4bad3e135c0d928, user_id=b2d8f316cf2c446eab77bba24bbc640a, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:25.186367 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 958/1917] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:26:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:25.187553 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dff04-4ca8-4bf8-bebe-8ecf15522d16 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:25.241768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 960/1918] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:25 2022] PUT /identity/v3/projects/d91b86f123b24fadb4bad3e135c0d928/users/b2d8f316cf2c446eab77bba24bbc640a/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:25.255316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbc67f-e3b6-4749-948c-4090df887387 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:25.255819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbc67f-e3b6-4749-948c-4090df887387 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:25.257262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbc67f-e3b6-4749-948c-4090df887387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:25.347562 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d8cbc67f-e3b6-4749-948c-4090df887387 None None] MFA Rules not processed for user `b2d8f316cf2c446eab77bba24bbc640a`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:25.351898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d8cbc67f-e3b6-4749-948c-4090df887387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:25.426620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dff04-4ca8-4bf8-bebe-8ecf15522d16 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:25.426620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-451dff04-4ca8-4bf8-bebe-8ecf15522d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:25.518773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 959/1919] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:25.533243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbc67f-e3b6-4749-948c-4090df887387 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:25.535296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d8cbc67f-e3b6-4749-948c-4090df887387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:25.617739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:25.641720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbc67f-e3b6-4749-948c-4090df887387 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:25.646563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dff04-4ca8-4bf8-bebe-8ecf15522d16 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:25.648996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2f060-c132-4bb8-9a72-055f15919438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:25.649984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2f060-c132-4bb8-9a72-055f15919438 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:25.650383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2f060-c132-4bb8-9a72-055f15919438 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:25.650826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2f060-c132-4bb8-9a72-055f15919438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:25.661317 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afaf23f-1316-47fd-996e-c4064d1d04b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:25.662422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afaf23f-1316-47fd-996e-c4064d1d04b3 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:25.663267 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afaf23f-1316-47fd-996e-c4064d1d04b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:25.663558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afaf23f-1316-47fd-996e-c4064d1d04b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:25.666154 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2f060-c132-4bb8-9a72-055f15919438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:25.669007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2f060-c132-4bb8-9a72-055f15919438 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:25.684279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 960/1920] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:25.688897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afaf23f-1316-47fd-996e-c4064d1d04b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:25.691270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afaf23f-1316-47fd-996e-c4064d1d04b3 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:25.712158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 961/1921] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:25.724227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2f060-c132-4bb8-9a72-055f15919438 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:25.726452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a9f2f060-c132-4bb8-9a72-055f15919438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:25.840756 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2f060-c132-4bb8-9a72-055f15919438 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:25.846328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:25.847246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:25.847536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:25.847817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] PATH_INFO: `/v3/users/d52b6a7d4a15420f8b55f6a219caeba2` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:25.850018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d52b6a7d4a15420f8b55f6a219caeba2)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:25.853119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:26.000624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd52b6a7d4a15420f8b55f6a219caeba2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:26.036117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd52b6a7d4a15420f8b55f6a219caeba2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:26.059544 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd52b6a7d4a15420f8b55f6a219caeba2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:26.069158 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd52b6a7d4a15420f8b55f6a219caeba2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:26.071628 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd52b6a7d4a15420f8b55f6a219caeba2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:26.080747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 961/1922] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:25 2022] DELETE /identity/v3/users/d52b6a7d4a15420f8b55f6a219caeba2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:26.086559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bbe46-8e8f-4486-ad6f-50f3cb85e6c8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:26.086862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bbe46-8e8f-4486-ad6f-50f3cb85e6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:26.087148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bbe46-8e8f-4486-ad6f-50f3cb85e6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:26.094176 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:26.096712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:26.110073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-de3bbe46-8e8f-4486-ad6f-50f3cb85e6c8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:26.112088 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-de3bbe46-8e8f-4486-ad6f-50f3cb85e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:26.182917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c62778-665b-45fc-ba09-e470697a8f39 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:26.189798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22033616-255e-4c76-aae0-ea53cb91cd50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:26.190690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22033616-255e-4c76-aae0-ea53cb91cd50 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:26.190975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22033616-255e-4c76-aae0-ea53cb91cd50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:26.191273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22033616-255e-4c76-aae0-ea53cb91cd50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:26.193508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-22033616-255e-4c76-aae0-ea53cb91cd50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:26.224038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:26.268906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 962/1923] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:26.296119 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bbe46-8e8f-4486-ad6f-50f3cb85e6c8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:26.302021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-de3bbe46-8e8f-4486-ad6f-50f3cb85e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:26.345691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22033616-255e-4c76-aae0-ea53cb91cd50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:26.348470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22033616-255e-4c76-aae0-ea53cb91cd50 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:26.374553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 962/1924] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:26.376383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22033616-255e-4c76-aae0-ea53cb91cd50 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:26.380038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-22033616-255e-4c76-aae0-ea53cb91cd50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:26.416794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22033616-255e-4c76-aae0-ea53cb91cd50 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:26.427690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:26.430358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:26.431796 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:26.431796 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] PATH_INFO: `/v3/projects/d124406925184c2e8ac4f81b08684bfb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:26.433560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d124406925184c2e8ac4f81b08684bfb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:26.436930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:26.451407 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bbe46-8e8f-4486-ad6f-50f3cb85e6c8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:26.456717 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f508e0-4910-4e47-ab98-97b31cbf62da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:26.457866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f508e0-4910-4e47-ab98-97b31cbf62da service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:26.459669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f508e0-4910-4e47-ab98-97b31cbf62da service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:26.460458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f508e0-4910-4e47-ab98-97b31cbf62da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:26.473716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f508e0-4910-4e47-ab98-97b31cbf62da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:26.476058 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f508e0-4910-4e47-ab98-97b31cbf62da service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:26.498715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 963/1925] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:26.550406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd124406925184c2e8ac4f81b08684bfb', 'request_id': 'req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:26.570712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd124406925184c2e8ac4f81b08684bfb', 'request_id': 'req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:26.585145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd124406925184c2e8ac4f81b08684bfb', 'request_id': 'req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:26.629826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] The token cache is being invalidate because project d124406925184c2e8ac4f81b08684bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:26.630551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:26.633026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:26.636720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 963/1926] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:26 2022] DELETE /identity/v3/projects/d124406925184c2e8ac4f81b08684bfb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:26.643223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f508e0-4910-4e47-ab98-97b31cbf62da service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:26.674053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f508e0-4910-4e47-ab98-97b31cbf62da service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:26.702368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:26.841702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:26.842855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:26.843198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:26.843505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] PATH_INFO: `/v3/users/e12d9a3253d245b9944bfe519ecd8604` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:26.849536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12d9a3253d245b9944bfe519ecd8604)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:26.853569 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:26.939415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:26.948117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:26.990192 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12d9a3253d245b9944bfe519ecd8604'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:26.998166 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533ed9f-a9ad-4e59-87b5-3c94d4eb16cb admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:27.014485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:27.015538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:27.015932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:27.016630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] PATH_INFO: `/v3/projects/8797bce0a14443be9ffdf0cbc4fdd56d` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:27.019697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8797bce0a14443be9ffdf0cbc4fdd56d)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:27.027797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:27.036050 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12d9a3253d245b9944bfe519ecd8604'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.098128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12d9a3253d245b9944bfe519ecd8604'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.124779 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12d9a3253d245b9944bfe519ecd8604'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.125517 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12d9a3253d245b9944bfe519ecd8604'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.147658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 964/1927] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:26 2022] DELETE /identity/v3/users/e12d9a3253d245b9944bfe519ecd8604 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:27.149662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:27.153411 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:27.170008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8797bce0a14443be9ffdf0cbc4fdd56d', 'request_id': 'req-b1dc9bc9-f30b-48db-b1dd-838af8494288'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.188992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8797bce0a14443be9ffdf0cbc4fdd56d', 'request_id': 'req-b1dc9bc9-f30b-48db-b1dd-838af8494288'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.206843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8797bce0a14443be9ffdf0cbc4fdd56d', 'request_id': 'req-b1dc9bc9-f30b-48db-b1dd-838af8494288'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.227901 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] The token cache is being invalidate because project 8797bce0a14443be9ffdf0cbc4fdd56d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:27.228510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.229452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.235599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 964/1928] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:26 2022] DELETE /identity/v3/projects/8797bce0a14443be9ffdf0cbc4fdd56d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:27.237110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:27.239507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:27.288339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:27.342872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba210be7-ace9-45ef-8ff9-dbdc8c82b254 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:27.355702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:27.356733 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:27.358940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:27.359364 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] PATH_INFO: `/v3/projects/08c15186a6774ebabe8fcff69d719dae` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:27.364442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c15186a6774ebabe8fcff69d719dae)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:27.367308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:27.394349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9bc9-f30b-48db-b1dd-838af8494288 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:27.404407 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:27.406663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:27.407393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:27.407928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] PATH_INFO: `/v3/users/decb0047eed94b64bd74c5d8acbe4b5b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:27.410958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=decb0047eed94b64bd74c5d8acbe4b5b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:27.413291 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:27.454285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:27.476995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c15186a6774ebabe8fcff69d719dae', 'request_id': 'req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.487201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c15186a6774ebabe8fcff69d719dae', 'request_id': 'req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.500760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c15186a6774ebabe8fcff69d719dae', 'request_id': 'req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.519085 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] The token cache is being invalidate because project 08c15186a6774ebabe8fcff69d719dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:27.519617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.521124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.521675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'decb0047eed94b64bd74c5d8acbe4b5b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.524056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 965/1929] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:27 2022] DELETE /identity/v3/projects/08c15186a6774ebabe8fcff69d719dae => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:27.528052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:27.530845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:27.552881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'decb0047eed94b64bd74c5d8acbe4b5b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.570871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'decb0047eed94b64bd74c5d8acbe4b5b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.598182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'decb0047eed94b64bd74c5d8acbe4b5b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.600276 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'decb0047eed94b64bd74c5d8acbe4b5b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.625969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 965/1930] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:27 2022] DELETE /identity/v3/users/decb0047eed94b64bd74c5d8acbe4b5b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:27.681340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8ab86-553f-4c3e-8769-e5149ae6d4cb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:27.685032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:27.686609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:27.781566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:27.783213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:27.783497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:27.783972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] PATH_INFO: `/v3/users/b9282f60cad54178bf0c11ea35684424` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:27.786082 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9282f60cad54178bf0c11ea35684424)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:27.789019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:27.880410 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54781ee0-51aa-49ad-a7db-74c19d403cf9 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:27.890380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9282f60cad54178bf0c11ea35684424'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.902599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:27.904323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:27.906621 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:27.906969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] PATH_INFO: `/v3/projects/0717659d32c44a64a34aff8d81ca3a72` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:27.909028 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0717659d32c44a64a34aff8d81ca3a72)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:27.913645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9282f60cad54178bf0c11ea35684424'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.913831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:27.925089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:27.936172 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9282f60cad54178bf0c11ea35684424'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.952591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9282f60cad54178bf0c11ea35684424'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.953832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9282f60cad54178bf0c11ea35684424'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:27.965153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 966/1931] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:27 2022] DELETE /identity/v3/users/b9282f60cad54178bf0c11ea35684424 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:28.018171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:28.023608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0717659d32c44a64a34aff8d81ca3a72', 'request_id': 'req-3e615cc1-9508-426f-8675-b83c6f82eb99'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.036085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0717659d32c44a64a34aff8d81ca3a72', 'request_id': 'req-3e615cc1-9508-426f-8675-b83c6f82eb99'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.049971 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0717659d32c44a64a34aff8d81ca3a72', 'request_id': 'req-3e615cc1-9508-426f-8675-b83c6f82eb99'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.108684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] The token cache is being invalidate because project 0717659d32c44a64a34aff8d81ca3a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:28.111707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.117263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.125271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 966/1932] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:27 2022] DELETE /identity/v3/projects/0717659d32c44a64a34aff8d81ca3a72 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:28.126094 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:28.129124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:28.148078 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:28.151160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:28.345535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e615cc1-9508-426f-8675-b83c6f82eb99 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:28.346264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53add47f-a1ed-4a04-8318-e1f03029622f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:28.353076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:28.354213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:28.354620 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:28.354945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca95969-eba4-44f3-b0a7-dae5dff6ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:28.355128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] PATH_INFO: `/v3/projects/8a852607384b4e3089a086853fb1f4db` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:28.356378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca95969-eba4-44f3-b0a7-dae5dff6ca4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:28.356838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca95969-eba4-44f3-b0a7-dae5dff6ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:28.356962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a852607384b4e3089a086853fb1f4db)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:28.357266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca95969-eba4-44f3-b0a7-dae5dff6ca4f admin admin] PATH_INFO: `/v3/users/1afba4964a7c449d9f1dc5842943e275` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:28.359563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca95969-eba4-44f3-b0a7-dae5dff6ca4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1afba4964a7c449d9f1dc5842943e275)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:28.359722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:28.363914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca95969-eba4-44f3-b0a7-dae5dff6ca4f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:28.458641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a852607384b4e3089a086853fb1f4db', 'request_id': 'req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.469962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a852607384b4e3089a086853fb1f4db', 'request_id': 'req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.474637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dca95969-eba4-44f3-b0a7-dae5dff6ca4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1afba4964a7c449d9f1dc5842943e275'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.482280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a852607384b4e3089a086853fb1f4db', 'request_id': 'req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.510814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] The token cache is being invalidate because project 8a852607384b4e3089a086853fb1f4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:28.511492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.512598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.522762 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dca95969-eba4-44f3-b0a7-dae5dff6ca4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1afba4964a7c449d9f1dc5842943e275'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.526272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 967/1933] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:28 2022] DELETE /identity/v3/projects/8a852607384b4e3089a086853fb1f4db => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:28.530085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:28.536056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:28.548943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dca95969-eba4-44f3-b0a7-dae5dff6ca4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1afba4964a7c449d9f1dc5842943e275'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.587956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dca95969-eba4-44f3-b0a7-dae5dff6ca4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1afba4964a7c449d9f1dc5842943e275'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.589449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dca95969-eba4-44f3-b0a7-dae5dff6ca4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1afba4964a7c449d9f1dc5842943e275'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.622399 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 967/1934] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:28 2022] DELETE /identity/v3/users/1afba4964a7c449d9f1dc5842943e275 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:28.626826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb87618-ac53-4abc-9c0b-723264f77695 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:28.629386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb87618-ac53-4abc-9c0b-723264f77695 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:28.629726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb87618-ac53-4abc-9c0b-723264f77695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:28.673957 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3cb87618-ac53-4abc-9c0b-723264f77695 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:28.675254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3cb87618-ac53-4abc-9c0b-723264f77695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:28.731945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58371e-b27d-4cb1-a307-9ef5ef5aec23 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:28.740928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:28.788011 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 968/1935] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:28.789139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb87618-ac53-4abc-9c0b-723264f77695 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:28.797266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3cb87618-ac53-4abc-9c0b-723264f77695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:28.831669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb87618-ac53-4abc-9c0b-723264f77695 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:28.839964 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f99014-379a-46e9-97e3-fc0746c2e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:28.840949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f99014-379a-46e9-97e3-fc0746c2e471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:28.841296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f99014-379a-46e9-97e3-fc0746c2e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:28.841672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f99014-379a-46e9-97e3-fc0746c2e471 admin admin] PATH_INFO: `/v3/projects/3d8de917e11546d885678f1ca44f8fa6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:28.843120 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f99014-379a-46e9-97e3-fc0746c2e471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8de917e11546d885678f1ca44f8fa6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:28.845455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f99014-379a-46e9-97e3-fc0746c2e471 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:28.854121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:28.865320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d87d8-35d3-4180-8412-196eb0231ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:28.866810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d87d8-35d3-4180-8412-196eb0231ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:28.866996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d87d8-35d3-4180-8412-196eb0231ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:28.867262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d87d8-35d3-4180-8412-196eb0231ea2 admin admin] PATH_INFO: `/v3/projects/d2c2d65e7c5049f3affc8a305012ebd1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:28.868526 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d87d8-35d3-4180-8412-196eb0231ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c2d65e7c5049f3affc8a305012ebd1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:28.870542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d87d8-35d3-4180-8412-196eb0231ea2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:28.939495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f5f99014-379a-46e9-97e3-fc0746c2e471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8de917e11546d885678f1ca44f8fa6', 'request_id': 'req-f5f99014-379a-46e9-97e3-fc0746c2e471'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.950450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-117d87d8-35d3-4180-8412-196eb0231ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c2d65e7c5049f3affc8a305012ebd1', 'request_id': 'req-117d87d8-35d3-4180-8412-196eb0231ea2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.952481 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f5f99014-379a-46e9-97e3-fc0746c2e471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8de917e11546d885678f1ca44f8fa6', 'request_id': 'req-f5f99014-379a-46e9-97e3-fc0746c2e471'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.965513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f5f99014-379a-46e9-97e3-fc0746c2e471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8de917e11546d885678f1ca44f8fa6', 'request_id': 'req-f5f99014-379a-46e9-97e3-fc0746c2e471'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.972352 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-117d87d8-35d3-4180-8412-196eb0231ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c2d65e7c5049f3affc8a305012ebd1', 'request_id': 'req-117d87d8-35d3-4180-8412-196eb0231ea2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.989255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f5f99014-379a-46e9-97e3-fc0746c2e471 admin admin] The token cache is being invalidate because project 3d8de917e11546d885678f1ca44f8fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:28.989638 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f5f99014-379a-46e9-97e3-fc0746c2e471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.990528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f5f99014-379a-46e9-97e3-fc0746c2e471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:28.992800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 969/1936] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:28 2022] DELETE /identity/v3/projects/3d8de917e11546d885678f1ca44f8fa6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:28.994458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825b2e0-c375-4ea2-b681-15d9c5153f01 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:28.994827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825b2e0-c375-4ea2-b681-15d9c5153f01 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:28.995218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825b2e0-c375-4ea2-b681-15d9c5153f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.012669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-117d87d8-35d3-4180-8412-196eb0231ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c2d65e7c5049f3affc8a305012ebd1', 'request_id': 'req-117d87d8-35d3-4180-8412-196eb0231ea2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:29.023540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8825b2e0-c375-4ea2-b681-15d9c5153f01 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:29.025178 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8825b2e0-c375-4ea2-b681-15d9c5153f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:29.052984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-117d87d8-35d3-4180-8412-196eb0231ea2 admin admin] The token cache is being invalidate because project d2c2d65e7c5049f3affc8a305012ebd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:29.054381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-117d87d8-35d3-4180-8412-196eb0231ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:29.055844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-117d87d8-35d3-4180-8412-196eb0231ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:29.059162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 968/1937] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:28 2022] DELETE /identity/v3/projects/d2c2d65e7c5049f3affc8a305012ebd1 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:29.063186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609b01f-3096-4a9a-9637-b66f3d10a7c4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.064637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609b01f-3096-4a9a-9637-b66f3d10a7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.065529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609b01f-3096-4a9a-9637-b66f3d10a7c4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.068986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 969/1938] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:26:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:26:29.071813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c493a-f14b-4c9c-bade-715deb2fff35 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.073235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c493a-f14b-4c9c-bade-715deb2fff35 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.074119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c493a-f14b-4c9c-bade-715deb2fff35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.117098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7c4c493a-f14b-4c9c-bade-715deb2fff35 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:29.118695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7c4c493a-f14b-4c9c-bade-715deb2fff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:29.122708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 970/1939] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:29.124251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e86f4b-aa6a-414e-b2d4-46e44dd3bb37 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.124910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e86f4b-aa6a-414e-b2d4-46e44dd3bb37 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.125215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e86f4b-aa6a-414e-b2d4-46e44dd3bb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.152175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e6e86f4b-aa6a-414e-b2d4-46e44dd3bb37 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:29.152175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e6e86f4b-aa6a-414e-b2d4-46e44dd3bb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:29.172987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 970/1940] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:29.172987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae7491-54fa-449f-94ca-0be63fe31f0f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.172987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae7491-54fa-449f-94ca-0be63fe31f0f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.172987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae7491-54fa-449f-94ca-0be63fe31f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.174214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 971/1941] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:29.175327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e86f4b-aa6a-414e-b2d4-46e44dd3bb37 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:29.186725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e86f4b-aa6a-414e-b2d4-46e44dd3bb37 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:29.192564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc59717-edd6-4c19-9e06-21c2983f983d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:29.193469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59717-edd6-4c19-9e06-21c2983f983d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.194222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59717-edd6-4c19-9e06-21c2983f983d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.194578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59717-edd6-4c19-9e06-21c2983f983d admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.194776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e6ae7491-54fa-449f-94ca-0be63fe31f0f None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:29.195578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc59717-edd6-4c19-9e06-21c2983f983d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:29.195954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc59717-edd6-4c19-9e06-21c2983f983d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:29.196097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e6ae7491-54fa-449f-94ca-0be63fe31f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:29.197820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc59717-edd6-4c19-9e06-21c2983f983d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:29.214258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 972/1942] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:29.216198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ce382-f0b5-4b7f-b859-247d9490f60a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.216741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ce382-f0b5-4b7f-b859-247d9490f60a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.217245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ce382-f0b5-4b7f-b859-247d9490f60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.241727 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d22ce382-f0b5-4b7f-b859-247d9490f60a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:29.243845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d22ce382-f0b5-4b7f-b859-247d9490f60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:29.254593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 973/1943] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:29.256985 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ed60-81d4-4963-8038-78739d2670c4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.257476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ed60-81d4-4963-8038-78739d2670c4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.257762 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ed60-81d4-4963-8038-78739d2670c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.279495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fc98ed60-81d4-4963-8038-78739d2670c4 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:29.281193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fc98ed60-81d4-4963-8038-78739d2670c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:29.295502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 974/1944] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:29.295502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98ed60-81d4-4963-8038-78739d2670c4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:29.298581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 971/1945] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:29.300027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae7491-54fa-449f-94ca-0be63fe31f0f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:29.306874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98ed60-81d4-4963-8038-78739d2670c4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:29.312396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04435e9-c43b-48be-a5ae-0cac8b7e3a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:29.313418 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04435e9-c43b-48be-a5ae-0cac8b7e3a9e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.313779 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04435e9-c43b-48be-a5ae-0cac8b7e3a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.314132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04435e9-c43b-48be-a5ae-0cac8b7e3a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.314949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04435e9-c43b-48be-a5ae-0cac8b7e3a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:29.316770 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae7491-54fa-449f-94ca-0be63fe31f0f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:29.317472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04435e9-c43b-48be-a5ae-0cac8b7e3a9e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:29.324108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e5f0b-f552-4719-8396-53c29b8ad4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:29.324818 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e5f0b-f552-4719-8396-53c29b8ad4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.325139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e5f0b-f552-4719-8396-53c29b8ad4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.325427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e5f0b-f552-4719-8396-53c29b8ad4e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.326210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e5f0b-f552-4719-8396-53c29b8ad4e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:29.326523 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e5f0b-f552-4719-8396-53c29b8ad4e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:29.329000 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e5f0b-f552-4719-8396-53c29b8ad4e2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:29.348752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 972/1946] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:29.348752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e5f0b-f552-4719-8396-53c29b8ad4e2 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:29.351819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 975/1947] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:29 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:29.357832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04435e9-c43b-48be-a5ae-0cac8b7e3a9e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:29.359686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e04435e9-c43b-48be-a5ae-0cac8b7e3a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:29.361808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e5f0b-f552-4719-8396-53c29b8ad4e2 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:29.371567 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:29.420983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:29.450009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c6532-26b2-4532-9155-106923898eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:29.451131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c6532-26b2-4532-9155-106923898eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.451606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c6532-26b2-4532-9155-106923898eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.452456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c6532-26b2-4532-9155-106923898eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.453233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c6532-26b2-4532-9155-106923898eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:29.453548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c6532-26b2-4532-9155-106923898eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:29.456008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c6532-26b2-4532-9155-106923898eaf admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:29.479138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 973/1948] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:29.479138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c6532-26b2-4532-9155-106923898eaf admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:29.490707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c6532-26b2-4532-9155-106923898eaf admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:29.496118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb1540-90a2-405e-99c5-c74a0104c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:29.496779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb1540-90a2-405e-99c5-c74a0104c381 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.497046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb1540-90a2-405e-99c5-c74a0104c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.497426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb1540-90a2-405e-99c5-c74a0104c381 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.498211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb1540-90a2-405e-99c5-c74a0104c381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:29.500287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb1540-90a2-405e-99c5-c74a0104c381 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:29.500449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04435e9-c43b-48be-a5ae-0cac8b7e3a9e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:29.508833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa655e-1fa4-4691-9331-bc7756763745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:29.509593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa655e-1fa4-4691-9331-bc7756763745 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.509883 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa655e-1fa4-4691-9331-bc7756763745 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.510168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa655e-1fa4-4691-9331-bc7756763745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.521482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa655e-1fa4-4691-9331-bc7756763745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:29.523849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa655e-1fa4-4691-9331-bc7756763745 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:29.536820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 974/1949] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:29 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:29.536820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb1540-90a2-405e-99c5-c74a0104c381 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:29.537166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 976/1950] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:29.538305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa655e-1fa4-4691-9331-bc7756763745 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:29.539790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-68fa655e-1fa4-4691-9331-bc7756763745 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:29.553990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa655e-1fa4-4691-9331-bc7756763745 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:29.658890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:29.659790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.660078 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.660359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] PATH_INFO: `/v3/projects/574cf36d42314ffe8e9f4986e7e07361` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.661770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=574cf36d42314ffe8e9f4986e7e07361)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:29.663939 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:29.681346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb1540-90a2-405e-99c5-c74a0104c381 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:29.689732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700610f-68f7-464c-8c41-9584dec52627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:29.690852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700610f-68f7-464c-8c41-9584dec52627 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.691334 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700610f-68f7-464c-8c41-9584dec52627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.691903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700610f-68f7-464c-8c41-9584dec52627 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.693354 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700610f-68f7-464c-8c41-9584dec52627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:29.696934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700610f-68f7-464c-8c41-9584dec52627 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:29.727875 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574cf36d42314ffe8e9f4986e7e07361', 'request_id': 'req-38056f34-873c-43c3-b4ef-362cb24eb3b9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:29.732350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 975/1951] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:29 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:29.734328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700610f-68f7-464c-8c41-9584dec52627 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:29.735888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574cf36d42314ffe8e9f4986e7e07361', 'request_id': 'req-38056f34-873c-43c3-b4ef-362cb24eb3b9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:29.746539 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574cf36d42314ffe8e9f4986e7e07361', 'request_id': 'req-38056f34-873c-43c3-b4ef-362cb24eb3b9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:29.751227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700610f-68f7-464c-8c41-9584dec52627 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:29.764046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] The token cache is being invalidate because project 574cf36d42314ffe8e9f4986e7e07361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:29.764395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:29.765129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:29.770841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 977/1952] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:29 2022] DELETE /identity/v3/projects/574cf36d42314ffe8e9f4986e7e07361 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:29.770841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:29.773744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:29.862138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11607f6-8863-4372-8d65-dfc2cc744c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:29.863423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11607f6-8863-4372-8d65-dfc2cc744c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.864408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11607f6-8863-4372-8d65-dfc2cc744c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.866436 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11607f6-8863-4372-8d65-dfc2cc744c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.867403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11607f6-8863-4372-8d65-dfc2cc744c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:29.873194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11607f6-8863-4372-8d65-dfc2cc744c1b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:29.887026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:29.908505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:29.916357 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38056f34-873c-43c3-b4ef-362cb24eb3b9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:29.927056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 976/1953] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:29 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:29.927056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11607f6-8863-4372-8d65-dfc2cc744c1b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:29.928730 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d11607f6-8863-4372-8d65-dfc2cc744c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:29.931408 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d3168-ee47-4a4e-b748-7ab21c417d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:29.932149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3168-ee47-4a4e-b748-7ab21c417d6f admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.932397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3168-ee47-4a4e-b748-7ab21c417d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.932724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3168-ee47-4a4e-b748-7ab21c417d6f admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:29.933478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d3168-ee47-4a4e-b748-7ab21c417d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:29.936312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d3168-ee47-4a4e-b748-7ab21c417d6f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:29.974187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 978/1954] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:29 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:29.976435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10e8bf-fe34-40c2-8885-ccde719d5673 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:29.977007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10e8bf-fe34-40c2-8885-ccde719d5673 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:29.977377 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10e8bf-fe34-40c2-8885-ccde719d5673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.002071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6f10e8bf-fe34-40c2-8885-ccde719d5673 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:30.003855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6f10e8bf-fe34-40c2-8885-ccde719d5673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:30.035937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11607f6-8863-4372-8d65-dfc2cc744c1b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.042659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc0f3a-6837-4525-b6ba-9b9daab97383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.043507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc0f3a-6837-4525-b6ba-9b9daab97383 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.043916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc0f3a-6837-4525-b6ba-9b9daab97383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.044338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc0f3a-6837-4525-b6ba-9b9daab97383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.045254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc0f3a-6837-4525-b6ba-9b9daab97383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.047233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc0f3a-6837-4525-b6ba-9b9daab97383 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.060989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 977/1955] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:30.062045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc0f3a-6837-4525-b6ba-9b9daab97383 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.063921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-97cc0f3a-6837-4525-b6ba-9b9daab97383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:30.078750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc0f3a-6837-4525-b6ba-9b9daab97383 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.084831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5749f47-8280-4aee-9b9c-8758019d216b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.086194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5749f47-8280-4aee-9b9c-8758019d216b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.086558 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5749f47-8280-4aee-9b9c-8758019d216b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.086975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5749f47-8280-4aee-9b9c-8758019d216b admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.087757 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5749f47-8280-4aee-9b9c-8758019d216b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.089984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5749f47-8280-4aee-9b9c-8758019d216b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.109730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 979/1956] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:30.109730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10e8bf-fe34-40c2-8885-ccde719d5673 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.128014 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 978/1957] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:30 2022] POST /identity/v3/users => generated 289 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:30.129878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5749f47-8280-4aee-9b9c-8758019d216b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.134465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10e8bf-fe34-40c2-8885-ccde719d5673 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.145103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5749f47-8280-4aee-9b9c-8758019d216b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.149293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543963-3068-4d80-a81a-bfb6db195d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.151776 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543963-3068-4d80-a81a-bfb6db195d15 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.152626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543963-3068-4d80-a81a-bfb6db195d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.154420 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543963-3068-4d80-a81a-bfb6db195d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.155214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf4e22-966e-40e5-9c43-c6957a152d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.156235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf4e22-966e-40e5-9c43-c6957a152d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.156592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf4e22-966e-40e5-9c43-c6957a152d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.157165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf4e22-966e-40e5-9c43-c6957a152d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.157933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf4e22-966e-40e5-9c43-c6957a152d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.158492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543963-3068-4d80-a81a-bfb6db195d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.160771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf4e22-966e-40e5-9c43-c6957a152d31 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.164898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543963-3068-4d80-a81a-bfb6db195d15 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.184110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 979/1958] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:30.185832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e24d-9779-4155-8245-f9fc75060287 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.186336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e24d-9779-4155-8245-f9fc75060287 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.186841 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e24d-9779-4155-8245-f9fc75060287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.196584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 980/1959] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:30.197606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543963-3068-4d80-a81a-bfb6db195d15 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.213251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ce23e24d-9779-4155-8245-f9fc75060287 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:30.214891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543963-3068-4d80-a81a-bfb6db195d15 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.216226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ce23e24d-9779-4155-8245-f9fc75060287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:30.224681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cd5da-2a79-48db-839d-337436e7e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.225982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cd5da-2a79-48db-839d-337436e7e92a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.226274 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cd5da-2a79-48db-839d-337436e7e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.226561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cd5da-2a79-48db-839d-337436e7e92a admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.227389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cd5da-2a79-48db-839d-337436e7e92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.230752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 980/1960] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:30.231617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cd5da-2a79-48db-839d-337436e7e92a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.232264 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e24d-9779-4155-8245-f9fc75060287 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.243669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e24d-9779-4155-8245-f9fc75060287 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.257220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 981/1961] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:30.257220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cd5da-2a79-48db-839d-337436e7e92a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.258466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceeb5f4-95b0-4419-80c9-e9c101d79a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.259865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceeb5f4-95b0-4419-80c9-e9c101d79a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.260262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceeb5f4-95b0-4419-80c9-e9c101d79a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.260659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceeb5f4-95b0-4419-80c9-e9c101d79a15 admin admin] PATH_INFO: `/v3/projects/acd26547cd0f4eb1acf25ae9ac1e6aaf/users/92ce46fe28914f6a9323a6f7fba90afa/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.277570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cd5da-2a79-48db-839d-337436e7e92a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.283942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceeb5f4-95b0-4419-80c9-e9c101d79a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd26547cd0f4eb1acf25ae9ac1e6aaf, user_id=92ce46fe28914f6a9323a6f7fba90afa, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.284397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc69d9-80aa-41ed-b0d5-a990ce7ccb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.285283 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc69d9-80aa-41ed-b0d5-a990ce7ccb78 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.286360 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc69d9-80aa-41ed-b0d5-a990ce7ccb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.286360 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc69d9-80aa-41ed-b0d5-a990ce7ccb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.287254 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc69d9-80aa-41ed-b0d5-a990ce7ccb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.289970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc69d9-80aa-41ed-b0d5-a990ce7ccb78 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.290957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceeb5f4-95b0-4419-80c9-e9c101d79a15 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.308748 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 982/1962] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:30.316192 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 981/1963] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:30 2022] PUT /identity/v3/projects/acd26547cd0f4eb1acf25ae9ac1e6aaf/users/92ce46fe28914f6a9323a6f7fba90afa/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:30.316620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc69d9-80aa-41ed-b0d5-a990ce7ccb78 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.317885 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceeb5f4-95b0-4419-80c9-e9c101d79a15 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.342889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc69d9-80aa-41ed-b0d5-a990ce7ccb78 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.482563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4fa4-7bd5-4865-86c6-1e7f936c7c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.483269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4fa4-7bd5-4865-86c6-1e7f936c7c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.484748 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4fa4-7bd5-4865-86c6-1e7f936c7c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.484987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4fa4-7bd5-4865-86c6-1e7f936c7c2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.485862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a4fa4-7bd5-4865-86c6-1e7f936c7c2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:30.486240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a4fa4-7bd5-4865-86c6-1e7f936c7c2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.489125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a4fa4-7bd5-4865-86c6-1e7f936c7c2d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.491256 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceeb5f4-95b0-4419-80c9-e9c101d79a15 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.505942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 983/1964] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:30.507729 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4fa4-7bd5-4865-86c6-1e7f936c7c2d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.522681 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735996-58d5-412c-bc6c-bee9785c9688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.523410 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735996-58d5-412c-bc6c-bee9785c9688 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.523726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735996-58d5-412c-bc6c-bee9785c9688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.523982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735996-58d5-412c-bc6c-bee9785c9688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.524734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2735996-58d5-412c-bc6c-bee9785c9688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.526473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2735996-58d5-412c-bc6c-bee9785c9688 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.545240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 982/1965] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:30.546679 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9024b06-e1d7-4287-87f5-a857decf10a5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.546984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9024b06-e1d7-4287-87f5-a857decf10a5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.547098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4fa4-7bd5-4865-86c6-1e7f936c7c2d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.547358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9024b06-e1d7-4287-87f5-a857decf10a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.553715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc4450-6a10-4e3d-80ba-50f8b4499145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.554645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc4450-6a10-4e3d-80ba-50f8b4499145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.554930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc4450-6a10-4e3d-80ba-50f8b4499145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.555208 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc4450-6a10-4e3d-80ba-50f8b4499145 admin admin] PATH_INFO: `/v3/projects/13211a3a86c94d23909622b9544e1cfa/users/5f43d14e33ec446cabee385007a7df1a/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.586201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc4450-6a10-4e3d-80ba-50f8b4499145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13211a3a86c94d23909622b9544e1cfa, user_id=5f43d14e33ec446cabee385007a7df1a, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.589667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc4450-6a10-4e3d-80ba-50f8b4499145 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.592237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c9024b06-e1d7-4287-87f5-a857decf10a5 None None] MFA Rules not processed for user `92ce46fe28914f6a9323a6f7fba90afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:30.595121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c9024b06-e1d7-4287-87f5-a857decf10a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:30.621417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 984/1966] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:30 2022] PUT /identity/v3/projects/13211a3a86c94d23909622b9544e1cfa/users/5f43d14e33ec446cabee385007a7df1a/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:30.622478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc4450-6a10-4e3d-80ba-50f8b4499145 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.634852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:30.652689 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:30.708051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc4450-6a10-4e3d-80ba-50f8b4499145 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.712573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 983/1967] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:30.713469 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9024b06-e1d7-4287-87f5-a857decf10a5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.718632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00baf8c-33cd-4ae7-be63-287c0acd3031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.719809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00baf8c-33cd-4ae7-be63-287c0acd3031 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.720105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00baf8c-33cd-4ae7-be63-287c0acd3031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.721648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00baf8c-33cd-4ae7-be63-287c0acd3031 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.722661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00baf8c-33cd-4ae7-be63-287c0acd3031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.725368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00baf8c-33cd-4ae7-be63-287c0acd3031 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.725599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9024b06-e1d7-4287-87f5-a857decf10a5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.736706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fa5f9-3dfc-495a-9ab9-3648176118b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.737672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa5f9-3dfc-495a-9ab9-3648176118b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.737963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa5f9-3dfc-495a-9ab9-3648176118b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.738242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa5f9-3dfc-495a-9ab9-3648176118b7 admin admin] PATH_INFO: `/v3/projects/056cacc68454447291e9e9fa57525f01/users/d519f82fefcc41a3a8c0a17a2e64ed74/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.756844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fa5f9-3dfc-495a-9ab9-3648176118b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056cacc68454447291e9e9fa57525f01, user_id=d519f82fefcc41a3a8c0a17a2e64ed74, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.759847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fa5f9-3dfc-495a-9ab9-3648176118b7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.767892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 985/1968] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:30 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:30.769761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c19ec-656d-4843-a924-514f3e3f6812 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.770169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c19ec-656d-4843-a924-514f3e3f6812 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.770786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c19ec-656d-4843-a924-514f3e3f6812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.783734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 984/1969] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:30 2022] PUT /identity/v3/projects/056cacc68454447291e9e9fa57525f01/users/d519f82fefcc41a3a8c0a17a2e64ed74/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:30.794432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fa5f9-3dfc-495a-9ab9-3648176118b7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.822258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c65c19ec-656d-4843-a924-514f3e3f6812 None None] MFA Rules not processed for user `5f43d14e33ec446cabee385007a7df1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:30.823602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c65c19ec-656d-4843-a924-514f3e3f6812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:30.866200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fa5f9-3dfc-495a-9ab9-3648176118b7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.871160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfee9d6-9f70-4390-8419-5076cd66fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:30.871922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfee9d6-9f70-4390-8419-5076cd66fabe admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.872288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfee9d6-9f70-4390-8419-5076cd66fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.872648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfee9d6-9f70-4390-8419-5076cd66fabe admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.873481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfee9d6-9f70-4390-8419-5076cd66fabe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:30.875527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfee9d6-9f70-4390-8419-5076cd66fabe admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:30.902561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 986/1970] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:30.903612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c19ec-656d-4843-a924-514f3e3f6812 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:30.915085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 985/1971] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:30 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:30.917027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dabf0-578c-40b9-a343-5644744a27e6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:30.917389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dabf0-578c-40b9-a343-5644744a27e6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:30.917708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dabf0-578c-40b9-a343-5644744a27e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:30.921132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c19ec-656d-4843-a924-514f3e3f6812 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:30.959488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b32dabf0-578c-40b9-a343-5644744a27e6 None None] MFA Rules not processed for user `d519f82fefcc41a3a8c0a17a2e64ed74`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:30.961839 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b32dabf0-578c-40b9-a343-5644744a27e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:31.002913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747e074-71cd-4e83-86a5-c017bb284757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.003647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747e074-71cd-4e83-86a5-c017bb284757 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.003978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747e074-71cd-4e83-86a5-c017bb284757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.004306 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747e074-71cd-4e83-86a5-c017bb284757 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.005086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747e074-71cd-4e83-86a5-c017bb284757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.007276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747e074-71cd-4e83-86a5-c017bb284757 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.029167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 987/1972] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:30 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:31.030356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747e074-71cd-4e83-86a5-c017bb284757 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.038319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 986/1973] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:31.039386 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dabf0-578c-40b9-a343-5644744a27e6 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.046603 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747e074-71cd-4e83-86a5-c017bb284757 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.050808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dabf0-578c-40b9-a343-5644744a27e6 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.051513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb1c14-9c86-4409-8b3e-5f56619e16d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.052325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb1c14-9c86-4409-8b3e-5f56619e16d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.052759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb1c14-9c86-4409-8b3e-5f56619e16d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.053127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb1c14-9c86-4409-8b3e-5f56619e16d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.054634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb1c14-9c86-4409-8b3e-5f56619e16d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.056057 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3aa366-b51e-4ab8-9ddf-691b397ac96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.056569 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb1c14-9c86-4409-8b3e-5f56619e16d5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.056740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3aa366-b51e-4ab8-9ddf-691b397ac96f admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.057033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3aa366-b51e-4ab8-9ddf-691b397ac96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.057371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3aa366-b51e-4ab8-9ddf-691b397ac96f admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.058073 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3aa366-b51e-4ab8-9ddf-691b397ac96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.060118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3aa366-b51e-4ab8-9ddf-691b397ac96f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.070752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:31.081528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:31.084186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 987/1974] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:31 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:31.088691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3aa366-b51e-4ab8-9ddf-691b397ac96f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.098863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 988/1975] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:31 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:31.099769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb1c14-9c86-4409-8b3e-5f56619e16d5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.100688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3aa366-b51e-4ab8-9ddf-691b397ac96f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.170339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43190541-eee9-4e28-af89-8a61447d783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.171234 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43190541-eee9-4e28-af89-8a61447d783b admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.171621 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43190541-eee9-4e28-af89-8a61447d783b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.171980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43190541-eee9-4e28-af89-8a61447d783b admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.172802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43190541-eee9-4e28-af89-8a61447d783b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.174612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb1c14-9c86-4409-8b3e-5f56619e16d5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.174779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43190541-eee9-4e28-af89-8a61447d783b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.180504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317878d1-2faa-4aa0-8568-83657abef5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.181206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317878d1-2faa-4aa0-8568-83657abef5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.181783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317878d1-2faa-4aa0-8568-83657abef5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.181893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317878d1-2faa-4aa0-8568-83657abef5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.182917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317878d1-2faa-4aa0-8568-83657abef5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.184549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317878d1-2faa-4aa0-8568-83657abef5a4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.189958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 988/1976] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:31.189958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43190541-eee9-4e28-af89-8a61447d783b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.199261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43190541-eee9-4e28-af89-8a61447d783b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.204723 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08486ae5-91d0-41ec-863b-370d36bbde90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.205622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08486ae5-91d0-41ec-863b-370d36bbde90 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.205914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08486ae5-91d0-41ec-863b-370d36bbde90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.206205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08486ae5-91d0-41ec-863b-370d36bbde90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.207066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08486ae5-91d0-41ec-863b-370d36bbde90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.208732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08486ae5-91d0-41ec-863b-370d36bbde90 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.217233 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 989/1977] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:31 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:31.218057 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317878d1-2faa-4aa0-8568-83657abef5a4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.219533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 989/1978] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:31.222101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08486ae5-91d0-41ec-863b-370d36bbde90 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.232630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08486ae5-91d0-41ec-863b-370d36bbde90 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.286670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317878d1-2faa-4aa0-8568-83657abef5a4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.291419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5f566-a999-41ef-b907-d6bbfe6c098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.292101 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5f566-a999-41ef-b907-d6bbfe6c098f admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.292397 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5f566-a999-41ef-b907-d6bbfe6c098f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.292720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5f566-a999-41ef-b907-d6bbfe6c098f admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.293422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5f566-a999-41ef-b907-d6bbfe6c098f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.293701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3651670-5865-4679-a973-c0a8564b56e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.294375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3651670-5865-4679-a973-c0a8564b56e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.294664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3651670-5865-4679-a973-c0a8564b56e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.294979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3651670-5865-4679-a973-c0a8564b56e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.295370 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5f566-a999-41ef-b907-d6bbfe6c098f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.295705 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3651670-5865-4679-a973-c0a8564b56e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.297330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3651670-5865-4679-a973-c0a8564b56e8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.308397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 990/1979] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:31.309332 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3651670-5865-4679-a973-c0a8564b56e8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.320185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 990/1980] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:31 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:31.320742 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3651670-5865-4679-a973-c0a8564b56e8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.320850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5f566-a999-41ef-b907-d6bbfe6c098f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.325549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94064b9c-9991-42ff-8199-a2dc6a388ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.326285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94064b9c-9991-42ff-8199-a2dc6a388ece admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.326576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94064b9c-9991-42ff-8199-a2dc6a388ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.326879 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94064b9c-9991-42ff-8199-a2dc6a388ece admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.327588 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94064b9c-9991-42ff-8199-a2dc6a388ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.329597 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94064b9c-9991-42ff-8199-a2dc6a388ece admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.332745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5f566-a999-41ef-b907-d6bbfe6c098f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.337670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b578678-5e1f-4a31-8eb5-dc5b09a265a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.338566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b578678-5e1f-4a31-8eb5-dc5b09a265a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.338856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b578678-5e1f-4a31-8eb5-dc5b09a265a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.339130 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b578678-5e1f-4a31-8eb5-dc5b09a265a2 admin admin] PATH_INFO: `/v3/projects/9af4d5cddc444276854e8296e3673a78/users/91846b0f693446d08954e5a663a99f60/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.351221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 991/1981] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:31 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:31.351221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94064b9c-9991-42ff-8199-a2dc6a388ece admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.355835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b578678-5e1f-4a31-8eb5-dc5b09a265a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af4d5cddc444276854e8296e3673a78, user_id=91846b0f693446d08954e5a663a99f60, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.358608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b578678-5e1f-4a31-8eb5-dc5b09a265a2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.363077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94064b9c-9991-42ff-8199-a2dc6a388ece admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.368498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb23205-c0ba-4985-9021-a59dd632d028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.369569 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb23205-c0ba-4985-9021-a59dd632d028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.369855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb23205-c0ba-4985-9021-a59dd632d028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.370135 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb23205-c0ba-4985-9021-a59dd632d028 admin admin] PATH_INFO: `/v3/projects/59115a2e3d7243b0ba8bb60a2b907a64/users/ad476d03121d427c930ac466e21d72db/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.377430 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 991/1982] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:31 2022] PUT /identity/v3/projects/9af4d5cddc444276854e8296e3673a78/users/91846b0f693446d08954e5a663a99f60/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:31.378429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b578678-5e1f-4a31-8eb5-dc5b09a265a2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.388994 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb23205-c0ba-4985-9021-a59dd632d028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59115a2e3d7243b0ba8bb60a2b907a64, user_id=ad476d03121d427c930ac466e21d72db, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.392327 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb23205-c0ba-4985-9021-a59dd632d028 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.410589 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 992/1983] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:31 2022] PUT /identity/v3/projects/59115a2e3d7243b0ba8bb60a2b907a64/users/ad476d03121d427c930ac466e21d72db/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:31.411599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb23205-c0ba-4985-9021-a59dd632d028 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.464140 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:31.466805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:31.481766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b578678-5e1f-4a31-8eb5-dc5b09a265a2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.518431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb23205-c0ba-4985-9021-a59dd632d028 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.525247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c08b-f3dc-41b3-8aaa-c45f84aca76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.525951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c08b-f3dc-41b3-8aaa-c45f84aca76a admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.526242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c08b-f3dc-41b3-8aaa-c45f84aca76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.526520 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c08b-f3dc-41b3-8aaa-c45f84aca76a admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.527296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066c08b-f3dc-41b3-8aaa-c45f84aca76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.533892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066c08b-f3dc-41b3-8aaa-c45f84aca76a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.550943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 993/1984] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:31.551809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c08b-f3dc-41b3-8aaa-c45f84aca76a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.564749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c08b-f3dc-41b3-8aaa-c45f84aca76a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.570610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c702d6f-d94f-47e5-bf28-134e5274dd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.571283 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c702d6f-d94f-47e5-bf28-134e5274dd38 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.571563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c702d6f-d94f-47e5-bf28-134e5274dd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.571846 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c702d6f-d94f-47e5-bf28-134e5274dd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.572899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c702d6f-d94f-47e5-bf28-134e5274dd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.575810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c702d6f-d94f-47e5-bf28-134e5274dd38 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.592861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 994/1985] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:31.613706 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74e76e-b2ba-46e1-9836-5a13caa4b0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.613991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74e76e-b2ba-46e1-9836-5a13caa4b0cf admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.614233 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74e76e-b2ba-46e1-9836-5a13caa4b0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.614516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74e76e-b2ba-46e1-9836-5a13caa4b0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.615640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74e76e-b2ba-46e1-9836-5a13caa4b0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.617227 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74e76e-b2ba-46e1-9836-5a13caa4b0cf admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.620528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d4f53-54d6-41ed-bed3-28ace6800727 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.620831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d4f53-54d6-41ed-bed3-28ace6800727 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.621145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d4f53-54d6-41ed-bed3-28ace6800727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.638172 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 992/1986] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:31.639398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74e76e-b2ba-46e1-9836-5a13caa4b0cf admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.659630 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74e76e-b2ba-46e1-9836-5a13caa4b0cf admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.665888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3d4d4f53-54d6-41ed-bed3-28ace6800727 None None] MFA Rules not processed for user `ad476d03121d427c930ac466e21d72db`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:31.666056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9e4cd-6220-4324-af2d-115bace1de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.666866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9e4cd-6220-4324-af2d-115bace1de30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.667147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9e4cd-6220-4324-af2d-115bace1de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.667430 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9e4cd-6220-4324-af2d-115bace1de30 admin admin] PATH_INFO: `/v3/projects/14d854ac65514992b294c649e33a060a/users/b2d25505961f4415ab4553790e430e74/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.667540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3d4d4f53-54d6-41ed-bed3-28ace6800727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:31.686748 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9e4cd-6220-4324-af2d-115bace1de30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d854ac65514992b294c649e33a060a, user_id=b2d25505961f4415ab4553790e430e74, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.689655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9e4cd-6220-4324-af2d-115bace1de30 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.706692 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 993/1987] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:31 2022] PUT /identity/v3/projects/14d854ac65514992b294c649e33a060a/users/b2d25505961f4415ab4553790e430e74/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:31.707741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9e4cd-6220-4324-af2d-115bace1de30 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.758428 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 995/1988] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:31.761962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d4f53-54d6-41ed-bed3-28ace6800727 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.780927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d4f53-54d6-41ed-bed3-28ace6800727 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.795602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9e4cd-6220-4324-af2d-115bace1de30 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.801675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038595ed-e63a-43bb-a830-6763e125c4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.802608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038595ed-e63a-43bb-a830-6763e125c4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.802900 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038595ed-e63a-43bb-a830-6763e125c4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.803847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038595ed-e63a-43bb-a830-6763e125c4ff admin admin] PATH_INFO: `/v3/projects/9af4d5cddc444276854e8296e3673a78/users/91846b0f693446d08954e5a663a99f60/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.805456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038595ed-e63a-43bb-a830-6763e125c4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af4d5cddc444276854e8296e3673a78, user_id=91846b0f693446d08954e5a663a99f60, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.808259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038595ed-e63a-43bb-a830-6763e125c4ff admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.821832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 994/1989] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:31 2022] PUT /identity/v3/projects/9af4d5cddc444276854e8296e3673a78/users/91846b0f693446d08954e5a663a99f60/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:31.830498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038595ed-e63a-43bb-a830-6763e125c4ff admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.882661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3d9e0-70f8-4e3b-bb87-59bdf94f0861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.883509 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3d9e0-70f8-4e3b-bb87-59bdf94f0861 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.883987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3d9e0-70f8-4e3b-bb87-59bdf94f0861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.884348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3d9e0-70f8-4e3b-bb87-59bdf94f0861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.885257 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3d9e0-70f8-4e3b-bb87-59bdf94f0861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.886974 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3d9e0-70f8-4e3b-bb87-59bdf94f0861 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.896966 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038595ed-e63a-43bb-a830-6763e125c4ff admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.901347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 996/1990] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:31.901347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3d9e0-70f8-4e3b-bb87-59bdf94f0861 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.907797 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac5137-fb24-46d4-b633-34994df51ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.908626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac5137-fb24-46d4-b633-34994df51ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.908921 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac5137-fb24-46d4-b633-34994df51ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.909917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3d9e0-70f8-4e3b-bb87-59bdf94f0861 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:31.910050 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac5137-fb24-46d4-b633-34994df51ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.911066 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac5137-fb24-46d4-b633-34994df51ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.912775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac5137-fb24-46d4-b633-34994df51ee8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.914783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e1e12-f46c-4d8a-a328-dc3c16df3c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:31.915783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e1e12-f46c-4d8a-a328-dc3c16df3c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.915783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e1e12-f46c-4d8a-a328-dc3c16df3c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.916056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e1e12-f46c-4d8a-a328-dc3c16df3c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.916844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e1e12-f46c-4d8a-a328-dc3c16df3c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:31.919165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e1e12-f46c-4d8a-a328-dc3c16df3c7f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:31.921940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:31.926804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 995/1991] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:31.928799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb9fec-0af2-43a0-9f70-8e78a303332f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:31.929528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb9fec-0af2-43a0-9f70-8e78a303332f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:31.929843 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb9fec-0af2-43a0-9f70-8e78a303332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:31.952563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 997/1992] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:31 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:31.955659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e1e12-f46c-4d8a-a328-dc3c16df3c7f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:31.966805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3cfb9fec-0af2-43a0-9f70-8e78a303332f None None] MFA Rules not processed for user `91846b0f693446d08954e5a663a99f60`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:31.968165 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3cfb9fec-0af2-43a0-9f70-8e78a303332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:31.984663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:32.038809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e1e12-f46c-4d8a-a328-dc3c16df3c7f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.044640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef507f4-0e36-46dd-a644-23bc2c9eb15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.045585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef507f4-0e36-46dd-a644-23bc2c9eb15b admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.045868 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef507f4-0e36-46dd-a644-23bc2c9eb15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.046149 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef507f4-0e36-46dd-a644-23bc2c9eb15b admin admin] PATH_INFO: `/v3/projects/ac459a6741964234abaf4eb8cf290917/users/f03e41839fb6432abee84a1e41f70dde/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.060044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 996/1993] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:32.060936 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb9fec-0af2-43a0-9f70-8e78a303332f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:32.064553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef507f4-0e36-46dd-a644-23bc2c9eb15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac459a6741964234abaf4eb8cf290917, user_id=f03e41839fb6432abee84a1e41f70dde, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.067665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef507f4-0e36-46dd-a644-23bc2c9eb15b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:32.072625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb9fec-0af2-43a0-9f70-8e78a303332f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.077567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8275e-fbb3-49b4-b19b-b22bc220228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.078465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8275e-fbb3-49b4-b19b-b22bc220228b admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.078750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8275e-fbb3-49b4-b19b-b22bc220228b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.079031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8275e-fbb3-49b4-b19b-b22bc220228b admin admin] PATH_INFO: `/v3/projects/14d854ac65514992b294c649e33a060a/users/b2d25505961f4415ab4553790e430e74/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.081043 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8275e-fbb3-49b4-b19b-b22bc220228b admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d854ac65514992b294c649e33a060a, user_id=b2d25505961f4415ab4553790e430e74, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.082510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 998/1994] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:31 2022] PUT /identity/v3/projects/ac459a6741964234abaf4eb8cf290917/users/f03e41839fb6432abee84a1e41f70dde/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:32.083325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef507f4-0e36-46dd-a644-23bc2c9eb15b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:32.083741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8275e-fbb3-49b4-b19b-b22bc220228b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:32.106893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 997/1995] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:32 2022] PUT /identity/v3/projects/14d854ac65514992b294c649e33a060a/users/b2d25505961f4415ab4553790e430e74/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:32.106893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8275e-fbb3-49b4-b19b-b22bc220228b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:32.110527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5bf8275e-fbb3-49b4-b19b-b22bc220228b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:32.145993 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef507f4-0e36-46dd-a644-23bc2c9eb15b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.168998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8275e-fbb3-49b4-b19b-b22bc220228b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.173387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda63fc-8cad-413f-9644-fcbfe7dae8c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.174057 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda63fc-8cad-413f-9644-fcbfe7dae8c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.174477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda63fc-8cad-413f-9644-fcbfe7dae8c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.174761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda63fc-8cad-413f-9644-fcbfe7dae8c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.204212 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d702-6b25-47db-b1c2-17a74050790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.204817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d702-6b25-47db-b1c2-17a74050790f admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.205131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d702-6b25-47db-b1c2-17a74050790f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.205411 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d702-6b25-47db-b1c2-17a74050790f admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.206109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09d702-6b25-47db-b1c2-17a74050790f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.208117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09d702-6b25-47db-b1c2-17a74050790f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:32.230117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 999/1996] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:32 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:32.231588 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea517f65-0e92-4c3f-9bea-d044346a95bf None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.231878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea517f65-0e92-4c3f-9bea-d044346a95bf None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.232160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea517f65-0e92-4c3f-9bea-d044346a95bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.241110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda63fc-8cad-413f-9644-fcbfe7dae8c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.242678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda63fc-8cad-413f-9644-fcbfe7dae8c5 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:32.253503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 998/1997] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:32.254903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07398beb-d8be-4e4e-9466-b1a3eee3cb75 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.255189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07398beb-d8be-4e4e-9466-b1a3eee3cb75 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.255469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07398beb-d8be-4e4e-9466-b1a3eee3cb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.262367 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ea517f65-0e92-4c3f-9bea-d044346a95bf None None] MFA Rules not processed for user `f03e41839fb6432abee84a1e41f70dde`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:32.263759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ea517f65-0e92-4c3f-9bea-d044346a95bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:32.286704 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-07398beb-d8be-4e4e-9466-b1a3eee3cb75 None None] MFA Rules not processed for user `b2d25505961f4415ab4553790e430e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:32.288818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-07398beb-d8be-4e4e-9466-b1a3eee3cb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:32.304474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:32.311606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:32.356519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1000/1998] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:32.357415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea517f65-0e92-4c3f-9bea-d044346a95bf None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:32.370889 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea517f65-0e92-4c3f-9bea-d044346a95bf None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.375538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddab2dd-4a72-46b2-b0f9-602aaff2bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.376217 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab2dd-4a72-46b2-b0f9-602aaff2bc87 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.376505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab2dd-4a72-46b2-b0f9-602aaff2bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.376846 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab2dd-4a72-46b2-b0f9-602aaff2bc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.377559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddab2dd-4a72-46b2-b0f9-602aaff2bc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.378232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 999/1999] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:32.382985 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07398beb-d8be-4e4e-9466-b1a3eee3cb75 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:32.383084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddab2dd-4a72-46b2-b0f9-602aaff2bc87 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:32.391046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1001/2000] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:32.392327 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddab2dd-4a72-46b2-b0f9-602aaff2bc87 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:32.398350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07398beb-d8be-4e4e-9466-b1a3eee3cb75 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.403222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3af15-49cd-42ff-8863-3ce5109ce486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.404127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3af15-49cd-42ff-8863-3ce5109ce486 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.404425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3af15-49cd-42ff-8863-3ce5109ce486 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.404702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3af15-49cd-42ff-8863-3ce5109ce486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.407428 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddab2dd-4a72-46b2-b0f9-602aaff2bc87 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.412751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bddeb-81f5-4efd-97f5-9766e9525ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.413454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bddeb-81f5-4efd-97f5-9766e9525ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.413940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bddeb-81f5-4efd-97f5-9766e9525ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.414233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bddeb-81f5-4efd-97f5-9766e9525ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.414940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bddeb-81f5-4efd-97f5-9766e9525ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.416870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bddeb-81f5-4efd-97f5-9766e9525ca1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:32.447870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1002/2001] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:32 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:32.447870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bddeb-81f5-4efd-97f5-9766e9525ca1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:32.447870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d89bddeb-81f5-4efd-97f5-9766e9525ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:32.476852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3af15-49cd-42ff-8863-3ce5109ce486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.478831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3af15-49cd-42ff-8863-3ce5109ce486 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:32.492323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1000/2002] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:32.493086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3af15-49cd-42ff-8863-3ce5109ce486 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:32.507844 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3af15-49cd-42ff-8863-3ce5109ce486 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.519308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bddeb-81f5-4efd-97f5-9766e9525ca1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.530558 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fbe4e-c21d-4a70-bbcd-81618fdb7262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.531246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fbe4e-c21d-4a70-bbcd-81618fdb7262 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.531533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fbe4e-c21d-4a70-bbcd-81618fdb7262 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.531869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fbe4e-c21d-4a70-bbcd-81618fdb7262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.606632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fc87a-c770-451c-ad81-0a566d8f82dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.607942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fc87a-c770-451c-ad81-0a566d8f82dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.608600 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fc87a-c770-451c-ad81-0a566d8f82dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.609113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fc87a-c770-451c-ad81-0a566d8f82dd admin admin] PATH_INFO: `/v3/projects/3b81e64772c241b6a3f88ce3710b0363/users/850592b499d04039ab2db4f1a52b8c0d/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.632246 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fc87a-c770-451c-ad81-0a566d8f82dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b81e64772c241b6a3f88ce3710b0363, user_id=850592b499d04039ab2db4f1a52b8c0d, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.636059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fc87a-c770-451c-ad81-0a566d8f82dd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:32.641504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fbe4e-c21d-4a70-bbcd-81618fdb7262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.643500 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fbe4e-c21d-4a70-bbcd-81618fdb7262 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:32.655667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1003/2003] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:32.656720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fbe4e-c21d-4a70-bbcd-81618fdb7262 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:32.659965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1001/2004] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:32 2022] PUT /identity/v3/projects/3b81e64772c241b6a3f88ce3710b0363/users/850592b499d04039ab2db4f1a52b8c0d/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:32.664715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fc87a-c770-451c-ad81-0a566d8f82dd admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:32.671566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fbe4e-c21d-4a70-bbcd-81618fdb7262 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.715135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:32.750007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:32.764066 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fc87a-c770-451c-ad81-0a566d8f82dd admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.769598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dfd87-79f5-4d63-95f0-ad9ef77e1f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.769933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5cff0-232b-45f5-a3f6-13e23f4d8b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.770294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dfd87-79f5-4d63-95f0-ad9ef77e1f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.770588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dfd87-79f5-4d63-95f0-ad9ef77e1f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.770787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5cff0-232b-45f5-a3f6-13e23f4d8b65 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.770906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dfd87-79f5-4d63-95f0-ad9ef77e1f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.771182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5cff0-232b-45f5-a3f6-13e23f4d8b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.772342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5cff0-232b-45f5-a3f6-13e23f4d8b65 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.772463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21dfd87-79f5-4d63-95f0-ad9ef77e1f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.774299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21dfd87-79f5-4d63-95f0-ad9ef77e1f88 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:32.774709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5cff0-232b-45f5-a3f6-13e23f4d8b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.780200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5cff0-232b-45f5-a3f6-13e23f4d8b65 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:32.786047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1002/2005] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:32.790478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dfd87-79f5-4d63-95f0-ad9ef77e1f88 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:32.804278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dfd87-79f5-4d63-95f0-ad9ef77e1f88 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.812166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b464de8-21b4-44a7-bd8e-7fd0c14f5652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.813447 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b464de8-21b4-44a7-bd8e-7fd0c14f5652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.813730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b464de8-21b4-44a7-bd8e-7fd0c14f5652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.814053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b464de8-21b4-44a7-bd8e-7fd0c14f5652 admin admin] PATH_INFO: `/v3/projects/3b81e64772c241b6a3f88ce3710b0363/users/850592b499d04039ab2db4f1a52b8c0d/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.817389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b464de8-21b4-44a7-bd8e-7fd0c14f5652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b81e64772c241b6a3f88ce3710b0363, user_id=850592b499d04039ab2db4f1a52b8c0d, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.820327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b464de8-21b4-44a7-bd8e-7fd0c14f5652 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:32.832647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1004/2006] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:32 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:32.837219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5cff0-232b-45f5-a3f6-13e23f4d8b65 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:32.851461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5cff0-232b-45f5-a3f6-13e23f4d8b65 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:32.854190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1003/2007] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:32 2022] PUT /identity/v3/projects/3b81e64772c241b6a3f88ce3710b0363/users/850592b499d04039ab2db4f1a52b8c0d/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:32.856214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51119edb-01f0-4f92-90ad-949d5e2bf2fd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.857308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51119edb-01f0-4f92-90ad-949d5e2bf2fd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.857590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51119edb-01f0-4f92-90ad-949d5e2bf2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.949669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-51119edb-01f0-4f92-90ad-949d5e2bf2fd None None] MFA Rules not processed for user `850592b499d04039ab2db4f1a52b8c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:32.953592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-51119edb-01f0-4f92-90ad-949d5e2bf2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:32.958717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac644e-1490-4abf-8d2c-7efc7ed27e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:32.959904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac644e-1490-4abf-8d2c-7efc7ed27e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:32.960355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac644e-1490-4abf-8d2c-7efc7ed27e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:32.960767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac644e-1490-4abf-8d2c-7efc7ed27e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:32.962742 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac644e-1490-4abf-8d2c-7efc7ed27e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:32.968329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac644e-1490-4abf-8d2c-7efc7ed27e22 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:33.019018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1005/2008] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:33.035606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac644e-1490-4abf-8d2c-7efc7ed27e22 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:33.057568 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac644e-1490-4abf-8d2c-7efc7ed27e22 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:33.087708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffbb1b-0f10-4128-a6c4-207bd7734fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:33.088647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffbb1b-0f10-4128-a6c4-207bd7734fba admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:33.089254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffbb1b-0f10-4128-a6c4-207bd7734fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:33.089440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffbb1b-0f10-4128-a6c4-207bd7734fba admin admin] PATH_INFO: `/v3/projects/8eddb83193fd4823bd50494a565e1cee/users/6b4439ec9a854fb5b3af51c3c3c79fcf/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:33.129438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffbb1b-0f10-4128-a6c4-207bd7734fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eddb83193fd4823bd50494a565e1cee, user_id=6b4439ec9a854fb5b3af51c3c3c79fcf, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:33.133319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1004/2009] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:33.134002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffbb1b-0f10-4128-a6c4-207bd7734fba admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:33.167880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1006/2010] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:33 2022] PUT /identity/v3/projects/8eddb83193fd4823bd50494a565e1cee/users/6b4439ec9a854fb5b3af51c3c3c79fcf/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:33.172097 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51119edb-01f0-4f92-90ad-949d5e2bf2fd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:33.188271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51119edb-01f0-4f92-90ad-949d5e2bf2fd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:33.208488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffbb1b-0f10-4128-a6c4-207bd7734fba admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:33.326672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffbb1b-0f10-4128-a6c4-207bd7734fba admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:33.340122 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5c5bf-ce7f-465b-b891-5c8ef6ca559f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:33.340830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c5bf-ce7f-465b-b891-5c8ef6ca559f service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:33.341162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c5bf-ce7f-465b-b891-5c8ef6ca559f service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:33.342690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c5bf-ce7f-465b-b891-5c8ef6ca559f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:33.410323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edafb6-2758-418f-a2da-01cb57ff5ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:33.410984 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edafb6-2758-418f-a2da-01cb57ff5ade admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:33.411266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edafb6-2758-418f-a2da-01cb57ff5ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:33.411536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edafb6-2758-418f-a2da-01cb57ff5ade admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:33.412328 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edafb6-2758-418f-a2da-01cb57ff5ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:33.423854 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edafb6-2758-418f-a2da-01cb57ff5ade admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:33.455978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1005/2011] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:33.458295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edafb6-2758-418f-a2da-01cb57ff5ade admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:33.487344 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5c5bf-ce7f-465b-b891-5c8ef6ca559f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:33.490919 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5c5bf-ce7f-465b-b891-5c8ef6ca559f service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:33.500147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edafb6-2758-418f-a2da-01cb57ff5ade admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:33.527561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1007/2012] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:33.528720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be63bec-9030-4b9a-bcdc-e44a8093d099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:33.529782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be63bec-9030-4b9a-bcdc-e44a8093d099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:33.530072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be63bec-9030-4b9a-bcdc-e44a8093d099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:33.530419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be63bec-9030-4b9a-bcdc-e44a8093d099 admin admin] PATH_INFO: `/v3/projects/8eddb83193fd4823bd50494a565e1cee/users/6b4439ec9a854fb5b3af51c3c3c79fcf/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:33.538640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be63bec-9030-4b9a-bcdc-e44a8093d099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eddb83193fd4823bd50494a565e1cee, user_id=6b4439ec9a854fb5b3af51c3c3c79fcf, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:33.541999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be63bec-9030-4b9a-bcdc-e44a8093d099 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:33.558267 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1006/2013] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:33 2022] PUT /identity/v3/projects/8eddb83193fd4823bd50494a565e1cee/users/6b4439ec9a854fb5b3af51c3c3c79fcf/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:33.569921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf02af8-7181-414b-8c74-a987488b7154 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:33.570223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf02af8-7181-414b-8c74-a987488b7154 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:33.570510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf02af8-7181-414b-8c74-a987488b7154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:33.586317 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:33.616103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be63bec-9030-4b9a-bcdc-e44a8093d099 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:33.619159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5be63bec-9030-4b9a-bcdc-e44a8093d099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:33.642948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4bf02af8-7181-414b-8c74-a987488b7154 None None] MFA Rules not processed for user `6b4439ec9a854fb5b3af51c3c3c79fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:33.645408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4bf02af8-7181-414b-8c74-a987488b7154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:33.676669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:33.747537 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be63bec-9030-4b9a-bcdc-e44a8093d099 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:33.753844 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12745215-c6aa-409b-89fc-aaed0a837b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:33.755177 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12745215-c6aa-409b-89fc-aaed0a837b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:33.755670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12745215-c6aa-409b-89fc-aaed0a837b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:33.756658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12745215-c6aa-409b-89fc-aaed0a837b24 admin admin] PATH_INFO: `/v3/users/906706c9b6504f6690a458c8608c26b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:33.758332 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12745215-c6aa-409b-89fc-aaed0a837b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=906706c9b6504f6690a458c8608c26b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:33.760501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12745215-c6aa-409b-89fc-aaed0a837b24 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:33.786152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1008/2014] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:33.798348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf02af8-7181-414b-8c74-a987488b7154 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:33.824924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-12745215-c6aa-409b-89fc-aaed0a837b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '906706c9b6504f6690a458c8608c26b1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:33.839505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-12745215-c6aa-409b-89fc-aaed0a837b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '906706c9b6504f6690a458c8608c26b1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:33.849009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-12745215-c6aa-409b-89fc-aaed0a837b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '906706c9b6504f6690a458c8608c26b1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:33.858370 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-12745215-c6aa-409b-89fc-aaed0a837b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '906706c9b6504f6690a458c8608c26b1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:33.859239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-12745215-c6aa-409b-89fc-aaed0a837b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '906706c9b6504f6690a458c8608c26b1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:33.862130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf02af8-7181-414b-8c74-a987488b7154 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:33.866315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc90ed-11a7-43c8-9ecd-71841fb56af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:33.866534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1007/2015] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:33 2022] DELETE /identity/v3/users/906706c9b6504f6690a458c8608c26b1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:33.867084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc90ed-11a7-43c8-9ecd-71841fb56af1 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:33.867407 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc90ed-11a7-43c8-9ecd-71841fb56af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:33.867719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc90ed-11a7-43c8-9ecd-71841fb56af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:33.869832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6adc90ed-11a7-43c8-9ecd-71841fb56af1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:33.871641 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac0fe-c419-433f-99cb-f679ae06d530 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:33.872000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac0fe-c419-433f-99cb-f679ae06d530 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:33.872373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac0fe-c419-433f-99cb-f679ae06d530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:33.895108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-bb0ac0fe-c419-433f-99cb-f679ae06d530 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:33.897053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bb0ac0fe-c419-433f-99cb-f679ae06d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:33.942356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc90ed-11a7-43c8-9ecd-71841fb56af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:33.943931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc90ed-11a7-43c8-9ecd-71841fb56af1 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:33.954832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1009/2016] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:33.984921 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1008/2017] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:26:34.000062 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc90ed-11a7-43c8-9ecd-71841fb56af1 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:34.001797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6adc90ed-11a7-43c8-9ecd-71841fb56af1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:34.079319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac0fe-c419-433f-99cb-f679ae06d530 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:34.081514 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bb0ac0fe-c419-433f-99cb-f679ae06d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:34.103594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:34.123996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc90ed-11a7-43c8-9ecd-71841fb56af1 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:34.157008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:34.191433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac0fe-c419-433f-99cb-f679ae06d530 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:34.197461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b4516-77ea-4ad7-9843-b487baf1e4e1 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850592b499d04039ab2db4f1a52b8c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b81e64772c241b6a3f88ce3710b0363', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:34.197461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b4516-77ea-4ad7-9843-b487baf1e4e1 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:34.197700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b4516-77ea-4ad7-9843-b487baf1e4e1 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:34.198058 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b4516-77ea-4ad7-9843-b487baf1e4e1 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:34.198828 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b4516-77ea-4ad7-9843-b487baf1e4e1 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:34.200075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b4516-77ea-4ad7-9843-b487baf1e4e1 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:34.201455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b4516-77ea-4ad7-9843-b487baf1e4e1 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:34.215735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1009/2018] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:26:34.219099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a45a94-a211-450f-bd81-7419a5653d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:34.219820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b4516-77ea-4ad7-9843-b487baf1e4e1 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:34.219938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a45a94-a211-450f-bd81-7419a5653d3b service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:34.220385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a45a94-a211-450f-bd81-7419a5653d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:34.221104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a45a94-a211-450f-bd81-7419a5653d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:34.230298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b4516-77ea-4ad7-9843-b487baf1e4e1 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:34.233491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a45a94-a211-450f-bd81-7419a5653d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:34.235824 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a45a94-a211-450f-bd81-7419a5653d3b service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:34.236333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bd5b2-2ee2-4d6d-84fd-3f6df5b2ddd2 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850592b499d04039ab2db4f1a52b8c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b81e64772c241b6a3f88ce3710b0363', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:34.237036 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bd5b2-2ee2-4d6d-84fd-3f6df5b2ddd2 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:34.237449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bd5b2-2ee2-4d6d-84fd-3f6df5b2ddd2 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:34.237643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bd5b2-2ee2-4d6d-84fd-3f6df5b2ddd2 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:34.238432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bd5b2-2ee2-4d6d-84fd-3f6df5b2ddd2 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:34.240995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bd5b2-2ee2-4d6d-84fd-3f6df5b2ddd2 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:34.257496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1010/2019] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:34.316535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1010/2020] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:34 2022] POST /identity/v3/projects => generated 354 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:26:34.321512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a45a94-a211-450f-bd81-7419a5653d3b service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:34.334806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a45a94-a211-450f-bd81-7419a5653d3b service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:34.433644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5800882-1bbf-4f1f-be2b-a4412e76e942 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850592b499d04039ab2db4f1a52b8c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b81e64772c241b6a3f88ce3710b0363', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:34.433644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5800882-1bbf-4f1f-be2b-a4412e76e942 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:34.433644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5800882-1bbf-4f1f-be2b-a4412e76e942 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:34.434186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5800882-1bbf-4f1f-be2b-a4412e76e942 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:34.434388 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5800882-1bbf-4f1f-be2b-a4412e76e942 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:34.434715 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5800882-1bbf-4f1f-be2b-a4412e76e942 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:34.437046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5800882-1bbf-4f1f-be2b-a4412e76e942 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:34.456666 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1011/2021] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:26:34.534048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bd5b2-2ee2-4d6d-84fd-3f6df5b2ddd2 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:34.553107 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bd5b2-2ee2-4d6d-84fd-3f6df5b2ddd2 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:34.560325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850592b499d04039ab2db4f1a52b8c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b81e64772c241b6a3f88ce3710b0363', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:34.562310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:34.562608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:34.562889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] PATH_INFO: `/v3/projects/938f69f10ddb46cf99978b397bcff83c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:34.570232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: Authorizing `identity:delete_project(project_id=938f69f10ddb46cf99978b397bcff83c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:34.572395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:34.688168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938f69f10ddb46cf99978b397bcff83c', 'request_id': 'req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:34.698668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938f69f10ddb46cf99978b397bcff83c', 'request_id': 'req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:34.711736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938f69f10ddb46cf99978b397bcff83c', 'request_id': 'req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:34.723286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5800882-1bbf-4f1f-be2b-a4412e76e942 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:34.726153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a5800882-1bbf-4f1f-be2b-a4412e76e942 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:34.729316 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] The token cache is being invalidate because project 938f69f10ddb46cf99978b397bcff83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:34.729796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:34.730664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:34.732956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1011/2022] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:34 2022] DELETE /identity/v3/projects/938f69f10ddb46cf99978b397bcff83c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:34.778202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:34.780755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:34.881279 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7e5a0-8607-4d1c-a73a-f100b8d975d5 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:34.896015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bba75-fefd-4005-9f72-537756c7b6aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:34.898260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bba75-fefd-4005-9f72-537756c7b6aa service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:34.898811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bba75-fefd-4005-9f72-537756c7b6aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:34.901673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bba75-fefd-4005-9f72-537756c7b6aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:34.904498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4f5bba75-fefd-4005-9f72-537756c7b6aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:34.911956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5800882-1bbf-4f1f-be2b-a4412e76e942 tempest-VolumeQuotaClassesTest-212046448 tempest-VolumeQuotaClassesTest-212046448-project-admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:35.001547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:35.009983 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:35.030602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bba75-fefd-4005-9f72-537756c7b6aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:35.030602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bba75-fefd-4005-9f72-537756c7b6aa service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:35.040741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:35.041754 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:35.042317 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:35.042967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] PATH_INFO: `/v3/projects/e8b2b7c6e67d490080602cd1327e54c3` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:35.044472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b2b7c6e67d490080602cd1327e54c3)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:35.047190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:35.049898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1012/2023] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:35.117333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b2b7c6e67d490080602cd1327e54c3', 'request_id': 'req-18b46e22-d605-49ed-a7b5-d9286c70a3bc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.118953 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bba75-fefd-4005-9f72-537756c7b6aa service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:35.120529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4f5bba75-fefd-4005-9f72-537756c7b6aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:35.126496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b2b7c6e67d490080602cd1327e54c3', 'request_id': 'req-18b46e22-d605-49ed-a7b5-d9286c70a3bc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.135416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b2b7c6e67d490080602cd1327e54c3', 'request_id': 'req-18b46e22-d605-49ed-a7b5-d9286c70a3bc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.139444 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bba75-fefd-4005-9f72-537756c7b6aa service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:35.153416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] The token cache is being invalidate because project e8b2b7c6e67d490080602cd1327e54c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:35.154041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.155616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.161550 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1012/2024] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:34 2022] DELETE /identity/v3/projects/e8b2b7c6e67d490080602cd1327e54c3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:35.163241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:35.164802 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:35.238609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd46c7-3900-4774-9c2b-e5774f719bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:35.239665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd46c7-3900-4774-9c2b-e5774f719bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:35.239952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd46c7-3900-4774-9c2b-e5774f719bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:35.240232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd46c7-3900-4774-9c2b-e5774f719bfe admin admin] PATH_INFO: `/v3/users/ad476d03121d427c930ac466e21d72db` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:35.242047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd46c7-3900-4774-9c2b-e5774f719bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad476d03121d427c930ac466e21d72db)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:35.243925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd46c7-3900-4774-9c2b-e5774f719bfe admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:35.253985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b46e22-d605-49ed-a7b5-d9286c70a3bc admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:35.264567 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:35.265741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:35.266191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:35.266769 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] PATH_INFO: `/v3/users/b2d8f316cf2c446eab77bba24bbc640a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:35.268268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d8f316cf2c446eab77bba24bbc640a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:35.271255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:35.332223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-75bd46c7-3900-4774-9c2b-e5774f719bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad476d03121d427c930ac466e21d72db'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.345268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d8f316cf2c446eab77bba24bbc640a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.350605 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-75bd46c7-3900-4774-9c2b-e5774f719bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad476d03121d427c930ac466e21d72db'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.360709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d8f316cf2c446eab77bba24bbc640a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.361457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-75bd46c7-3900-4774-9c2b-e5774f719bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad476d03121d427c930ac466e21d72db'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.370840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d8f316cf2c446eab77bba24bbc640a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.372334 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-75bd46c7-3900-4774-9c2b-e5774f719bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad476d03121d427c930ac466e21d72db'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.373638 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:35.375450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-75bd46c7-3900-4774-9c2b-e5774f719bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad476d03121d427c930ac466e21d72db'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.383451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d8f316cf2c446eab77bba24bbc640a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.384612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1013/2025] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:35 2022] DELETE /identity/v3/users/ad476d03121d427c930ac466e21d72db => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:35.387808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d8f316cf2c446eab77bba24bbc640a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.389562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120ba2f-8a90-4f53-9841-4adbcec9f7b3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:35.390176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120ba2f-8a90-4f53-9841-4adbcec9f7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:35.390847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120ba2f-8a90-4f53-9841-4adbcec9f7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:35.395319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1013/2026] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:35 2022] DELETE /identity/v3/users/b2d8f316cf2c446eab77bba24bbc640a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:35.435221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c120ba2f-8a90-4f53-9841-4adbcec9f7b3 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:35.435221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c120ba2f-8a90-4f53-9841-4adbcec9f7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:35.563386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1014/2027] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:35.580944 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:35.581405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:35.654824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120ba2f-8a90-4f53-9841-4adbcec9f7b3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:35.656473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c120ba2f-8a90-4f53-9841-4adbcec9f7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:35.667206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:35.671699 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120ba2f-8a90-4f53-9841-4adbcec9f7b3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:35.680600 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed61ae6-ecad-4d8f-8a95-9fe3fc992f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:35.681753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed61ae6-ecad-4d8f-8a95-9fe3fc992f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:35.682203 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed61ae6-ecad-4d8f-8a95-9fe3fc992f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:35.682799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed61ae6-ecad-4d8f-8a95-9fe3fc992f43 admin admin] PATH_INFO: `/v3/users/92ce46fe28914f6a9323a6f7fba90afa` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:35.685137 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed61ae6-ecad-4d8f-8a95-9fe3fc992f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ce46fe28914f6a9323a6f7fba90afa)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:35.688426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed61ae6-ecad-4d8f-8a95-9fe3fc992f43 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:35.707474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0744a-c711-4815-8f35-12196ccea65e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:35.717345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2ad66-9d34-449f-afc1-b33c6fec3fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:35.718037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2ad66-9d34-449f-afc1-b33c6fec3fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:35.718329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2ad66-9d34-449f-afc1-b33c6fec3fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:35.718883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2ad66-9d34-449f-afc1-b33c6fec3fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:35.737297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2ad66-9d34-449f-afc1-b33c6fec3fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:35.738771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2ad66-9d34-449f-afc1-b33c6fec3fb2 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:35.751772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1014/2028] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:35.752670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2ad66-9d34-449f-afc1-b33c6fec3fb2 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:35.754086 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-28a2ad66-9d34-449f-afc1-b33c6fec3fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:35.768406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5ed61ae6-ecad-4d8f-8a95-9fe3fc992f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ce46fe28914f6a9323a6f7fba90afa'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.783896 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5ed61ae6-ecad-4d8f-8a95-9fe3fc992f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ce46fe28914f6a9323a6f7fba90afa'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.792148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5ed61ae6-ecad-4d8f-8a95-9fe3fc992f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ce46fe28914f6a9323a6f7fba90afa'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.802434 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5ed61ae6-ecad-4d8f-8a95-9fe3fc992f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ce46fe28914f6a9323a6f7fba90afa'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.803366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5ed61ae6-ecad-4d8f-8a95-9fe3fc992f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ce46fe28914f6a9323a6f7fba90afa'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:35.814224 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1015/2029] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:35 2022] DELETE /identity/v3/users/92ce46fe28914f6a9323a6f7fba90afa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:35.817712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b66b6-2339-4f24-afae-513ae93a25a6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:35.818575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b66b6-2339-4f24-afae-513ae93a25a6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:35.818979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b66b6-2339-4f24-afae-513ae93a25a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:35.831296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2ad66-9d34-449f-afc1-b33c6fec3fb2 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:35.841499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b14b66b6-2339-4f24-afae-513ae93a25a6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:35.843128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b14b66b6-2339-4f24-afae-513ae93a25a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:35.915369 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94f4c-8eaa-4593-8252-08aa09c36063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:35.916110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94f4c-8eaa-4593-8252-08aa09c36063 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:35.916454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94f4c-8eaa-4593-8252-08aa09c36063 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:35.916744 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94f4c-8eaa-4593-8252-08aa09c36063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:35.918977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2ca94f4c-8eaa-4593-8252-08aa09c36063 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:35.940735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1016/2030] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:35.946105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b66b6-2339-4f24-afae-513ae93a25a6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:35.946105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b14b66b6-2339-4f24-afae-513ae93a25a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:35.961104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b66b6-2339-4f24-afae-513ae93a25a6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:35.966229 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:35.967206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:35.967570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:35.967952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35 admin admin] PATH_INFO: `/v3/projects/d91b86f123b24fadb4bad3e135c0d928` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:35.969784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91b86f123b24fadb4bad3e135c0d928)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:35.971858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:36.032455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91b86f123b24fadb4bad3e135c0d928', 'request_id': 'req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:36.040310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91b86f123b24fadb4bad3e135c0d928', 'request_id': 'req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:36.048948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca94f4c-8eaa-4593-8252-08aa09c36063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:36.052104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91b86f123b24fadb4bad3e135c0d928', 'request_id': 'req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:36.056884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca94f4c-8eaa-4593-8252-08aa09c36063 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:36.062933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:36.067772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35 admin admin] The token cache is being invalidate because project d91b86f123b24fadb4bad3e135c0d928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:36.068277 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1015/2031] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:36.068533 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:36.069008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94f4c-8eaa-4593-8252-08aa09c36063 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:36.070385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2ca94f4c-8eaa-4593-8252-08aa09c36063 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:36.070611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a0e77fee-1793-4ffc-bc22-90e4bfcdad35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:36.072808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1017/2032] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:35 2022] DELETE /identity/v3/projects/d91b86f123b24fadb4bad3e135c0d928 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:36.078402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a11f98-6472-45f8-902b-a94a95f26818 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:36.078913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a11f98-6472-45f8-902b-a94a95f26818 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:36.079630 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a11f98-6472-45f8-902b-a94a95f26818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:36.080909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:36.106350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f8a11f98-6472-45f8-902b-a94a95f26818 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:36.107785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f8a11f98-6472-45f8-902b-a94a95f26818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:36.159007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94f4c-8eaa-4593-8252-08aa09c36063 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:36.240275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1018/2033] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:36.253857 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80386006-1a7d-49a4-8ffd-c63dd75d3c40 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:36.254443 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80386006-1a7d-49a4-8ffd-c63dd75d3c40 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:36.256553 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80386006-1a7d-49a4-8ffd-c63dd75d3c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:36.322099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-80386006-1a7d-49a4-8ffd-c63dd75d3c40 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:36.324253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-80386006-1a7d-49a4-8ffd-c63dd75d3c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:36.341892 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1019/2034] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:36.344045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80386006-1a7d-49a4-8ffd-c63dd75d3c40 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:36.344233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef961e7-f0e4-44dc-a2df-b34341a1ec9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:36.347286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef961e7-f0e4-44dc-a2df-b34341a1ec9e service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:36.347613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef961e7-f0e4-44dc-a2df-b34341a1ec9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:36.347884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef961e7-f0e4-44dc-a2df-b34341a1ec9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:36.354080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6ef961e7-f0e4-44dc-a2df-b34341a1ec9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:36.361733 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80386006-1a7d-49a4-8ffd-c63dd75d3c40 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:36.374793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499e6fc-93c3-4bc6-981f-d8e2dc5dd92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:36.375488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e6fc-93c3-4bc6-981f-d8e2dc5dd92f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:36.375777 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e6fc-93c3-4bc6-981f-d8e2dc5dd92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:36.376060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e6fc-93c3-4bc6-981f-d8e2dc5dd92f admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:36.379925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499e6fc-93c3-4bc6-981f-d8e2dc5dd92f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:36.380257 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499e6fc-93c3-4bc6-981f-d8e2dc5dd92f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:36.383947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499e6fc-93c3-4bc6-981f-d8e2dc5dd92f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:36.401644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef961e7-f0e4-44dc-a2df-b34341a1ec9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:36.403878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef961e7-f0e4-44dc-a2df-b34341a1ec9e service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:36.417011 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1020/2035] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:36.421570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499e6fc-93c3-4bc6-981f-d8e2dc5dd92f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:36.436022 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1016/2036] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:36.436932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef961e7-f0e4-44dc-a2df-b34341a1ec9e service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:36.439309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6ef961e7-f0e4-44dc-a2df-b34341a1ec9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:36.440557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499e6fc-93c3-4bc6-981f-d8e2dc5dd92f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:36.467059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63ff9c-f776-400b-82af-2ace875fdf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:36.468505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63ff9c-f776-400b-82af-2ace875fdf9f admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:36.468798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63ff9c-f776-400b-82af-2ace875fdf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:36.469104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63ff9c-f776-400b-82af-2ace875fdf9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:36.469830 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63ff9c-f776-400b-82af-2ace875fdf9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:36.471789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63ff9c-f776-400b-82af-2ace875fdf9f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:36.473193 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef961e7-f0e4-44dc-a2df-b34341a1ec9e service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:36.484041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:36.488468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:36.488814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:36.489117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] PATH_INFO: `/v3/projects/59115a2e3d7243b0ba8bb60a2b907a64` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:36.498138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59115a2e3d7243b0ba8bb60a2b907a64)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:36.505118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:36.536623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1021/2037] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:36 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:26:36.541419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63ff9c-f776-400b-82af-2ace875fdf9f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:36.620710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59115a2e3d7243b0ba8bb60a2b907a64', 'request_id': 'req-6bb80f40-e1bf-40aa-986b-0105a928ad97'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:36.635769 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59115a2e3d7243b0ba8bb60a2b907a64', 'request_id': 'req-6bb80f40-e1bf-40aa-986b-0105a928ad97'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:36.648074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59115a2e3d7243b0ba8bb60a2b907a64', 'request_id': 'req-6bb80f40-e1bf-40aa-986b-0105a928ad97'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:36.675603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] The token cache is being invalidate because project 59115a2e3d7243b0ba8bb60a2b907a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:36.676051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:36.677564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:36.683722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1017/2038] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:36 2022] DELETE /identity/v3/projects/59115a2e3d7243b0ba8bb60a2b907a64 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:36.686250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:36.690540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:36.706212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63ff9c-f776-400b-82af-2ace875fdf9f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:36.811168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:36.851545 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb80f40-e1bf-40aa-986b-0105a928ad97 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:36.853317 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f52b8-388f-44cf-8dca-055a19a97b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:36.855997 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f52b8-388f-44cf-8dca-055a19a97b1f admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:36.856362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f52b8-388f-44cf-8dca-055a19a97b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:36.857546 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f52b8-388f-44cf-8dca-055a19a97b1f admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:36.859148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:36.860386 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:36.870399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:36.870772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f52b8-388f-44cf-8dca-055a19a97b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:36.870866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] PATH_INFO: `/v3/users/850592b499d04039ab2db4f1a52b8c0d` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:36.870866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=850592b499d04039ab2db4f1a52b8c0d)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:36.871051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f52b8-388f-44cf-8dca-055a19a97b1f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:36.871144 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:36.895772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:36.929108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1022/2039] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:36 2022] POST /identity/v3/users => generated 293 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:36.933001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f52b8-388f-44cf-8dca-055a19a97b1f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:36.935893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-969f52b8-388f-44cf-8dca-055a19a97b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:36.966327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f52b8-388f-44cf-8dca-055a19a97b1f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:36.980115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '850592b499d04039ab2db4f1a52b8c0d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:36.992348 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390d537-c39e-4cf3-9ac2-d5b49b8da12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:36.993301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390d537-c39e-4cf3-9ac2-d5b49b8da12d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:36.993594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390d537-c39e-4cf3-9ac2-d5b49b8da12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:36.993874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390d537-c39e-4cf3-9ac2-d5b49b8da12d admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:36.994820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390d537-c39e-4cf3-9ac2-d5b49b8da12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:37.001213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390d537-c39e-4cf3-9ac2-d5b49b8da12d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:37.008957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '850592b499d04039ab2db4f1a52b8c0d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.018301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1023/2040] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:37.022502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390d537-c39e-4cf3-9ac2-d5b49b8da12d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:37.026512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '850592b499d04039ab2db4f1a52b8c0d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.039769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390d537-c39e-4cf3-9ac2-d5b49b8da12d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:37.040664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '850592b499d04039ab2db4f1a52b8c0d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.042015 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '850592b499d04039ab2db4f1a52b8c0d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.048445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cca1f6-9b26-4f1e-afbb-09593f1b0fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:37.049345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cca1f6-9b26-4f1e-afbb-09593f1b0fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:37.049736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cca1f6-9b26-4f1e-afbb-09593f1b0fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:37.050173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cca1f6-9b26-4f1e-afbb-09593f1b0fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:37.051302 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cca1f6-9b26-4f1e-afbb-09593f1b0fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:37.053280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cca1f6-9b26-4f1e-afbb-09593f1b0fb9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:37.066726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1018/2041] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:36 2022] DELETE /identity/v3/users/850592b499d04039ab2db4f1a52b8c0d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:37.069457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1024/2042] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:37.073027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:37.079018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:37.094702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cca1f6-9b26-4f1e-afbb-09593f1b0fb9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:37.097124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b2cca1f6-9b26-4f1e-afbb-09593f1b0fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:37.122100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cca1f6-9b26-4f1e-afbb-09593f1b0fb9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:37.259099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a15d6-74d7-4ee1-8910-31a4f27645b7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:37.265717 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:37.265938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028136fa-ceca-4967-a893-4ae475b9849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:37.267136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028136fa-ceca-4967-a893-4ae475b9849e admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:37.267432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028136fa-ceca-4967-a893-4ae475b9849e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:37.267718 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028136fa-ceca-4967-a893-4ae475b9849e admin admin] PATH_INFO: `/v3/projects/2efb6354432a47d1b9f4191035385272/users/e85d3242ce6047b5b98799b4ae838101/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:37.267982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:37.268419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:37.268916 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b admin admin] PATH_INFO: `/v3/projects/acd26547cd0f4eb1acf25ae9ac1e6aaf` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:37.273887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd26547cd0f4eb1acf25ae9ac1e6aaf)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:37.277525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:37.323793 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028136fa-ceca-4967-a893-4ae475b9849e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efb6354432a47d1b9f4191035385272, user_id=e85d3242ce6047b5b98799b4ae838101, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:37.328609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028136fa-ceca-4967-a893-4ae475b9849e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:37.360391 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1019/2043] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:37 2022] PUT /identity/v3/projects/2efb6354432a47d1b9f4191035385272/users/e85d3242ce6047b5b98799b4ae838101/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:37.382510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028136fa-ceca-4967-a893-4ae475b9849e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:37.384815 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-028136fa-ceca-4967-a893-4ae475b9849e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:37.409241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd26547cd0f4eb1acf25ae9ac1e6aaf', 'request_id': 'req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.416679 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd26547cd0f4eb1acf25ae9ac1e6aaf', 'request_id': 'req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.430803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd26547cd0f4eb1acf25ae9ac1e6aaf', 'request_id': 'req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.447880 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b admin admin] The token cache is being invalidate because project acd26547cd0f4eb1acf25ae9ac1e6aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:37.448245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.449562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9101b1c8-9759-452a-b6bd-ecb5a60b4b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.452148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1025/2044] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:37 2022] DELETE /identity/v3/projects/acd26547cd0f4eb1acf25ae9ac1e6aaf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:37.453810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acbfea-1fa7-4580-b5ca-38f006aa62a4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:37.454292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acbfea-1fa7-4580-b5ca-38f006aa62a4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:37.454639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acbfea-1fa7-4580-b5ca-38f006aa62a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:37.501444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028136fa-ceca-4967-a893-4ae475b9849e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:37.506947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e6acbfea-1fa7-4580-b5ca-38f006aa62a4 None None] MFA Rules not processed for user `e85d3242ce6047b5b98799b4ae838101`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:37.508188 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:37.508925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e6acbfea-1fa7-4580-b5ca-38f006aa62a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:37.583979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1909d4c-2e6f-4e17-bd6d-a11abc7c3088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:37.585400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1909d4c-2e6f-4e17-bd6d-a11abc7c3088 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:37.585788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1909d4c-2e6f-4e17-bd6d-a11abc7c3088 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:37.586359 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1909d4c-2e6f-4e17-bd6d-a11abc7c3088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:37.588499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:37.601298 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f1909d4c-2e6f-4e17-bd6d-a11abc7c3088 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:37.623207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1026/2045] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:37.624763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acbfea-1fa7-4580-b5ca-38f006aa62a4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:37.629761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e6acbfea-1fa7-4580-b5ca-38f006aa62a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:37.697645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1909d4c-2e6f-4e17-bd6d-a11abc7c3088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:37.699185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1909d4c-2e6f-4e17-bd6d-a11abc7c3088 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:37.714750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1020/2046] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:37.715709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1909d4c-2e6f-4e17-bd6d-a11abc7c3088 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:37.717428 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f1909d4c-2e6f-4e17-bd6d-a11abc7c3088 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:37.718451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acbfea-1fa7-4580-b5ca-38f006aa62a4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:37.725823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c704cc-8cc9-408a-846f-81858f279980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:37.727180 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c704cc-8cc9-408a-846f-81858f279980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:37.727609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c704cc-8cc9-408a-846f-81858f279980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:37.727950 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c704cc-8cc9-408a-846f-81858f279980 admin admin] PATH_INFO: `/v3/users/91846b0f693446d08954e5a663a99f60` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:37.728803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1909d4c-2e6f-4e17-bd6d-a11abc7c3088 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:37.729456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c704cc-8cc9-408a-846f-81858f279980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91846b0f693446d08954e5a663a99f60)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:37.731482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c704cc-8cc9-408a-846f-81858f279980 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:37.732899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ceb463-127d-4d92-8b6d-e949ea642464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:37.734645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ceb463-127d-4d92-8b6d-e949ea642464 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:37.734645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ceb463-127d-4d92-8b6d-e949ea642464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:37.734645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ceb463-127d-4d92-8b6d-e949ea642464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:37.760947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ceb463-127d-4d92-8b6d-e949ea642464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:37.762816 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ceb463-127d-4d92-8b6d-e949ea642464 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:37.783612 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1021/2047] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:37.816697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ceb463-127d-4d92-8b6d-e949ea642464 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:37.819099 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-97ceb463-127d-4d92-8b6d-e949ea642464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:37.825494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-52c704cc-8cc9-408a-846f-81858f279980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91846b0f693446d08954e5a663a99f60'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.849480 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ceb463-127d-4d92-8b6d-e949ea642464 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:37.857224 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-52c704cc-8cc9-408a-846f-81858f279980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91846b0f693446d08954e5a663a99f60'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.862464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:37.864228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:37.865118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:37.866201 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] PATH_INFO: `/v3/users/e85d3242ce6047b5b98799b4ae838101` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:37.869207 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85d3242ce6047b5b98799b4ae838101)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:37.873289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:37.875738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-52c704cc-8cc9-408a-846f-81858f279980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91846b0f693446d08954e5a663a99f60'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.899070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-52c704cc-8cc9-408a-846f-81858f279980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91846b0f693446d08954e5a663a99f60'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.899070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-52c704cc-8cc9-408a-846f-81858f279980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91846b0f693446d08954e5a663a99f60'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.909208 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1027/2048] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:37 2022] DELETE /identity/v3/users/91846b0f693446d08954e5a663a99f60 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:37.939105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85d3242ce6047b5b98799b4ae838101'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.967420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85d3242ce6047b5b98799b4ae838101'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.984159 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85d3242ce6047b5b98799b4ae838101'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.997140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85d3242ce6047b5b98799b4ae838101'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:37.998400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85d3242ce6047b5b98799b4ae838101'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:38.010090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1022/2049] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:37 2022] DELETE /identity/v3/users/e85d3242ce6047b5b98799b4ae838101 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:38.015781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e87a-8aa8-4998-8ac8-2179347278c9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:38.016660 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e87a-8aa8-4998-8ac8-2179347278c9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:38.017109 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e87a-8aa8-4998-8ac8-2179347278c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:38.074404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ed97e87a-8aa8-4998-8ac8-2179347278c9 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:38.075556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ed97e87a-8aa8-4998-8ac8-2179347278c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:38.182468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:38.184675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:38.219610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:38.276065 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1028/2050] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:38.299210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e87a-8aa8-4998-8ac8-2179347278c9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:38.300778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ed97e87a-8aa8-4998-8ac8-2179347278c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:38.307061 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52a93e-2d59-406d-809e-df196136087c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:38.314677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:38.317539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:38.317816 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:38.318353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] PATH_INFO: `/v3/projects/3b81e64772c241b6a3f88ce3710b0363` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:38.324157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b81e64772c241b6a3f88ce3710b0363)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:38.331381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:38.335359 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:38.415837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b81e64772c241b6a3f88ce3710b0363', 'request_id': 'req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:38.425394 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e87a-8aa8-4998-8ac8-2179347278c9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:38.427884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b81e64772c241b6a3f88ce3710b0363', 'request_id': 'req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:38.436806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b81e64772c241b6a3f88ce3710b0363', 'request_id': 'req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:38.448653 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] The token cache is being invalidate because project 3b81e64772c241b6a3f88ce3710b0363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:38.449134 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:38.449970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:38.451848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1023/2051] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:38 2022] DELETE /identity/v3/projects/3b81e64772c241b6a3f88ce3710b0363 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:38.452707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:38.457154 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:38.502794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2467cf7-3962-4988-92a6-32caf0386845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:38.504006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2467cf7-3962-4988-92a6-32caf0386845 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:38.504483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2467cf7-3962-4988-92a6-32caf0386845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:38.505121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2467cf7-3962-4988-92a6-32caf0386845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:38.507791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c2467cf7-3962-4988-92a6-32caf0386845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:38.566219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfd9ab-2088-442a-99da-25dea1fd7a4d admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:38.573242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c713fb-9f09-42cc-98b4-72edc9baaafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:38.574168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c713fb-9f09-42cc-98b4-72edc9baaafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:38.574461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c713fb-9f09-42cc-98b4-72edc9baaafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:38.574740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c713fb-9f09-42cc-98b4-72edc9baaafd admin admin] PATH_INFO: `/v3/projects/9af4d5cddc444276854e8296e3673a78` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:38.576056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c713fb-9f09-42cc-98b4-72edc9baaafd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af4d5cddc444276854e8296e3673a78)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:38.578210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c713fb-9f09-42cc-98b4-72edc9baaafd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:38.607878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2467cf7-3962-4988-92a6-32caf0386845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:38.609764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2467cf7-3962-4988-92a6-32caf0386845 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:38.624140 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1029/2052] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:38.625912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6c5ae-7a9b-4dc4-8f2f-5ae772534ac3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:38.626409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6c5ae-7a9b-4dc4-8f2f-5ae772534ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:38.627221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6c5ae-7a9b-4dc4-8f2f-5ae772534ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:38.656324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2bc6c5ae-7a9b-4dc4-8f2f-5ae772534ac3 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:38.659685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2bc6c5ae-7a9b-4dc4-8f2f-5ae772534ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:38.702731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:38.706967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-22c713fb-9f09-42cc-98b4-72edc9baaafd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af4d5cddc444276854e8296e3673a78', 'request_id': 'req-22c713fb-9f09-42cc-98b4-72edc9baaafd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:38.725409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-22c713fb-9f09-42cc-98b4-72edc9baaafd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af4d5cddc444276854e8296e3673a78', 'request_id': 'req-22c713fb-9f09-42cc-98b4-72edc9baaafd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:38.743508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-22c713fb-9f09-42cc-98b4-72edc9baaafd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af4d5cddc444276854e8296e3673a78', 'request_id': 'req-22c713fb-9f09-42cc-98b4-72edc9baaafd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:38.757366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-22c713fb-9f09-42cc-98b4-72edc9baaafd admin admin] The token cache is being invalidate because project 9af4d5cddc444276854e8296e3673a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:38.757720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-22c713fb-9f09-42cc-98b4-72edc9baaafd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:38.758377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-22c713fb-9f09-42cc-98b4-72edc9baaafd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:38.763390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1024/2053] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:38 2022] DELETE /identity/v3/projects/9af4d5cddc444276854e8296e3673a78 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:38.764162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1030/2054] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:38.767652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e13d5-fbd2-477f-b112-77a1fbd90748 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:38.767652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e13d5-fbd2-477f-b112-77a1fbd90748 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:38.767652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e13d5-fbd2-477f-b112-77a1fbd90748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:38.774395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430975-1733-4552-bc55-f88343ec5a5a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:38.776114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430975-1733-4552-bc55-f88343ec5a5a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:38.776114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430975-1733-4552-bc55-f88343ec5a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:38.801625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1d430975-1733-4552-bc55-f88343ec5a5a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:38.803184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1d430975-1733-4552-bc55-f88343ec5a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:38.804471 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-609e13d5-fbd2-477f-b112-77a1fbd90748 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:38.807090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-609e13d5-fbd2-477f-b112-77a1fbd90748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:38.826688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1025/2055] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:38.829707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1031/2056] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:38.830755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430975-1733-4552-bc55-f88343ec5a5a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:38.832174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796883a8-4f31-4c4c-bf02-925899d26ff8 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:38.832809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796883a8-4f31-4c4c-bf02-925899d26ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:38.833491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796883a8-4f31-4c4c-bf02-925899d26ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:38.854633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430975-1733-4552-bc55-f88343ec5a5a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:38.857212 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-796883a8-4f31-4c4c-bf02-925899d26ff8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:38.859259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-796883a8-4f31-4c4c-bf02-925899d26ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:38.866839 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d445b-64b5-44ea-9798-b13be1ad752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:38.867541 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d445b-64b5-44ea-9798-b13be1ad752e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:38.867834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d445b-64b5-44ea-9798-b13be1ad752e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:38.868115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d445b-64b5-44ea-9798-b13be1ad752e admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:38.871257 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d445b-64b5-44ea-9798-b13be1ad752e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:38.871590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d445b-64b5-44ea-9798-b13be1ad752e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:38.878156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d445b-64b5-44ea-9798-b13be1ad752e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:38.883437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1026/2057] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:38.884979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796883a8-4f31-4c4c-bf02-925899d26ff8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:38.899621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:38.907489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1032/2058] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:38.910656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796883a8-4f31-4c4c-bf02-925899d26ff8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:38.914378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d445b-64b5-44ea-9798-b13be1ad752e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:38.918473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81461a-eaf3-4c61-b397-eaf1d1351a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:38.919601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81461a-eaf3-4c61-b397-eaf1d1351a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:38.919601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81461a-eaf3-4c61-b397-eaf1d1351a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:38.920001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81461a-eaf3-4c61-b397-eaf1d1351a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:38.920925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81461a-eaf3-4c61-b397-eaf1d1351a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:38.921513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81461a-eaf3-4c61-b397-eaf1d1351a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:38.923571 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81461a-eaf3-4c61-b397-eaf1d1351a8d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:38.948885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d445b-64b5-44ea-9798-b13be1ad752e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:38.962759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5700477-445f-4b55-81ae-fbab1c765783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:38.964111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1027/2059] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:38.965611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81461a-eaf3-4c61-b397-eaf1d1351a8d admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:38.977974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5700477-445f-4b55-81ae-fbab1c765783 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:38.980377 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5700477-445f-4b55-81ae-fbab1c765783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:38.981653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5700477-445f-4b55-81ae-fbab1c765783 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:38.983552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5700477-445f-4b55-81ae-fbab1c765783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:38.986546 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5700477-445f-4b55-81ae-fbab1c765783 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:38.988604 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81461a-eaf3-4c61-b397-eaf1d1351a8d admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:39.000452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b6c72-c9f2-4786-be0d-1caf52af6750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:39.001819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b6c72-c9f2-4786-be0d-1caf52af6750 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:39.002470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b6c72-c9f2-4786-be0d-1caf52af6750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:39.003062 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b6c72-c9f2-4786-be0d-1caf52af6750 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:39.004986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b6c72-c9f2-4786-be0d-1caf52af6750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:39.008725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b6c72-c9f2-4786-be0d-1caf52af6750 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:39.033662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1033/2060] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:38 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:39.046400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5700477-445f-4b55-81ae-fbab1c765783 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:39.087288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1028/2061] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:38 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:39.096369 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b6c72-c9f2-4786-be0d-1caf52af6750 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:39.263676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5700477-445f-4b55-81ae-fbab1c765783 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:39.332008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b6c72-c9f2-4786-be0d-1caf52af6750 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:39.369916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de0730-03fa-40fc-9e95-eed169dad00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:39.370632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de0730-03fa-40fc-9e95-eed169dad00f admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:39.370927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de0730-03fa-40fc-9e95-eed169dad00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:39.371212 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de0730-03fa-40fc-9e95-eed169dad00f admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:39.371947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de0730-03fa-40fc-9e95-eed169dad00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:39.373967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de0730-03fa-40fc-9e95-eed169dad00f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:39.428875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1029/2062] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:39 2022] POST /identity/v3/users => generated 291 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:39.428875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de0730-03fa-40fc-9e95-eed169dad00f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:39.440604 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a0de0730-03fa-40fc-9e95-eed169dad00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:39.464333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f48de5-cc0e-4cf9-a82c-553939d97500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:39.465327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f48de5-cc0e-4cf9-a82c-553939d97500 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:39.465689 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f48de5-cc0e-4cf9-a82c-553939d97500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:39.466045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f48de5-cc0e-4cf9-a82c-553939d97500 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:39.467069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f48de5-cc0e-4cf9-a82c-553939d97500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:39.469298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f48de5-cc0e-4cf9-a82c-553939d97500 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:39.494660 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de0730-03fa-40fc-9e95-eed169dad00f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:39.509871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:39.510929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:39.511399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:39.511754 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] PATH_INFO: `/v3/users/d519f82fefcc41a3a8c0a17a2e64ed74` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:39.513451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d519f82fefcc41a3a8c0a17a2e64ed74)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:39.515960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:39.524401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1034/2063] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:39 2022] POST /identity/v3/users => generated 286 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:39.529675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f48de5-cc0e-4cf9-a82c-553939d97500 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:39.531820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-28f48de5-cc0e-4cf9-a82c-553939d97500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:39.546684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f48de5-cc0e-4cf9-a82c-553939d97500 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:39.552501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:39.554138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:39.554508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:39.554897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] PATH_INFO: `/v3/projects/2efb6354432a47d1b9f4191035385272` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:39.556345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2efb6354432a47d1b9f4191035385272)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:39.558922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:39.609729 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd519f82fefcc41a3a8c0a17a2e64ed74'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:39.636985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd519f82fefcc41a3a8c0a17a2e64ed74'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:39.645815 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:DELETE=12 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:39.649232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd519f82fefcc41a3a8c0a17a2e64ed74'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:39.654935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2efb6354432a47d1b9f4191035385272', 'request_id': 'req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:39.666018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd519f82fefcc41a3a8c0a17a2e64ed74'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:39.666320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2efb6354432a47d1b9f4191035385272', 'request_id': 'req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:39.667733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd519f82fefcc41a3a8c0a17a2e64ed74'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:39.676100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2efb6354432a47d1b9f4191035385272', 'request_id': 'req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:39.683982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1030/2064] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:39 2022] DELETE /identity/v3/users/d519f82fefcc41a3a8c0a17a2e64ed74 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:39.684810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:39.685783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:39.687342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:39.694379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] The token cache is being invalidate because project 2efb6354432a47d1b9f4191035385272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:39.694713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:39.695790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:39.698431 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1035/2065] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:39 2022] DELETE /identity/v3/projects/2efb6354432a47d1b9f4191035385272 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:39.699565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:39.702465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:39.780495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a815d1d-1bd0-4d08-be9d-20b598d624f9 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:39.794602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9e194-50b4-4f60-b5d0-2edc3e21ef2a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:39.797988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ae62a-6978-4f51-9562-20951ddf7170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:39.799233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ae62a-6978-4f51-9562-20951ddf7170 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:39.799527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ae62a-6978-4f51-9562-20951ddf7170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:39.799807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ae62a-6978-4f51-9562-20951ddf7170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:39.800571 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ae62a-6978-4f51-9562-20951ddf7170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:39.803028 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ae62a-6978-4f51-9562-20951ddf7170 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:39.803177 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00ab8b-1d18-4179-b581-546b1af56227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:39.804101 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00ab8b-1d18-4179-b581-546b1af56227 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:39.804485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00ab8b-1d18-4179-b581-546b1af56227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:39.804863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00ab8b-1d18-4179-b581-546b1af56227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:39.806182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00ab8b-1d18-4179-b581-546b1af56227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:39.808349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00ab8b-1d18-4179-b581-546b1af56227 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:39.825053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1036/2066] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:39.826503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b5362-4e4a-43b9-aea0-1e07d8713a2f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:39.826891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b5362-4e4a-43b9-aea0-1e07d8713a2f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:39.827269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b5362-4e4a-43b9-aea0-1e07d8713a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:39.836898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1031/2067] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:39.852725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d654ef6-6d53-4655-8e39-c2b78213de8c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:39.854176 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d654ef6-6d53-4655-8e39-c2b78213de8c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:39.854547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d654ef6-6d53-4655-8e39-c2b78213de8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:39.866496 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c70b5362-4e4a-43b9-aea0-1e07d8713a2f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:39.868473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c70b5362-4e4a-43b9-aea0-1e07d8713a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:39.891158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1037/2068] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:39.895973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b5362-4e4a-43b9-aea0-1e07d8713a2f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:39.909150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b5362-4e4a-43b9-aea0-1e07d8713a2f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:39.915763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adb1e5-81c6-4eef-9e2e-1663517d1c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:39.917582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adb1e5-81c6-4eef-9e2e-1663517d1c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:39.917922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adb1e5-81c6-4eef-9e2e-1663517d1c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:39.918824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adb1e5-81c6-4eef-9e2e-1663517d1c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:39.919740 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adb1e5-81c6-4eef-9e2e-1663517d1c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:39.919851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9d654ef6-6d53-4655-8e39-c2b78213de8c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:39.921448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9d654ef6-6d53-4655-8e39-c2b78213de8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:39.921614 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adb1e5-81c6-4eef-9e2e-1663517d1c8a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:39.941913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1038/2069] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:39.945362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adb1e5-81c6-4eef-9e2e-1663517d1c8a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:39.948991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-22adb1e5-81c6-4eef-9e2e-1663517d1c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:39.960019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1032/2070] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:39.960698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d654ef6-6d53-4655-8e39-c2b78213de8c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:39.962190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9d654ef6-6d53-4655-8e39-c2b78213de8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:39.972209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adb1e5-81c6-4eef-9e2e-1663517d1c8a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:39.980910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e6390-313f-4c04-b7a1-10a72d23c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:39.982419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e6390-313f-4c04-b7a1-10a72d23c8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:39.983015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e6390-313f-4c04-b7a1-10a72d23c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:39.984466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e6390-313f-4c04-b7a1-10a72d23c8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:39.986226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e6390-313f-4c04-b7a1-10a72d23c8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:39.988869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e6390-313f-4c04-b7a1-10a72d23c8f8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:40.000710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1039/2071] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:40.007549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e6390-313f-4c04-b7a1-10a72d23c8f8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:40.019682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e6390-313f-4c04-b7a1-10a72d23c8f8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:40.025489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dae79e-d739-4348-9681-3e44b7a01633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:40.027185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dae79e-d739-4348-9681-3e44b7a01633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:40.027926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dae79e-d739-4348-9681-3e44b7a01633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:40.028408 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dae79e-d739-4348-9681-3e44b7a01633 admin admin] PATH_INFO: `/v3/projects/11ec68dbde0344d692eafefcc01719d5/users/559354ede14a42f78e03f5bf3f1b3af3/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:40.039349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d654ef6-6d53-4655-8e39-c2b78213de8c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:40.044642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd137c8-12fa-4c91-b432-9da054d872a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:40.046564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd137c8-12fa-4c91-b432-9da054d872a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:40.046881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd137c8-12fa-4c91-b432-9da054d872a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:40.047171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd137c8-12fa-4c91-b432-9da054d872a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:40.050868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dae79e-d739-4348-9681-3e44b7a01633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ec68dbde0344d692eafefcc01719d5, user_id=559354ede14a42f78e03f5bf3f1b3af3, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:40.054530 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dae79e-d739-4348-9681-3e44b7a01633 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:40.064345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd137c8-12fa-4c91-b432-9da054d872a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:40.065867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd137c8-12fa-4c91-b432-9da054d872a9 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:40.076541 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1040/2072] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:40 2022] PUT /identity/v3/projects/11ec68dbde0344d692eafefcc01719d5/users/559354ede14a42f78e03f5bf3f1b3af3/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:40.077379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6300e5-2bdf-4547-b146-d9be92e7705f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:40.080122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6300e5-2bdf-4547-b146-d9be92e7705f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:40.080122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6300e5-2bdf-4547-b146-d9be92e7705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:40.081292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1033/2073] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:40.082153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd137c8-12fa-4c91-b432-9da054d872a9 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:40.094487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd137c8-12fa-4c91-b432-9da054d872a9 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:40.107081 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8c6300e5-2bdf-4547-b146-d9be92e7705f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:40.109019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8c6300e5-2bdf-4547-b146-d9be92e7705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:40.170533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e886874-fc10-420c-9245-4ec0c18c7525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:40.171712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e886874-fc10-420c-9245-4ec0c18c7525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:40.172103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e886874-fc10-420c-9245-4ec0c18c7525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:40.172484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e886874-fc10-420c-9245-4ec0c18c7525 admin admin] PATH_INFO: `/v3/projects/4ac42883896c44d0b7ac854ea8d86e11/users/866e4e8c4c454f0c9f252b41f332db8e/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:40.199218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1041/2074] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:40.201407 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bcaf4-19fa-46a6-b86e-0fabf6c0d5b8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:40.201959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bcaf4-19fa-46a6-b86e-0fabf6c0d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:40.202475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bcaf4-19fa-46a6-b86e-0fabf6c0d5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:40.203190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e886874-fc10-420c-9245-4ec0c18c7525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac42883896c44d0b7ac854ea8d86e11, user_id=866e4e8c4c454f0c9f252b41f332db8e, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:40.206479 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e886874-fc10-420c-9245-4ec0c18c7525 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:40.225859 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1034/2075] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:40 2022] PUT /identity/v3/projects/4ac42883896c44d0b7ac854ea8d86e11/users/866e4e8c4c454f0c9f252b41f332db8e/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:40.231876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fc7bcaf4-19fa-46a6-b86e-0fabf6c0d5b8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:40.233622 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fc7bcaf4-19fa-46a6-b86e-0fabf6c0d5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:40.237111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e886874-fc10-420c-9245-4ec0c18c7525 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:40.243811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:40.300166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:40.339990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1042/2076] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:40.341573 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fd216-6bba-465f-97ea-2e6a92c08a2f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:40.341937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fd216-6bba-465f-97ea-2e6a92c08a2f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:40.345548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fd216-6bba-465f-97ea-2e6a92c08a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:40.380584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d93fd216-6bba-465f-97ea-2e6a92c08a2f None None] MFA Rules not processed for user `866e4e8c4c454f0c9f252b41f332db8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:40.380883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e886874-fc10-420c-9245-4ec0c18c7525 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:40.382174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d93fd216-6bba-465f-97ea-2e6a92c08a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:40.398232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb2954-c779-479f-b083-8e38a7912f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:40.398941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb2954-c779-479f-b083-8e38a7912f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:40.399301 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb2954-c779-479f-b083-8e38a7912f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:40.400561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb2954-c779-479f-b083-8e38a7912f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:40.401400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb2954-c779-479f-b083-8e38a7912f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:40.418091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb2954-c779-479f-b083-8e38a7912f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:40.421212 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb2954-c779-479f-b083-8e38a7912f46 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:40.459892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1035/2077] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:40.463103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb2954-c779-479f-b083-8e38a7912f46 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:40.533154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1043/2078] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:40.534442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fd216-6bba-465f-97ea-2e6a92c08a2f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:40.552080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fd216-6bba-465f-97ea-2e6a92c08a2f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:40.564926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c516e3-449e-4198-9a47-4b177e6c0a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:40.566380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c516e3-449e-4198-9a47-4b177e6c0a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:40.566874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c516e3-449e-4198-9a47-4b177e6c0a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:40.567656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c516e3-449e-4198-9a47-4b177e6c0a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:40.569503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c516e3-449e-4198-9a47-4b177e6c0a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:40.572259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c516e3-449e-4198-9a47-4b177e6c0a0a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:40.580799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb2954-c779-479f-b083-8e38a7912f46 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:40.586350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ebb75-b978-4219-8f00-5799b304fe6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:40.587167 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ebb75-b978-4219-8f00-5799b304fe6e service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:40.587685 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ebb75-b978-4219-8f00-5799b304fe6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:40.588134 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ebb75-b978-4219-8f00-5799b304fe6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:40.606365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ebb75-b978-4219-8f00-5799b304fe6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:40.608146 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ebb75-b978-4219-8f00-5799b304fe6e service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:40.629631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1036/2079] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:40.631721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ebb75-b978-4219-8f00-5799b304fe6e service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:40.668875 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1044/2080] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:40 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:40.676917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c516e3-449e-4198-9a47-4b177e6c0a0a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:40.688579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ebb75-b978-4219-8f00-5799b304fe6e service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:40.843954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c393-f2ac-4306-9aff-12300945d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:40.844883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c393-f2ac-4306-9aff-12300945d833 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:40.845243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c393-f2ac-4306-9aff-12300945d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:40.845632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c393-f2ac-4306-9aff-12300945d833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:40.846756 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1c393-f2ac-4306-9aff-12300945d833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:40.851089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1c393-f2ac-4306-9aff-12300945d833 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:40.851893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c516e3-449e-4198-9a47-4b177e6c0a0a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:40.863527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0482330-58f8-48e0-befa-60d00829b1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:40.868697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0482330-58f8-48e0-befa-60d00829b1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:40.869173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0482330-58f8-48e0-befa-60d00829b1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:40.869570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0482330-58f8-48e0-befa-60d00829b1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:40.870683 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0482330-58f8-48e0-befa-60d00829b1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:40.878363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0482330-58f8-48e0-befa-60d00829b1b3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:40.955643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1037/2081] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:40 2022] POST /identity/v3/projects => generated 379 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:40.957274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c393-f2ac-4306-9aff-12300945d833 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:40.969099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1045/2082] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:40 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:40.972111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0482330-58f8-48e0-befa-60d00829b1b3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:40.993658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0482330-58f8-48e0-befa-60d00829b1b3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:41.044641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:41.123854 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:41.125992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c393-f2ac-4306-9aff-12300945d833 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:41.147051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a257c-7bef-46f6-8a8f-24a81fc925ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:41.147880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a257c-7bef-46f6-8a8f-24a81fc925ac admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:41.148341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a257c-7bef-46f6-8a8f-24a81fc925ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:41.148760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a257c-7bef-46f6-8a8f-24a81fc925ac admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:41.149634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a257c-7bef-46f6-8a8f-24a81fc925ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:41.151893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a257c-7bef-46f6-8a8f-24a81fc925ac admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:41.184103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1038/2083] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:40 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:26:41.188933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a257c-7bef-46f6-8a8f-24a81fc925ac admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:41.190241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df6b83-f979-4f52-92af-9c2f863c00a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:41.190950 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df6b83-f979-4f52-92af-9c2f863c00a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:41.191240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df6b83-f979-4f52-92af-9c2f863c00a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:41.191528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df6b83-f979-4f52-92af-9c2f863c00a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:41.192293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df6b83-f979-4f52-92af-9c2f863c00a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:41.195290 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df6b83-f979-4f52-92af-9c2f863c00a5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:41.222850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a257c-7bef-46f6-8a8f-24a81fc925ac admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:41.226045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1046/2084] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:41.229318 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df6b83-f979-4f52-92af-9c2f863c00a5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:41.258861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf016a-86c7-4efc-a35e-7c537fdad018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:41.260114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf016a-86c7-4efc-a35e-7c537fdad018 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:41.260515 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf016a-86c7-4efc-a35e-7c537fdad018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:41.261202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf016a-86c7-4efc-a35e-7c537fdad018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:41.262089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df6b83-f979-4f52-92af-9c2f863c00a5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:41.263060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf016a-86c7-4efc-a35e-7c537fdad018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:41.269703 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf016a-86c7-4efc-a35e-7c537fdad018 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:41.273510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49231d43-007c-41ee-a9ea-56179ac395e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:41.274210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49231d43-007c-41ee-a9ea-56179ac395e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:41.274497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49231d43-007c-41ee-a9ea-56179ac395e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:41.274783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49231d43-007c-41ee-a9ea-56179ac395e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:41.275706 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49231d43-007c-41ee-a9ea-56179ac395e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:41.277547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49231d43-007c-41ee-a9ea-56179ac395e2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:41.305054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1039/2085] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:41.306565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf016a-86c7-4efc-a35e-7c537fdad018 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:41.319424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1047/2086] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:41.327770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49231d43-007c-41ee-a9ea-56179ac395e2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:41.336415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf016a-86c7-4efc-a35e-7c537fdad018 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:41.349705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49231d43-007c-41ee-a9ea-56179ac395e2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:41.354269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72474c-169a-4619-9bfc-3eb2f0827191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:41.356398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72474c-169a-4619-9bfc-3eb2f0827191 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:41.358467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72474c-169a-4619-9bfc-3eb2f0827191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:41.358801 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72474c-169a-4619-9bfc-3eb2f0827191 admin admin] PATH_INFO: `/v3/projects/fe2c7afe3a2a4b4db9fe2cc6e252e6d9/users/91c496a7063c4be09cc864dcd9c6823b/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:41.364560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2715652-4659-49a2-8774-73f36b41a98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:41.366534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2715652-4659-49a2-8774-73f36b41a98f admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:41.367031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2715652-4659-49a2-8774-73f36b41a98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:41.369400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2715652-4659-49a2-8774-73f36b41a98f admin admin] PATH_INFO: `/v3/projects/ab8f7ea5d382423dbf310f22088c676c/users/2edeff9a6c70433eb0b0df7b3d05df1e/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:41.405881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72474c-169a-4619-9bfc-3eb2f0827191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2c7afe3a2a4b4db9fe2cc6e252e6d9, user_id=91c496a7063c4be09cc864dcd9c6823b, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:41.413478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72474c-169a-4619-9bfc-3eb2f0827191 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:41.420113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2715652-4659-49a2-8774-73f36b41a98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8f7ea5d382423dbf310f22088c676c, user_id=2edeff9a6c70433eb0b0df7b3d05df1e, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:41.423278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2715652-4659-49a2-8774-73f36b41a98f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:41.461299 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1040/2087] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:41 2022] PUT /identity/v3/projects/fe2c7afe3a2a4b4db9fe2cc6e252e6d9/users/91c496a7063c4be09cc864dcd9c6823b/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:41.463341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1048/2088] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:41 2022] PUT /identity/v3/projects/ab8f7ea5d382423dbf310f22088c676c/users/2edeff9a6c70433eb0b0df7b3d05df1e/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:41.475979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72474c-169a-4619-9bfc-3eb2f0827191 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:41.478611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be62a-5680-4853-85ca-ecb47be70ba3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:41.480558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be62a-5680-4853-85ca-ecb47be70ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:41.483309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be62a-5680-4853-85ca-ecb47be70ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:41.534313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-633be62a-5680-4853-85ca-ecb47be70ba3 None None] MFA Rules not processed for user `2edeff9a6c70433eb0b0df7b3d05df1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:41.538762 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-633be62a-5680-4853-85ca-ecb47be70ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:41.627933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72474c-169a-4619-9bfc-3eb2f0827191 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:41.732563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1049/2089] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:41.753042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633be62a-5680-4853-85ca-ecb47be70ba3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:41.754934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-633be62a-5680-4853-85ca-ecb47be70ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:41.778485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0ef24-1c7c-49e6-8b37-e3275c80fdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:41.779182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0ef24-1c7c-49e6-8b37-e3275c80fdde admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:41.779476 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0ef24-1c7c-49e6-8b37-e3275c80fdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:41.779755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0ef24-1c7c-49e6-8b37-e3275c80fdde admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:41.780557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0ef24-1c7c-49e6-8b37-e3275c80fdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:41.783688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0ef24-1c7c-49e6-8b37-e3275c80fdde admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:41.802424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1041/2090] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:41.805924 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0ef24-1c7c-49e6-8b37-e3275c80fdde admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:41.808418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-baa0ef24-1c7c-49e6-8b37-e3275c80fdde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:41.853651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:41.903319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633be62a-5680-4853-85ca-ecb47be70ba3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:41.909562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ce2cc-b17b-4610-9867-f0ece3ff71bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:41.910771 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce2cc-b17b-4610-9867-f0ece3ff71bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:41.911286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce2cc-b17b-4610-9867-f0ece3ff71bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:41.911781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce2cc-b17b-4610-9867-f0ece3ff71bf admin admin] PATH_INFO: `/v3/projects/056cacc68454447291e9e9fa57525f01` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:41.913366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ce2cc-b17b-4610-9867-f0ece3ff71bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=056cacc68454447291e9e9fa57525f01)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:41.915583 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ce2cc-b17b-4610-9867-f0ece3ff71bf admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:41.932246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0ef24-1c7c-49e6-8b37-e3275c80fdde admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:41.936175 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c58bc-d5f8-4e72-a255-5daa8c99c06e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a4ae82b1b4619b90f9ad0f3dea5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:41.936766 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c58bc-d5f8-4e72-a255-5daa8c99c06e service glance] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:41.937478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c58bc-d5f8-4e72-a255-5daa8c99c06e service glance] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:41.937478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c58bc-d5f8-4e72-a255-5daa8c99c06e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:41.954351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c58bc-d5f8-4e72-a255-5daa8c99c06e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:41.955840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c58bc-d5f8-4e72-a255-5daa8c99c06e service glance] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:41.973601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1042/2091] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:41.974235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c58bc-d5f8-4e72-a255-5daa8c99c06e service glance] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:41.978365 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:41.991790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c58bc-d5f8-4e72-a255-5daa8c99c06e service glance] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:42.017218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-924ce2cc-b17b-4610-9867-f0ece3ff71bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056cacc68454447291e9e9fa57525f01', 'request_id': 'req-924ce2cc-b17b-4610-9867-f0ece3ff71bf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:42.025864 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-924ce2cc-b17b-4610-9867-f0ece3ff71bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056cacc68454447291e9e9fa57525f01', 'request_id': 'req-924ce2cc-b17b-4610-9867-f0ece3ff71bf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:42.038376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-924ce2cc-b17b-4610-9867-f0ece3ff71bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056cacc68454447291e9e9fa57525f01', 'request_id': 'req-924ce2cc-b17b-4610-9867-f0ece3ff71bf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:42.071044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-924ce2cc-b17b-4610-9867-f0ece3ff71bf admin admin] The token cache is being invalidate because project 056cacc68454447291e9e9fa57525f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:42.071606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-924ce2cc-b17b-4610-9867-f0ece3ff71bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:42.072439 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-924ce2cc-b17b-4610-9867-f0ece3ff71bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:42.085594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1050/2092] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:41 2022] DELETE /identity/v3/projects/056cacc68454447291e9e9fa57525f01 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:42.085594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cb354-6289-4b34-abd7-a81283f3a1d7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:42.085594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cb354-6289-4b34-abd7-a81283f3a1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:42.085594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cb354-6289-4b34-abd7-a81283f3a1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:42.127858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3b865-46b6-4397-9d44-1570a1035539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:42.128733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3b865-46b6-4397-9d44-1570a1035539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:42.129030 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3b865-46b6-4397-9d44-1570a1035539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:42.129866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3b865-46b6-4397-9d44-1570a1035539 admin admin] PATH_INFO: `/v3/projects/fe2c7afe3a2a4b4db9fe2cc6e252e6d9/users/91c496a7063c4be09cc864dcd9c6823b/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:42.132236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3b865-46b6-4397-9d44-1570a1035539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2c7afe3a2a4b4db9fe2cc6e252e6d9, user_id=91c496a7063c4be09cc864dcd9c6823b, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:42.135964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3b865-46b6-4397-9d44-1570a1035539 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:42.141212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ee0cb354-6289-4b34-abd7-a81283f3a1d7 None None] MFA Rules not processed for user `559354ede14a42f78e03f5bf3f1b3af3`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:42.144844 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ee0cb354-6289-4b34-abd7-a81283f3a1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:42.157819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1043/2093] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:41 2022] PUT /identity/v3/projects/fe2c7afe3a2a4b4db9fe2cc6e252e6d9/users/91c496a7063c4be09cc864dcd9c6823b/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:42.159763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3b865-46b6-4397-9d44-1570a1035539 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:42.161637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4bc3b865-46b6-4397-9d44-1570a1035539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:42.253966 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1051/2094] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:42.258001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c64853-cb8b-4e35-b6aa-6f39db75ac14 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:42.258426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c64853-cb8b-4e35-b6aa-6f39db75ac14 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:42.258789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c64853-cb8b-4e35-b6aa-6f39db75ac14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:42.286757 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3b865-46b6-4397-9d44-1570a1035539 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:42.293242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:42.294282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:42.294575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:42.294856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] PATH_INFO: `/v3/users/b2d25505961f4415ab4553790e430e74` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:42.296096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d25505961f4415ab4553790e430e74)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:42.296983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-66c64853-cb8b-4e35-b6aa-6f39db75ac14 None None] MFA Rules not processed for user `91c496a7063c4be09cc864dcd9c6823b`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:42.298171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:42.298607 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-66c64853-cb8b-4e35-b6aa-6f39db75ac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:42.366762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:42.369945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d25505961f4415ab4553790e430e74'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:42.389624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d25505961f4415ab4553790e430e74'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:42.399293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1052/2095] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:42.400272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c64853-cb8b-4e35-b6aa-6f39db75ac14 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:42.401559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-66c64853-cb8b-4e35-b6aa-6f39db75ac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:42.403355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d25505961f4415ab4553790e430e74'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:42.426348 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c64853-cb8b-4e35-b6aa-6f39db75ac14 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:42.430113 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d25505961f4415ab4553790e430e74'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:42.431000 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d25505961f4415ab4553790e430e74'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:42.436389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a1a87-ebd3-47b7-b511-22014b43d0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:42.437741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a1a87-ebd3-47b7-b511-22014b43d0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:42.437849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a1a87-ebd3-47b7-b511-22014b43d0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:42.438128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a1a87-ebd3-47b7-b511-22014b43d0a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:42.438984 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a1a87-ebd3-47b7-b511-22014b43d0a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:42.442273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a1a87-ebd3-47b7-b511-22014b43d0a8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:42.453424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1044/2096] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:42 2022] DELETE /identity/v3/users/b2d25505961f4415ab4553790e430e74 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:42.455544 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:42.457129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:42.478882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1053/2097] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:42 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:42.483133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a1a87-ebd3-47b7-b511-22014b43d0a8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:42.485230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cd1a1a87-ebd3-47b7-b511-22014b43d0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:42.508014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:42.545424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4461a40-5eaf-42bc-a868-98aa059df594 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:42.616534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d1ed2-3f6c-40d3-a470-0b4d91661435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:42.617297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d1ed2-3f6c-40d3-a470-0b4d91661435 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:42.618288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d1ed2-3f6c-40d3-a470-0b4d91661435 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:42.618581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d1ed2-3f6c-40d3-a470-0b4d91661435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:42.622803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-010d1ed2-3f6c-40d3-a470-0b4d91661435 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:42.644545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a1a87-ebd3-47b7-b511-22014b43d0a8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:42.658114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7eb2-e79d-4838-8f78-1a6ea3db0208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:42.662183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7eb2-e79d-4838-8f78-1a6ea3db0208 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:42.665037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7eb2-e79d-4838-8f78-1a6ea3db0208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:42.667064 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7eb2-e79d-4838-8f78-1a6ea3db0208 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:42.667910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b7eb2-e79d-4838-8f78-1a6ea3db0208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:42.672438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b7eb2-e79d-4838-8f78-1a6ea3db0208 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:42.728553 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1054/2098] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:42 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:42.732249 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7eb2-e79d-4838-8f78-1a6ea3db0208 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:42.755025 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7eb2-e79d-4838-8f78-1a6ea3db0208 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:42.763420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d1ed2-3f6c-40d3-a470-0b4d91661435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:42.764905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d1ed2-3f6c-40d3-a470-0b4d91661435 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:42.772181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9f231-7b10-4681-9340-254061258f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:42.781261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1045/2099] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:42.789958 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9f231-7b10-4681-9340-254061258f19 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:42.790396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9f231-7b10-4681-9340-254061258f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:42.792840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9f231-7b10-4681-9340-254061258f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:42.795547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9f231-7b10-4681-9340-254061258f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:42.800052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9f231-7b10-4681-9340-254061258f19 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:42.822773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d1ed2-3f6c-40d3-a470-0b4d91661435 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:42.824564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-010d1ed2-3f6c-40d3-a470-0b4d91661435 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:42.831673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1055/2100] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:42.834583 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9f231-7b10-4681-9340-254061258f19 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:42.860186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9f231-7b10-4681-9340-254061258f19 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:42.866712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d7984-0c77-44d1-8a2f-fe028e849178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:42.867901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d7984-0c77-44d1-8a2f-fe028e849178 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:42.868297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d7984-0c77-44d1-8a2f-fe028e849178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:42.868683 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d7984-0c77-44d1-8a2f-fe028e849178 admin admin] PATH_INFO: `/v3/projects/d19bfa0371874eb08626fdad3bc1ae7b/users/b90836f4c8b6442bb548c341561b6327/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:42.879405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d1ed2-3f6c-40d3-a470-0b4d91661435 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:42.891955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d7984-0c77-44d1-8a2f-fe028e849178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19bfa0371874eb08626fdad3bc1ae7b, user_id=b90836f4c8b6442bb548c341561b6327, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:42.906676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:42.908791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d7984-0c77-44d1-8a2f-fe028e849178 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:42.913892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:42.914405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:42.915293 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] PATH_INFO: `/v3/users/5f43d14e33ec446cabee385007a7df1a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:42.917919 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f43d14e33ec446cabee385007a7df1a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:42.932137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:42.962371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1056/2101] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:42 2022] PUT /identity/v3/projects/d19bfa0371874eb08626fdad3bc1ae7b/users/b90836f4c8b6442bb548c341561b6327/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:42.963441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d7984-0c77-44d1-8a2f-fe028e849178 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:42.991843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:43.061614 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f43d14e33ec446cabee385007a7df1a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.098003 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d7984-0c77-44d1-8a2f-fe028e849178 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:43.102293 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f43d14e33ec446cabee385007a7df1a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.115874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c98cd5-8368-41d8-8700-9e43a28116f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:43.116592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c98cd5-8368-41d8-8700-9e43a28116f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:43.116945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c98cd5-8368-41d8-8700-9e43a28116f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:43.117259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c98cd5-8368-41d8-8700-9e43a28116f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:43.118625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c98cd5-8368-41d8-8700-9e43a28116f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:43.120684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c98cd5-8368-41d8-8700-9e43a28116f1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:43.135877 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f43d14e33ec446cabee385007a7df1a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.153145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1057/2102] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:43.160350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f43d14e33ec446cabee385007a7df1a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.160350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f43d14e33ec446cabee385007a7df1a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.160531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c98cd5-8368-41d8-8700-9e43a28116f1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:43.167104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e4c98cd5-8368-41d8-8700-9e43a28116f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:43.179271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1046/2103] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:42 2022] DELETE /identity/v3/users/5f43d14e33ec446cabee385007a7df1a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:43.179806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:43.187157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:43.194994 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c98cd5-8368-41d8-8700-9e43a28116f1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:43.356881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb663a-13e4-456e-8918-7349eae7fe1c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:43.360229 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f238828-b697-4ed4-9b9f-fe70dd200252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:43.361295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f238828-b697-4ed4-9b9f-fe70dd200252 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:43.361684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f238828-b697-4ed4-9b9f-fe70dd200252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:43.362037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f238828-b697-4ed4-9b9f-fe70dd200252 admin admin] PATH_INFO: `/v3/projects/d19bfa0371874eb08626fdad3bc1ae7b/users/b90836f4c8b6442bb548c341561b6327/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:43.364728 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f238828-b697-4ed4-9b9f-fe70dd200252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19bfa0371874eb08626fdad3bc1ae7b, user_id=b90836f4c8b6442bb548c341561b6327, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:43.369757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f238828-b697-4ed4-9b9f-fe70dd200252 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:43.370325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:43.372458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:43.373006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:43.373557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] PATH_INFO: `/v3/projects/14d854ac65514992b294c649e33a060a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:43.376142 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d854ac65514992b294c649e33a060a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:43.379774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:43.395167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:43.410154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1058/2104] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:43 2022] PUT /identity/v3/projects/d19bfa0371874eb08626fdad3bc1ae7b/users/b90836f4c8b6442bb548c341561b6327/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:43.413715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0e6cc-f0fe-4ad0-a2f7-dbed2e41de7f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:43.414856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0e6cc-f0fe-4ad0-a2f7-dbed2e41de7f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:43.415310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0e6cc-f0fe-4ad0-a2f7-dbed2e41de7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:43.439520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f3f0e6cc-f0fe-4ad0-a2f7-dbed2e41de7f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:43.442472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f3f0e6cc-f0fe-4ad0-a2f7-dbed2e41de7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:43.494237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d854ac65514992b294c649e33a060a', 'request_id': 'req-067bb223-fcdb-4372-a0a4-689b4f77087f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.525794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d854ac65514992b294c649e33a060a', 'request_id': 'req-067bb223-fcdb-4372-a0a4-689b4f77087f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.547485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d854ac65514992b294c649e33a060a', 'request_id': 'req-067bb223-fcdb-4372-a0a4-689b4f77087f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.550408 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1059/2105] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:43.565197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0e6cc-f0fe-4ad0-a2f7-dbed2e41de7f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:43.573478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f3f0e6cc-f0fe-4ad0-a2f7-dbed2e41de7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:43.578915 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] The token cache is being invalidate because project 14d854ac65514992b294c649e33a060a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:43.582078 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.585319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.593747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1047/2106] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:43 2022] DELETE /identity/v3/projects/14d854ac65514992b294c649e33a060a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:43.600112 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:43.605771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:43.687722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0e6cc-f0fe-4ad0-a2f7-dbed2e41de7f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:43.717163 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:43.785250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bb223-fcdb-4372-a0a4-689b4f77087f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:43.793281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f1882-bd49-40d8-a24c-2a27981b2152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:43.794849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f1882-bd49-40d8-a24c-2a27981b2152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:43.795313 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f1882-bd49-40d8-a24c-2a27981b2152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:43.795789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f1882-bd49-40d8-a24c-2a27981b2152 admin admin] PATH_INFO: `/v3/users/866e4e8c4c454f0c9f252b41f332db8e` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:43.800753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f1882-bd49-40d8-a24c-2a27981b2152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=866e4e8c4c454f0c9f252b41f332db8e)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:43.803110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f1882-bd49-40d8-a24c-2a27981b2152 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:43.824062 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e3a85-b37b-4e40-9b6a-8341495a7986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:43.824873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e3a85-b37b-4e40-9b6a-8341495a7986 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:43.825198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e3a85-b37b-4e40-9b6a-8341495a7986 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:43.825504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e3a85-b37b-4e40-9b6a-8341495a7986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:43.827442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-448e3a85-b37b-4e40-9b6a-8341495a7986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:43.842999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e3a85-b37b-4e40-9b6a-8341495a7986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:43.845275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e3a85-b37b-4e40-9b6a-8341495a7986 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:43.869196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1060/2107] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:43.871581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882c321-eb97-4c5e-86f0-eab82a98e3ae None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:43.872062 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882c321-eb97-4c5e-86f0-eab82a98e3ae None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:43.872269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882c321-eb97-4c5e-86f0-eab82a98e3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:43.878544 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-466f1882-bd49-40d8-a24c-2a27981b2152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866e4e8c4c454f0c9f252b41f332db8e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.898037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-466f1882-bd49-40d8-a24c-2a27981b2152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866e4e8c4c454f0c9f252b41f332db8e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.906566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-466f1882-bd49-40d8-a24c-2a27981b2152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866e4e8c4c454f0c9f252b41f332db8e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.918705 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-466f1882-bd49-40d8-a24c-2a27981b2152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866e4e8c4c454f0c9f252b41f332db8e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.919604 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-466f1882-bd49-40d8-a24c-2a27981b2152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866e4e8c4c454f0c9f252b41f332db8e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:43.931892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1048/2108] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:43 2022] DELETE /identity/v3/users/866e4e8c4c454f0c9f252b41f332db8e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:43.935577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc970d-a29a-4d2b-8151-7865c0248693 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:43.935577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc970d-a29a-4d2b-8151-7865c0248693 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:43.935577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc970d-a29a-4d2b-8151-7865c0248693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:43.943163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d882c321-eb97-4c5e-86f0-eab82a98e3ae None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:43.946011 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d882c321-eb97-4c5e-86f0-eab82a98e3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:43.968081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-01cc970d-a29a-4d2b-8151-7865c0248693 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:43.971256 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-01cc970d-a29a-4d2b-8151-7865c0248693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:44.100327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:44.123092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1061/2109] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:44.131617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a3313-9d66-4ed5-af2d-c8ccc317a7b1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:44.132068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a3313-9d66-4ed5-af2d-c8ccc317a7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:44.132356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a3313-9d66-4ed5-af2d-c8ccc317a7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:44.174206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-592a3313-9d66-4ed5-af2d-c8ccc317a7b1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:44.175472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-592a3313-9d66-4ed5-af2d-c8ccc317a7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:44.184636 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1049/2110] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:44.198701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1062/2111] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:44.206762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc970d-a29a-4d2b-8151-7865c0248693 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:44.211380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a3313-9d66-4ed5-af2d-c8ccc317a7b1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:44.215110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-592a3313-9d66-4ed5-af2d-c8ccc317a7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:44.243116 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc970d-a29a-4d2b-8151-7865c0248693 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:44.251819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a544c-6e71-49b7-84e2-e504169ac98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:44.252970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a544c-6e71-49b7-84e2-e504169ac98e admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:44.253423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a544c-6e71-49b7-84e2-e504169ac98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:44.254701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a544c-6e71-49b7-84e2-e504169ac98e admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:44.260461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a544c-6e71-49b7-84e2-e504169ac98e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:44.260461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a544c-6e71-49b7-84e2-e504169ac98e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:44.274364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a544c-6e71-49b7-84e2-e504169ac98e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:44.300787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1050/2112] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:44.301837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a544c-6e71-49b7-84e2-e504169ac98e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:44.315336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a544c-6e71-49b7-84e2-e504169ac98e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:44.324984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c580c-52e1-4d45-9f17-38dce9f18956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:44.325885 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c580c-52e1-4d45-9f17-38dce9f18956 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:44.326275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c580c-52e1-4d45-9f17-38dce9f18956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:44.326658 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c580c-52e1-4d45-9f17-38dce9f18956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:44.327467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c580c-52e1-4d45-9f17-38dce9f18956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:44.329650 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c580c-52e1-4d45-9f17-38dce9f18956 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:44.359585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a3313-9d66-4ed5-af2d-c8ccc317a7b1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:44.367151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610570ef-d16d-4451-a655-83f449810d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:44.367832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610570ef-d16d-4451-a655-83f449810d05 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:44.368135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610570ef-d16d-4451-a655-83f449810d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:44.368398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610570ef-d16d-4451-a655-83f449810d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:44.375972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1051/2113] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:44 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:44.380640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c580c-52e1-4d45-9f17-38dce9f18956 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:44.388782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610570ef-d16d-4451-a655-83f449810d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:44.390774 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610570ef-d16d-4451-a655-83f449810d05 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:44.403754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1063/2114] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:44.421636 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:44.546231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c580c-52e1-4d45-9f17-38dce9f18956 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:44.564130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8deb2-8e49-4366-a2dd-5c429ab7e0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:44.564567 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8deb2-8e49-4366-a2dd-5c429ab7e0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:44.565164 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8deb2-8e49-4366-a2dd-5c429ab7e0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:44.565668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8deb2-8e49-4366-a2dd-5c429ab7e0e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:44.566576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8deb2-8e49-4366-a2dd-5c429ab7e0e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:44.574473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8deb2-8e49-4366-a2dd-5c429ab7e0e1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:44.627900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1052/2115] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:44 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:44.632506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610570ef-d16d-4451-a655-83f449810d05 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:44.660425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610570ef-d16d-4451-a655-83f449810d05 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:44.685927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63848930-8d20-4f4b-a906-6bcbffbd51cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:44.688747 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63848930-8d20-4f4b-a906-6bcbffbd51cc admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:44.689986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63848930-8d20-4f4b-a906-6bcbffbd51cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:44.690840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63848930-8d20-4f4b-a906-6bcbffbd51cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:44.695601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63848930-8d20-4f4b-a906-6bcbffbd51cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:44.699572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63848930-8d20-4f4b-a906-6bcbffbd51cc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:44.733395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1064/2116] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:44.734268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8deb2-8e49-4366-a2dd-5c429ab7e0e1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:44.746466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8deb2-8e49-4366-a2dd-5c429ab7e0e1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:44.754863 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa685ee-0145-4a10-98a2-611a010bf3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:44.755968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa685ee-0145-4a10-98a2-611a010bf3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:44.756497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa685ee-0145-4a10-98a2-611a010bf3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:44.756927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa685ee-0145-4a10-98a2-611a010bf3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:44.758041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa685ee-0145-4a10-98a2-611a010bf3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:44.760085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa685ee-0145-4a10-98a2-611a010bf3f6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:44.782510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1053/2117] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:44.787804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63848930-8d20-4f4b-a906-6bcbffbd51cc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:44.809959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63848930-8d20-4f4b-a906-6bcbffbd51cc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:44.816321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c4465-456f-475a-a3a8-ae258c26d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:44.817361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4465-456f-475a-a3a8-ae258c26d4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:44.817684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4465-456f-475a-a3a8-ae258c26d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:44.817969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4465-456f-475a-a3a8-ae258c26d4a7 admin admin] PATH_INFO: `/v3/projects/5127e031d5904de49d81a0c053c23d92/users/887b447484e94478bab6a7ba2166dbc5/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:44.846384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c4465-456f-475a-a3a8-ae258c26d4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5127e031d5904de49d81a0c053c23d92, user_id=887b447484e94478bab6a7ba2166dbc5, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:44.858682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c4465-456f-475a-a3a8-ae258c26d4a7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:44.895341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1065/2118] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:44 2022] PUT /identity/v3/projects/5127e031d5904de49d81a0c053c23d92/users/887b447484e94478bab6a7ba2166dbc5/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:44.924325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352974e1-d298-40ae-a112-4585187988c8 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:44.924922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352974e1-d298-40ae-a112-4585187988c8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:44.925330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352974e1-d298-40ae-a112-4585187988c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:44.995617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-352974e1-d298-40ae-a112-4585187988c8 None None] MFA Rules not processed for user `887b447484e94478bab6a7ba2166dbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:44.997191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-352974e1-d298-40ae-a112-4585187988c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:45.061968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c4465-456f-475a-a3a8-ae258c26d4a7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:45.065464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d04c4465-456f-475a-a3a8-ae258c26d4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:45.134761 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1054/2119] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:45.136785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352974e1-d298-40ae-a112-4585187988c8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:45.140098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-352974e1-d298-40ae-a112-4585187988c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:45.218750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c4465-456f-475a-a3a8-ae258c26d4a7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:45.230004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:45.231381 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:45.231851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:45.232301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] PATH_INFO: `/v3/projects/13211a3a86c94d23909622b9544e1cfa` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:45.234156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=13211a3a86c94d23909622b9544e1cfa)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:45.238180 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:45.307436 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352974e1-d298-40ae-a112-4585187988c8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:45.335545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13211a3a86c94d23909622b9544e1cfa', 'request_id': 'req-3c75290d-b646-4c72-b296-41836022f1ba'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:45.342751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13211a3a86c94d23909622b9544e1cfa', 'request_id': 'req-3c75290d-b646-4c72-b296-41836022f1ba'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:45.356722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13211a3a86c94d23909622b9544e1cfa', 'request_id': 'req-3c75290d-b646-4c72-b296-41836022f1ba'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:45.359238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:45.380552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:45.382027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] The token cache is being invalidate because project 13211a3a86c94d23909622b9544e1cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:45.382027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:45.382904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:45.394345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1066/2120] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:45 2022] DELETE /identity/v3/projects/13211a3a86c94d23909622b9544e1cfa => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:45.399145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:45.402695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:45.447957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:45.450307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:45.451090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:45.452238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] PATH_INFO: `/v3/projects/4ac42883896c44d0b7ac854ea8d86e11` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:45.454129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac42883896c44d0b7ac854ea8d86e11)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:45.464933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:45.523648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75290d-b646-4c72-b296-41836022f1ba admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:45.548716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac42883896c44d0b7ac854ea8d86e11', 'request_id': 'req-60565952-8ca3-457d-ba7e-f798733b381b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:45.563179 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac42883896c44d0b7ac854ea8d86e11', 'request_id': 'req-60565952-8ca3-457d-ba7e-f798733b381b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:45.572134 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac42883896c44d0b7ac854ea8d86e11', 'request_id': 'req-60565952-8ca3-457d-ba7e-f798733b381b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:45.585945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] The token cache is being invalidate because project 4ac42883896c44d0b7ac854ea8d86e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:45.586340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:45.587286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:45.592774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1055/2121] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:45 2022] DELETE /identity/v3/projects/4ac42883896c44d0b7ac854ea8d86e11 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:45.594212 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:45.612018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:45.662810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985859d-d697-4cdd-9c6b-bc9f86bcb23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:45.667109 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985859d-d697-4cdd-9c6b-bc9f86bcb23a admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:45.667433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985859d-d697-4cdd-9c6b-bc9f86bcb23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:45.668752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985859d-d697-4cdd-9c6b-bc9f86bcb23a admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:45.668752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985859d-d697-4cdd-9c6b-bc9f86bcb23a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:45.675075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985859d-d697-4cdd-9c6b-bc9f86bcb23a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:45.737273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1067/2122] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:45 2022] POST /identity/v3/projects => generated 383 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:45.738690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985859d-d697-4cdd-9c6b-bc9f86bcb23a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:45.743804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8985859d-d697-4cdd-9c6b-bc9f86bcb23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:45.749693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60565952-8ca3-457d-ba7e-f798733b381b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:45.897148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985859d-d697-4cdd-9c6b-bc9f86bcb23a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:45.907773 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:45.908798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:45.909110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:45.909460 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] PATH_INFO: `/v3/users/91c496a7063c4be09cc864dcd9c6823b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:45.912686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c496a7063c4be09cc864dcd9c6823b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:45.914626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de666b0c-8dd9-440d-a07b-6c27da870b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:45.916016 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:45.916207 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de666b0c-8dd9-440d-a07b-6c27da870b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:45.916503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de666b0c-8dd9-440d-a07b-6c27da870b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:45.916861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de666b0c-8dd9-440d-a07b-6c27da870b68 admin admin] PATH_INFO: `/v3/users/f03e41839fb6432abee84a1e41f70dde` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:45.918895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de666b0c-8dd9-440d-a07b-6c27da870b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03e41839fb6432abee84a1e41f70dde)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:45.921026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de666b0c-8dd9-440d-a07b-6c27da870b68 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:45.928442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:45.996084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:46.040406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-de666b0c-8dd9-440d-a07b-6c27da870b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03e41839fb6432abee84a1e41f70dde'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:46.071373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c496a7063c4be09cc864dcd9c6823b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:46.103674 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c496a7063c4be09cc864dcd9c6823b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:46.105158 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-de666b0c-8dd9-440d-a07b-6c27da870b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03e41839fb6432abee84a1e41f70dde'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:46.115564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c496a7063c4be09cc864dcd9c6823b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:46.120972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-de666b0c-8dd9-440d-a07b-6c27da870b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03e41839fb6432abee84a1e41f70dde'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:46.126594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c496a7063c4be09cc864dcd9c6823b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:46.127596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c496a7063c4be09cc864dcd9c6823b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:46.141174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1068/2123] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:45 2022] DELETE /identity/v3/users/91c496a7063c4be09cc864dcd9c6823b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:46.143826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:46.146131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:46.146594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-de666b0c-8dd9-440d-a07b-6c27da870b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03e41839fb6432abee84a1e41f70dde'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:46.147352 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-de666b0c-8dd9-440d-a07b-6c27da870b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03e41839fb6432abee84a1e41f70dde'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:46.157161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1056/2124] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:45 2022] DELETE /identity/v3/users/f03e41839fb6432abee84a1e41f70dde => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:46.162197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9fc93-0de1-4cbf-8692-2a9a843055ae None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:46.162952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9fc93-0de1-4cbf-8692-2a9a843055ae None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:46.163566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9fc93-0de1-4cbf-8692-2a9a843055ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:46.196971 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-19e9fc93-0de1-4cbf-8692-2a9a843055ae None None] MFA Rules not processed for user `b90836f4c8b6442bb548c341561b6327`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:46.199177 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-19e9fc93-0de1-4cbf-8692-2a9a843055ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:46.300044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1057/2125] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:46.320975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee484927-9d8f-4835-8b3b-2d0d15b9dc68 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:46.321601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee484927-9d8f-4835-8b3b-2d0d15b9dc68 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:46.322599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee484927-9d8f-4835-8b3b-2d0d15b9dc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:46.362713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ee484927-9d8f-4835-8b3b-2d0d15b9dc68 None None] MFA Rules not processed for user `559354ede14a42f78e03f5bf3f1b3af3`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:46.363990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ee484927-9d8f-4835-8b3b-2d0d15b9dc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:46.397735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bac38-bd2e-4d92-a8ac-2b29cce0c93a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:46.482661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a4419-6a87-44e8-9ed6-0f68db3849df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:46.483485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a4419-6a87-44e8-9ed6-0f68db3849df admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:46.483909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a4419-6a87-44e8-9ed6-0f68db3849df admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:46.484527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1058/2126] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:26:46.488829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a4419-6a87-44e8-9ed6-0f68db3849df admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:46.489852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a4419-6a87-44e8-9ed6-0f68db3849df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:46.491966 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a4419-6a87-44e8-9ed6-0f68db3849df admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:46.507560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee484927-9d8f-4835-8b3b-2d0d15b9dc68 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:46.509325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ee484927-9d8f-4835-8b3b-2d0d15b9dc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:46.520956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1069/2127] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:46 2022] POST /identity/v3/users => generated 298 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:46.526655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a4419-6a87-44e8-9ed6-0f68db3849df admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:46.531219 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9f0a4419-6a87-44e8-9ed6-0f68db3849df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:46.548969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a4419-6a87-44e8-9ed6-0f68db3849df admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:46.554593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dba0e-2b98-4117-bbe6-9ba014ead2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:46.555518 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dba0e-2b98-4117-bbe6-9ba014ead2ca admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:46.555810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dba0e-2b98-4117-bbe6-9ba014ead2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:46.556090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dba0e-2b98-4117-bbe6-9ba014ead2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:46.556868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dba0e-2b98-4117-bbe6-9ba014ead2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:46.558853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dba0e-2b98-4117-bbe6-9ba014ead2ca admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:46.572197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:46.573563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1070/2128] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:46.579484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dba0e-2b98-4117-bbe6-9ba014ead2ca admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:46.599054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dba0e-2b98-4117-bbe6-9ba014ead2ca admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:46.608831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4bdea-450e-44a4-9f9a-507655e0a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:46.613175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4bdea-450e-44a4-9f9a-507655e0a04e admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:46.613623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4bdea-450e-44a4-9f9a-507655e0a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:46.614007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4bdea-450e-44a4-9f9a-507655e0a04e admin admin] PATH_INFO: `/v3/projects/13ab86ca1ab64bd5863015827736363c/users/f3cd5366a9d84e68b9d406b9cc55a004/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:46.635539 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4bdea-450e-44a4-9f9a-507655e0a04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ab86ca1ab64bd5863015827736363c, user_id=f3cd5366a9d84e68b9d406b9cc55a004, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:46.640651 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4bdea-450e-44a4-9f9a-507655e0a04e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:46.673635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1071/2129] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:46 2022] PUT /identity/v3/projects/13ab86ca1ab64bd5863015827736363c/users/f3cd5366a9d84e68b9d406b9cc55a004/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:46.675050 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4bdea-450e-44a4-9f9a-507655e0a04e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:46.681260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:46.684575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee484927-9d8f-4835-8b3b-2d0d15b9dc68 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:46.766105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4bdea-450e-44a4-9f9a-507655e0a04e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:46.771943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc23d32-850e-4b3b-b67a-37b34ea54ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:46.772655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc23d32-850e-4b3b-b67a-37b34ea54ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:46.772939 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc23d32-850e-4b3b-b67a-37b34ea54ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:46.773983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc23d32-850e-4b3b-b67a-37b34ea54ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:46.773983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc23d32-850e-4b3b-b67a-37b34ea54ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:46.775692 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc23d32-850e-4b3b-b67a-37b34ea54ce7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:46.788438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb868d-33bf-4b34-b83c-9d863b0158a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:46.789250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb868d-33bf-4b34-b83c-9d863b0158a2 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:46.789527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb868d-33bf-4b34-b83c-9d863b0158a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:46.789845 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb868d-33bf-4b34-b83c-9d863b0158a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:46.792075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-42eb868d-33bf-4b34-b83c-9d863b0158a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:46.800700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1072/2130] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:46.805581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc23d32-850e-4b3b-b67a-37b34ea54ce7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:46.829147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc23d32-850e-4b3b-b67a-37b34ea54ce7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:46.839071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103a6d3-3010-4afd-a680-455c681ceb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:46.840580 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103a6d3-3010-4afd-a680-455c681ceb62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:46.841083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103a6d3-3010-4afd-a680-455c681ceb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:46.841594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103a6d3-3010-4afd-a680-455c681ceb62 admin admin] PATH_INFO: `/v3/projects/13ab86ca1ab64bd5863015827736363c/users/f3cd5366a9d84e68b9d406b9cc55a004/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:46.845324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103a6d3-3010-4afd-a680-455c681ceb62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ab86ca1ab64bd5863015827736363c, user_id=f3cd5366a9d84e68b9d406b9cc55a004, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:46.853932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103a6d3-3010-4afd-a680-455c681ceb62 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:46.870235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1073/2131] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:46 2022] PUT /identity/v3/projects/13ab86ca1ab64bd5863015827736363c/users/f3cd5366a9d84e68b9d406b9cc55a004/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:46.871225 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103a6d3-3010-4afd-a680-455c681ceb62 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:46.885782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3103a6d3-3010-4afd-a680-455c681ceb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:46.900762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb868d-33bf-4b34-b83c-9d863b0158a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:46.902704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb868d-33bf-4b34-b83c-9d863b0158a2 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:46.915928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1059/2132] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:46.917683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb868d-33bf-4b34-b83c-9d863b0158a2 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:46.919123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-42eb868d-33bf-4b34-b83c-9d863b0158a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:46.933912 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb868d-33bf-4b34-b83c-9d863b0158a2 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:46.971086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103a6d3-3010-4afd-a680-455c681ceb62 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:46.977869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7875ce-900f-4fb7-8388-53a16543419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:46.978874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7875ce-900f-4fb7-8388-53a16543419b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:46.979224 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7875ce-900f-4fb7-8388-53a16543419b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:46.979569 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7875ce-900f-4fb7-8388-53a16543419b admin admin] PATH_INFO: `/v3/projects/ac459a6741964234abaf4eb8cf290917` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:46.980846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7875ce-900f-4fb7-8388-53a16543419b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac459a6741964234abaf4eb8cf290917)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:46.983006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7875ce-900f-4fb7-8388-53a16543419b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:47.006743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:47.034678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:47.044499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:47.045102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:47.045689 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] PATH_INFO: `/v3/projects/fe2c7afe3a2a4b4db9fe2cc6e252e6d9` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:47.047940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2c7afe3a2a4b4db9fe2cc6e252e6d9)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:47.051235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d7875ce-900f-4fb7-8388-53a16543419b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac459a6741964234abaf4eb8cf290917', 'request_id': 'req-3d7875ce-900f-4fb7-8388-53a16543419b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.061764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d7875ce-900f-4fb7-8388-53a16543419b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac459a6741964234abaf4eb8cf290917', 'request_id': 'req-3d7875ce-900f-4fb7-8388-53a16543419b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.064109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:47.077615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d7875ce-900f-4fb7-8388-53a16543419b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac459a6741964234abaf4eb8cf290917', 'request_id': 'req-3d7875ce-900f-4fb7-8388-53a16543419b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.101102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d7875ce-900f-4fb7-8388-53a16543419b admin admin] The token cache is being invalidate because project ac459a6741964234abaf4eb8cf290917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:47.101830 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d7875ce-900f-4fb7-8388-53a16543419b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.102819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d7875ce-900f-4fb7-8388-53a16543419b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.108761 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1074/2133] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:46 2022] DELETE /identity/v3/projects/ac459a6741964234abaf4eb8cf290917 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:47.110370 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337e784-57cd-4086-b4c5-ed91f44e5ee0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:47.110664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337e784-57cd-4086-b4c5-ed91f44e5ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:47.110940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337e784-57cd-4086-b4c5-ed91f44e5ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:47.164223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9337e784-57cd-4086-b4c5-ed91f44e5ee0 None None] MFA Rules not processed for user `f3cd5366a9d84e68b9d406b9cc55a004`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:47.165777 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9337e784-57cd-4086-b4c5-ed91f44e5ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:47.172457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:47.196383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2c7afe3a2a4b4db9fe2cc6e252e6d9', 'request_id': 'req-cd22d99b-07a5-4450-9d09-34dc488e9e81'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.210647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2c7afe3a2a4b4db9fe2cc6e252e6d9', 'request_id': 'req-cd22d99b-07a5-4450-9d09-34dc488e9e81'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.219328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2c7afe3a2a4b4db9fe2cc6e252e6d9', 'request_id': 'req-cd22d99b-07a5-4450-9d09-34dc488e9e81'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.242503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] The token cache is being invalidate because project fe2c7afe3a2a4b4db9fe2cc6e252e6d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:47.242825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.243885 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.249401 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1060/2134] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:46 2022] DELETE /identity/v3/projects/fe2c7afe3a2a4b4db9fe2cc6e252e6d9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:47.249401 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:47.250444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:47.277913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1075/2135] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:47.280625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fafb4-c89e-474b-9c7f-95949f7ad841 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:47.281618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fafb4-c89e-474b-9c7f-95949f7ad841 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:47.282173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fafb4-c89e-474b-9c7f-95949f7ad841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:47.307639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1b0fafb4-c89e-474b-9c7f-95949f7ad841 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:47.309299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1b0fafb4-c89e-474b-9c7f-95949f7ad841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:47.355797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22d99b-07a5-4450-9d09-34dc488e9e81 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:47.361506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391eb6e-88da-4303-adae-433abcf8d910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:47.362649 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391eb6e-88da-4303-adae-433abcf8d910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:47.362941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391eb6e-88da-4303-adae-433abcf8d910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:47.363218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391eb6e-88da-4303-adae-433abcf8d910 admin admin] PATH_INFO: `/v3/users/6b4439ec9a854fb5b3af51c3c3c79fcf` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:47.364670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391eb6e-88da-4303-adae-433abcf8d910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4439ec9a854fb5b3af51c3c3c79fcf)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:47.367029 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391eb6e-88da-4303-adae-433abcf8d910 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:47.395618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1076/2136] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:47.403430 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fafb4-c89e-474b-9c7f-95949f7ad841 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:47.404712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1b0fafb4-c89e-474b-9c7f-95949f7ad841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:47.442447 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4391eb6e-88da-4303-adae-433abcf8d910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4439ec9a854fb5b3af51c3c3c79fcf'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.463174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4391eb6e-88da-4303-adae-433abcf8d910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4439ec9a854fb5b3af51c3c3c79fcf'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.480194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4391eb6e-88da-4303-adae-433abcf8d910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4439ec9a854fb5b3af51c3c3c79fcf'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.489677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4391eb6e-88da-4303-adae-433abcf8d910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4439ec9a854fb5b3af51c3c3c79fcf'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.490717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4391eb6e-88da-4303-adae-433abcf8d910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4439ec9a854fb5b3af51c3c3c79fcf'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:47.490916 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fafb4-c89e-474b-9c7f-95949f7ad841 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:47.495839 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:47.498269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22d547-b319-467f-a5cd-7bd0dc77b204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:47.499036 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22d547-b319-467f-a5cd-7bd0dc77b204 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:47.499325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22d547-b319-467f-a5cd-7bd0dc77b204 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:47.499605 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22d547-b319-467f-a5cd-7bd0dc77b204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:47.501513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cd22d547-b319-467f-a5cd-7bd0dc77b204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:47.504043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1061/2137] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:47 2022] DELETE /identity/v3/users/6b4439ec9a854fb5b3af51c3c3c79fcf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:47.506399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7d651-7c62-47c3-82f9-9155c242db75 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:47.506923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7d651-7c62-47c3-82f9-9155c242db75 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:47.507553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7d651-7c62-47c3-82f9-9155c242db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:47.535059 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-30b7d651-7c62-47c3-82f9-9155c242db75 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:47.536812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-30b7d651-7c62-47c3-82f9-9155c242db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:47.583179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:47.587057 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22d547-b319-467f-a5cd-7bd0dc77b204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:47.588954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22d547-b319-467f-a5cd-7bd0dc77b204 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:47.604922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1077/2138] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:47.657432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1062/2139] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:47.660652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22d547-b319-467f-a5cd-7bd0dc77b204 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:47.675197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22d547-b319-467f-a5cd-7bd0dc77b204 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:47.682483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8475ee9-2ab1-45d8-bcca-a85cef6e2998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:47.683446 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8475ee9-2ab1-45d8-bcca-a85cef6e2998 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:47.684157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8475ee9-2ab1-45d8-bcca-a85cef6e2998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:47.684567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8475ee9-2ab1-45d8-bcca-a85cef6e2998 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:47.686135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8475ee9-2ab1-45d8-bcca-a85cef6e2998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:47.686611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8475ee9-2ab1-45d8-bcca-a85cef6e2998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:47.689307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8475ee9-2ab1-45d8-bcca-a85cef6e2998 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:47.714883 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1078/2140] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:47.719321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7d651-7c62-47c3-82f9-9155c242db75 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:47.731869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7d651-7c62-47c3-82f9-9155c242db75 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:47.741678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb8c86-d11b-467a-bc70-a18aee9d60c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:47.742716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb8c86-d11b-467a-bc70-a18aee9d60c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:47.743668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb8c86-d11b-467a-bc70-a18aee9d60c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:47.744152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb8c86-d11b-467a-bc70-a18aee9d60c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:47.745081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb8c86-d11b-467a-bc70-a18aee9d60c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:47.747947 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb8c86-d11b-467a-bc70-a18aee9d60c5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:47.790433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1063/2141] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:47 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:47.792487 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8475ee9-2ab1-45d8-bcca-a85cef6e2998 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:47.807716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8475ee9-2ab1-45d8-bcca-a85cef6e2998 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:47.903384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15202318-ffa5-4ebd-8b50-83eaa7dd1489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:47.904195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15202318-ffa5-4ebd-8b50-83eaa7dd1489 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:47.904566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15202318-ffa5-4ebd-8b50-83eaa7dd1489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:47.904855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15202318-ffa5-4ebd-8b50-83eaa7dd1489 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:47.905635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15202318-ffa5-4ebd-8b50-83eaa7dd1489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:47.908384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15202318-ffa5-4ebd-8b50-83eaa7dd1489 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:47.937553 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1079/2142] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:47 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:26:47.942381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb8c86-d11b-467a-bc70-a18aee9d60c5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:47.957699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb8c86-d11b-467a-bc70-a18aee9d60c5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:47.964130 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15202318-ffa5-4ebd-8b50-83eaa7dd1489 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:47.966800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988b1f6-caff-4ff9-aafa-37185a8336fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:47.967205 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-15202318-ffa5-4ebd-8b50-83eaa7dd1489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:47.967759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988b1f6-caff-4ff9-aafa-37185a8336fa admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:47.968358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988b1f6-caff-4ff9-aafa-37185a8336fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:47.968576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988b1f6-caff-4ff9-aafa-37185a8336fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:47.970479 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988b1f6-caff-4ff9-aafa-37185a8336fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:47.976985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988b1f6-caff-4ff9-aafa-37185a8336fa admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:47.993406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15202318-ffa5-4ebd-8b50-83eaa7dd1489 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:48.010291 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:48.011194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:48.011484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:48.011767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de admin admin] PATH_INFO: `/v3/projects/8eddb83193fd4823bd50494a565e1cee` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:48.012310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1064/2143] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:48.016231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988b1f6-caff-4ff9-aafa-37185a8336fa admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:48.018293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eddb83193fd4823bd50494a565e1cee)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:48.023432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:48.042065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988b1f6-caff-4ff9-aafa-37185a8336fa admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:48.047876 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15c7ad-f0ff-4242-a5bf-30e7723538a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:48.048551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15c7ad-f0ff-4242-a5bf-30e7723538a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:48.048835 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15c7ad-f0ff-4242-a5bf-30e7723538a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:48.049166 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15c7ad-f0ff-4242-a5bf-30e7723538a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:48.050093 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15c7ad-f0ff-4242-a5bf-30e7723538a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:48.051727 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15c7ad-f0ff-4242-a5bf-30e7723538a6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:48.071943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1065/2144] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:48.079504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15c7ad-f0ff-4242-a5bf-30e7723538a6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:48.106513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15c7ad-f0ff-4242-a5bf-30e7723538a6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:48.118469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eddb83193fd4823bd50494a565e1cee', 'request_id': 'req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:48.128507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eddb83193fd4823bd50494a565e1cee', 'request_id': 'req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:48.140183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eddb83193fd4823bd50494a565e1cee', 'request_id': 'req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:48.155745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de admin admin] The token cache is being invalidate because project 8eddb83193fd4823bd50494a565e1cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:48.156169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:48.157476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-aa6bb858-5c9c-4448-ba04-a4d6a27c37de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:48.167340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1080/2145] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:47 2022] DELETE /identity/v3/projects/8eddb83193fd4823bd50494a565e1cee => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:48.170405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c18ea-2935-4ab8-803e-7274c9864d8d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:48.170754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c18ea-2935-4ab8-803e-7274c9864d8d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:48.171255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c18ea-2935-4ab8-803e-7274c9864d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:48.225458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c87c18ea-2935-4ab8-803e-7274c9864d8d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:48.232198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c87c18ea-2935-4ab8-803e-7274c9864d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:48.261035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba4cc-b8ed-4cc4-ba33-f5fa34990837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:48.263632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba4cc-b8ed-4cc4-ba33-f5fa34990837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:48.263933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba4cc-b8ed-4cc4-ba33-f5fa34990837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:48.264248 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba4cc-b8ed-4cc4-ba33-f5fa34990837 admin admin] PATH_INFO: `/v3/projects/0fc2a3f18be8494397e19521c8e808f8/users/b262e4e4d19d40f4b89ab79547783658/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:48.317382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba4cc-b8ed-4cc4-ba33-f5fa34990837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc2a3f18be8494397e19521c8e808f8, user_id=b262e4e4d19d40f4b89ab79547783658, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:48.328195 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba4cc-b8ed-4cc4-ba33-f5fa34990837 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:48.362011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1066/2146] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:48 2022] PUT /identity/v3/projects/0fc2a3f18be8494397e19521c8e808f8/users/b262e4e4d19d40f4b89ab79547783658/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:48.370009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523fa9-79c1-4761-8af8-e9a17f95814a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:48.372284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523fa9-79c1-4761-8af8-e9a17f95814a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:48.372617 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523fa9-79c1-4761-8af8-e9a17f95814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:48.404766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:48.425714 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ed523fa9-79c1-4761-8af8-e9a17f95814a None None] MFA Rules not processed for user `b262e4e4d19d40f4b89ab79547783658`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:48.427041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ed523fa9-79c1-4761-8af8-e9a17f95814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:48.427223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1081/2147] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:48.440278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38f362-1049-4e9b-9daf-bd2b34d2565e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:48.440692 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38f362-1049-4e9b-9daf-bd2b34d2565e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:48.441034 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38f362-1049-4e9b-9daf-bd2b34d2565e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:48.465631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6b38f362-1049-4e9b-9daf-bd2b34d2565e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:48.466970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6b38f362-1049-4e9b-9daf-bd2b34d2565e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:48.473907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:48.581781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1067/2148] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:48.586230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523fa9-79c1-4761-8af8-e9a17f95814a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:48.589260 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ed523fa9-79c1-4761-8af8-e9a17f95814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:48.599628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1082/2149] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:26:48.600694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38f362-1049-4e9b-9daf-bd2b34d2565e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:48.612311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38f362-1049-4e9b-9daf-bd2b34d2565e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:48.617148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523fa9-79c1-4761-8af8-e9a17f95814a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:48.628524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c092ba-6f47-4471-bce1-864e8dbac014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:48.629004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43429b-272a-4046-8b73-433ec4ee06fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:48.629347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c092ba-6f47-4471-bce1-864e8dbac014 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:48.629640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c092ba-6f47-4471-bce1-864e8dbac014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:48.629924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c092ba-6f47-4471-bce1-864e8dbac014 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:48.630394 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43429b-272a-4046-8b73-433ec4ee06fc admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:48.631073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c092ba-6f47-4471-bce1-864e8dbac014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:48.631239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43429b-272a-4046-8b73-433ec4ee06fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:48.631382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c092ba-6f47-4471-bce1-864e8dbac014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:48.631673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43429b-272a-4046-8b73-433ec4ee06fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:48.632882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43429b-272a-4046-8b73-433ec4ee06fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:48.633188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c092ba-6f47-4471-bce1-864e8dbac014 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:48.636741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43429b-272a-4046-8b73-433ec4ee06fc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:48.649113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1083/2150] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:48.654386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c092ba-6f47-4471-bce1-864e8dbac014 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:48.667778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c092ba-6f47-4471-bce1-864e8dbac014 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:48.680942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2670f-6d18-4029-814b-02e6d1f693ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:48.682139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2670f-6d18-4029-814b-02e6d1f693ed admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:48.682139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2670f-6d18-4029-814b-02e6d1f693ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:48.682396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2670f-6d18-4029-814b-02e6d1f693ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:48.683242 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2670f-6d18-4029-814b-02e6d1f693ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:48.686697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2670f-6d18-4029-814b-02e6d1f693ed admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:48.692385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1068/2151] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:48 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:48.696295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43429b-272a-4046-8b73-433ec4ee06fc admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:48.746247 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1084/2152] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:48 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:48.747451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2670f-6d18-4029-814b-02e6d1f693ed admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:48.842156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43429b-272a-4046-8b73-433ec4ee06fc admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:48.859040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2670f-6d18-4029-814b-02e6d1f693ed admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:48.864661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff73ecf-1e63-407b-9034-0cecf574a077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:48.865409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73ecf-1e63-407b-9034-0cecf574a077 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:48.865698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73ecf-1e63-407b-9034-0cecf574a077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:48.865998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73ecf-1e63-407b-9034-0cecf574a077 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:48.866836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff73ecf-1e63-407b-9034-0cecf574a077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:48.868820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff73ecf-1e63-407b-9034-0cecf574a077 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:48.895534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1085/2153] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:48 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:26:48.903951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff73ecf-1e63-407b-9034-0cecf574a077 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:48.919506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff73ecf-1e63-407b-9034-0cecf574a077 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:48.926713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597381a-e33d-46c5-be98-91c088ed9ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:48.927453 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597381a-e33d-46c5-be98-91c088ed9ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:48.927961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597381a-e33d-46c5-be98-91c088ed9ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:48.928248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597381a-e33d-46c5-be98-91c088ed9ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:48.929261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597381a-e33d-46c5-be98-91c088ed9ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:48.931041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597381a-e33d-46c5-be98-91c088ed9ffa admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:48.961762 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1086/2154] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:48.966552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597381a-e33d-46c5-be98-91c088ed9ffa admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:48.980876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597381a-e33d-46c5-be98-91c088ed9ffa admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:48.994501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b168eb-be6f-4c91-8a3a-5b29b883bce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:48.996885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b168eb-be6f-4c91-8a3a-5b29b883bce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:48.997726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b168eb-be6f-4c91-8a3a-5b29b883bce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:48.998713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b168eb-be6f-4c91-8a3a-5b29b883bce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.000386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b168eb-be6f-4c91-8a3a-5b29b883bce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:49.008583 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b168eb-be6f-4c91-8a3a-5b29b883bce9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:49.027231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4887cdb-4158-4f36-b998-801255b1767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:49.028377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4887cdb-4158-4f36-b998-801255b1767b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:49.028840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4887cdb-4158-4f36-b998-801255b1767b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:49.029405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4887cdb-4158-4f36-b998-801255b1767b admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.030643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4887cdb-4158-4f36-b998-801255b1767b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:49.034521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4887cdb-4158-4f36-b998-801255b1767b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:49.040139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1087/2155] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:49.044537 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b168eb-be6f-4c91-8a3a-5b29b883bce9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:49.059393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b168eb-be6f-4c91-8a3a-5b29b883bce9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:49.065091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eef538-9bdb-4a43-9cad-c51d3143ebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:49.066121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eef538-9bdb-4a43-9cad-c51d3143ebc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:49.066433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eef538-9bdb-4a43-9cad-c51d3143ebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:49.066677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eef538-9bdb-4a43-9cad-c51d3143ebc5 admin admin] PATH_INFO: `/v3/projects/b5090dad094a419cb6f3652115b73648/users/d28f43fd41a64be2a5a04593af7da11b/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.070092 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1069/2156] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:48 2022] POST /identity/v3/users => generated 293 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:49.076101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4887cdb-4158-4f36-b998-801255b1767b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:49.086388 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eef538-9bdb-4a43-9cad-c51d3143ebc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5090dad094a419cb6f3652115b73648, user_id=d28f43fd41a64be2a5a04593af7da11b, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:49.086831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4887cdb-4158-4f36-b998-801255b1767b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:49.090166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eef538-9bdb-4a43-9cad-c51d3143ebc5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:49.092120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dca0c2-939d-496f-a592-c1b7e30f2631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:49.092934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dca0c2-939d-496f-a592-c1b7e30f2631 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:49.093263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dca0c2-939d-496f-a592-c1b7e30f2631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:49.093573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dca0c2-939d-496f-a592-c1b7e30f2631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.094293 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dca0c2-939d-496f-a592-c1b7e30f2631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:49.096081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dca0c2-939d-496f-a592-c1b7e30f2631 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:49.110138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1088/2157] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:49 2022] PUT /identity/v3/projects/b5090dad094a419cb6f3652115b73648/users/d28f43fd41a64be2a5a04593af7da11b/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:49.114065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1070/2158] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:49.118240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eef538-9bdb-4a43-9cad-c51d3143ebc5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:49.123165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845922-9c8f-43e1-a6ba-c97d33d71690 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:49.123634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845922-9c8f-43e1-a6ba-c97d33d71690 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:49.123958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845922-9c8f-43e1-a6ba-c97d33d71690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.125031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:49.160583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-98845922-9c8f-43e1-a6ba-c97d33d71690 None None] MFA Rules not processed for user `d28f43fd41a64be2a5a04593af7da11b`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:49.162487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-98845922-9c8f-43e1-a6ba-c97d33d71690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:49.188990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:49.192456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eef538-9bdb-4a43-9cad-c51d3143ebc5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:49.198140 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161daa1-743a-453c-9058-488e9fb2370e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:49.198839 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161daa1-743a-453c-9058-488e9fb2370e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:49.199133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161daa1-743a-453c-9058-488e9fb2370e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:49.199417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161daa1-743a-453c-9058-488e9fb2370e admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.200190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161daa1-743a-453c-9058-488e9fb2370e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:49.201952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161daa1-743a-453c-9058-488e9fb2370e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:49.218596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1089/2159] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:49.220077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161daa1-743a-453c-9058-488e9fb2370e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:49.231060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161daa1-743a-453c-9058-488e9fb2370e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:49.236567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c98e2-7c24-478f-bc43-30aef22b1284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:49.237488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c98e2-7c24-478f-bc43-30aef22b1284 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:49.237773 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c98e2-7c24-478f-bc43-30aef22b1284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:49.238052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c98e2-7c24-478f-bc43-30aef22b1284 admin admin] PATH_INFO: `/v3/projects/968687be13734188a3cf0e11b325d7ef/users/f181334bdc754706bfebdc5a62b913de/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.244391 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1071/2160] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:26:49.256691 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c98e2-7c24-478f-bc43-30aef22b1284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=968687be13734188a3cf0e11b325d7ef, user_id=f181334bdc754706bfebdc5a62b913de, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:49.257853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845922-9c8f-43e1-a6ba-c97d33d71690 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:49.259708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c98e2-7c24-478f-bc43-30aef22b1284 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:49.261678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-98845922-9c8f-43e1-a6ba-c97d33d71690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:49.276447 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1090/2161] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:49 2022] PUT /identity/v3/projects/968687be13734188a3cf0e11b325d7ef/users/f181334bdc754706bfebdc5a62b913de/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:49.290799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b944d-87c4-4504-aa1c-7f0aa7ef5581 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:49.291103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b944d-87c4-4504-aa1c-7f0aa7ef5581 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:49.291380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b944d-87c4-4504-aa1c-7f0aa7ef5581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.320800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-733b944d-87c4-4504-aa1c-7f0aa7ef5581 None None] MFA Rules not processed for user `f181334bdc754706bfebdc5a62b913de`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:49.322247 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-733b944d-87c4-4504-aa1c-7f0aa7ef5581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:49.338700 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845922-9c8f-43e1-a6ba-c97d33d71690 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:49.420144 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f2d85-84dd-4e6d-8bd4-fe49011a5dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:49.421051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2d85-84dd-4e6d-8bd4-fe49011a5dae service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:49.421417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2d85-84dd-4e6d-8bd4-fe49011a5dae service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:49.421861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f2d85-84dd-4e6d-8bd4-fe49011a5dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.434039 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1091/2162] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:49.439863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b944d-87c4-4504-aa1c-7f0aa7ef5581 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:49.515082 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f2d85-84dd-4e6d-8bd4-fe49011a5dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:49.516898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f2d85-84dd-4e6d-8bd4-fe49011a5dae service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:49.525367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b944d-87c4-4504-aa1c-7f0aa7ef5581 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:49.527014 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1072/2163] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:49.530836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c680757-d235-416e-bacf-1a2f99a042a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:49.531406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c680757-d235-416e-bacf-1a2f99a042a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:49.531695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c680757-d235-416e-bacf-1a2f99a042a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:49.531978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c680757-d235-416e-bacf-1a2f99a042a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.532901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c680757-d235-416e-bacf-1a2f99a042a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:49.535240 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c680757-d235-416e-bacf-1a2f99a042a9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:49.556167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:49.580049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1092/2164] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:49 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:49.584021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f2d85-84dd-4e6d-8bd4-fe49011a5dae service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:49.614463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f2d85-84dd-4e6d-8bd4-fe49011a5dae service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:49.663749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:49.721259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cf744-7c7e-425c-92df-3ae7844fa722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:49.723150 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cf744-7c7e-425c-92df-3ae7844fa722 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:49.723961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cf744-7c7e-425c-92df-3ae7844fa722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:49.725157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cf744-7c7e-425c-92df-3ae7844fa722 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.729608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cf744-7c7e-425c-92df-3ae7844fa722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:49.734247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cf744-7c7e-425c-92df-3ae7844fa722 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:49.769101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1073/2165] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:49 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:49.773307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c680757-d235-416e-bacf-1a2f99a042a9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:49.794559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c680757-d235-416e-bacf-1a2f99a042a9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:49.801450 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5655a-9893-4c10-9a1a-cf6102f40722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:49.802329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5655a-9893-4c10-9a1a-cf6102f40722 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:49.802806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5655a-9893-4c10-9a1a-cf6102f40722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:49.803313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5655a-9893-4c10-9a1a-cf6102f40722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.804243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5655a-9893-4c10-9a1a-cf6102f40722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:49.805999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5655a-9893-4c10-9a1a-cf6102f40722 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:49.827463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1093/2166] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:49.828860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cf744-7c7e-425c-92df-3ae7844fa722 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:49.845547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cf744-7c7e-425c-92df-3ae7844fa722 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:49.851842 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f26dd7-d08b-4600-a722-03428234606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:49.853085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f26dd7-d08b-4600-a722-03428234606a admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:49.853673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f26dd7-d08b-4600-a722-03428234606a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:49.853854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f26dd7-d08b-4600-a722-03428234606a admin admin] PATH_INFO: `/v3/projects/bdd3aa9bb0bd44f49c3356985ef8d3db/users/974a2bde499f4724a036e7cbcf24c82c/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:49.881898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f26dd7-d08b-4600-a722-03428234606a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd3aa9bb0bd44f49c3356985ef8d3db, user_id=974a2bde499f4724a036e7cbcf24c82c, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:49.887854 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f26dd7-d08b-4600-a722-03428234606a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:49.911429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1074/2167] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:49 2022] PUT /identity/v3/projects/bdd3aa9bb0bd44f49c3356985ef8d3db/users/974a2bde499f4724a036e7cbcf24c82c/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:49.917641 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5655a-9893-4c10-9a1a-cf6102f40722 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:49.933345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5655a-9893-4c10-9a1a-cf6102f40722 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:50.035459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672d4a1-131d-44ea-9a23-ae76a20ac167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:50.036152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672d4a1-131d-44ea-9a23-ae76a20ac167 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:50.036441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672d4a1-131d-44ea-9a23-ae76a20ac167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:50.036745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672d4a1-131d-44ea-9a23-ae76a20ac167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:50.038636 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672d4a1-131d-44ea-9a23-ae76a20ac167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:50.040868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672d4a1-131d-44ea-9a23-ae76a20ac167 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:50.064157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1094/2168] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:50.065452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f26dd7-d08b-4600-a722-03428234606a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:50.078199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f26dd7-d08b-4600-a722-03428234606a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:50.087987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2487c8f-2087-4f76-80e0-8ddb2459f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:50.089275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2487c8f-2087-4f76-80e0-8ddb2459f5fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:50.089735 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2487c8f-2087-4f76-80e0-8ddb2459f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:50.090008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2487c8f-2087-4f76-80e0-8ddb2459f5fb admin admin] PATH_INFO: `/v3/projects/bdd3aa9bb0bd44f49c3356985ef8d3db/users/974a2bde499f4724a036e7cbcf24c82c/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:50.092563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2487c8f-2087-4f76-80e0-8ddb2459f5fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd3aa9bb0bd44f49c3356985ef8d3db, user_id=974a2bde499f4724a036e7cbcf24c82c, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:50.095822 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2487c8f-2087-4f76-80e0-8ddb2459f5fb admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:50.110963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1075/2169] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:50 2022] PUT /identity/v3/projects/bdd3aa9bb0bd44f49c3356985ef8d3db/users/974a2bde499f4724a036e7cbcf24c82c/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:50.123716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddcf1e-87d2-4861-a008-71caa70c8e45 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:50.124248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddcf1e-87d2-4861-a008-71caa70c8e45 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:50.124605 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddcf1e-87d2-4861-a008-71caa70c8e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:50.162486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b3ddcf1e-87d2-4861-a008-71caa70c8e45 None None] MFA Rules not processed for user `974a2bde499f4724a036e7cbcf24c82c`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:50.164534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b3ddcf1e-87d2-4861-a008-71caa70c8e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:50.249031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1095/2170] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:50.268874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2487c8f-2087-4f76-80e0-8ddb2459f5fb admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:50.339356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2487c8f-2087-4f76-80e0-8ddb2459f5fb admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:50.342445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e88f-537d-4a98-ab40-d6e192d06c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:50.345190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e88f-537d-4a98-ab40-d6e192d06c84 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:50.345190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e88f-537d-4a98-ab40-d6e192d06c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:50.345190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e88f-537d-4a98-ab40-d6e192d06c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:50.431555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6e88f-537d-4a98-ab40-d6e192d06c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:50.433121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6e88f-537d-4a98-ab40-d6e192d06c84 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:50.444123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1076/2171] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:52.133340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddcf1e-87d2-4861-a008-71caa70c8e45 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:52.144683 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddcf1e-87d2-4861-a008-71caa70c8e45 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:52.148643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddb41b-8777-475f-80dd-c16c73a56130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:52.149426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddb41b-8777-475f-80dd-c16c73a56130 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:52.149776 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddb41b-8777-475f-80dd-c16c73a56130 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:52.150156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddb41b-8777-475f-80dd-c16c73a56130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:52.211367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddb41b-8777-475f-80dd-c16c73a56130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:52.213006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddb41b-8777-475f-80dd-c16c73a56130 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:52.219035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:52.224644 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1096/2172] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:52.360452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e88f-537d-4a98-ab40-d6e192d06c84 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:52.414077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:52.442764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e88f-537d-4a98-ab40-d6e192d06c84 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:52.448542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:52.449469 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:52.449753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:52.450031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] PATH_INFO: `/v3/users/d28f43fd41a64be2a5a04593af7da11b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:52.451702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28f43fd41a64be2a5a04593af7da11b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:52.453203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:52.523302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28f43fd41a64be2a5a04593af7da11b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:52.572709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28f43fd41a64be2a5a04593af7da11b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:52.601831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28f43fd41a64be2a5a04593af7da11b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:52.614708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28f43fd41a64be2a5a04593af7da11b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:52.617229 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28f43fd41a64be2a5a04593af7da11b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:52.631821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1077/2173] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:52 2022] DELETE /identity/v3/users/d28f43fd41a64be2a5a04593af7da11b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:52.635526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f29900-e7d8-4fdb-a0b0-6e1d74d26f66 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:52.635824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f29900-e7d8-4fdb-a0b0-6e1d74d26f66 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:52.636106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f29900-e7d8-4fdb-a0b0-6e1d74d26f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:52.667449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-50f29900-e7d8-4fdb-a0b0-6e1d74d26f66 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:52.669036 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-50f29900-e7d8-4fdb-a0b0-6e1d74d26f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:52.712829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:52.715430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:52.780173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1097/2174] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:52.790194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f29900-e7d8-4fdb-a0b0-6e1d74d26f66 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:52.793153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-50f29900-e7d8-4fdb-a0b0-6e1d74d26f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:52.846669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81497657-16e5-416c-9df5-b13ff968fd7a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:52.852578 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31728ff8-752b-462a-9692-b3e24cf1fffe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:52.853309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31728ff8-752b-462a-9692-b3e24cf1fffe service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:52.855440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31728ff8-752b-462a-9692-b3e24cf1fffe service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:52.855678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31728ff8-752b-462a-9692-b3e24cf1fffe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:52.857825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-31728ff8-752b-462a-9692-b3e24cf1fffe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:52.926411 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f29900-e7d8-4fdb-a0b0-6e1d74d26f66 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:52.930509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a525-c8ee-4896-9327-0a9a98f876fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:52.931213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a525-c8ee-4896-9327-0a9a98f876fb service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:52.931520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a525-c8ee-4896-9327-0a9a98f876fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:52.932203 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a525-c8ee-4896-9327-0a9a98f876fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:52.952514 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21a525-c8ee-4896-9327-0a9a98f876fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:52.955121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21a525-c8ee-4896-9327-0a9a98f876fb service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:52.973577 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1098/2175] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:52.994297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31728ff8-752b-462a-9692-b3e24cf1fffe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:52.996112 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31728ff8-752b-462a-9692-b3e24cf1fffe service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:53.023720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1078/2176] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:53.152867 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a525-c8ee-4896-9327-0a9a98f876fb service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:53.155153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3d21a525-c8ee-4896-9327-0a9a98f876fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:53.178686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a525-c8ee-4896-9327-0a9a98f876fb service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:53.191230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ede0d8-e8b1-4e3c-875b-bb7e0c0e90e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:53.192193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ede0d8-e8b1-4e3c-875b-bb7e0c0e90e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:53.192630 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ede0d8-e8b1-4e3c-875b-bb7e0c0e90e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:53.193111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ede0d8-e8b1-4e3c-875b-bb7e0c0e90e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:53.200702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f0ede0d8-e8b1-4e3c-875b-bb7e0c0e90e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:53.379863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ede0d8-e8b1-4e3c-875b-bb7e0c0e90e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:53.388764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ede0d8-e8b1-4e3c-875b-bb7e0c0e90e7 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:53.411173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1099/2177] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:53.558747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31728ff8-752b-462a-9692-b3e24cf1fffe service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:53.562737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-31728ff8-752b-462a-9692-b3e24cf1fffe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:53.594341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31728ff8-752b-462a-9692-b3e24cf1fffe service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:53.603090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc78b2-2ecc-4414-b300-8e83d063f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:53.603949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc78b2-2ecc-4414-b300-8e83d063f949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:53.604542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc78b2-2ecc-4414-b300-8e83d063f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:53.604660 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc78b2-2ecc-4414-b300-8e83d063f949 admin admin] PATH_INFO: `/v3/projects/b5090dad094a419cb6f3652115b73648` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:53.606326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc78b2-2ecc-4414-b300-8e83d063f949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5090dad094a419cb6f3652115b73648)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:53.608547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc78b2-2ecc-4414-b300-8e83d063f949 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:53.612069 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:53.736298 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fdfc78b2-2ecc-4414-b300-8e83d063f949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5090dad094a419cb6f3652115b73648', 'request_id': 'req-fdfc78b2-2ecc-4414-b300-8e83d063f949'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:53.746065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fdfc78b2-2ecc-4414-b300-8e83d063f949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5090dad094a419cb6f3652115b73648', 'request_id': 'req-fdfc78b2-2ecc-4414-b300-8e83d063f949'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:53.758355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fdfc78b2-2ecc-4414-b300-8e83d063f949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5090dad094a419cb6f3652115b73648', 'request_id': 'req-fdfc78b2-2ecc-4414-b300-8e83d063f949'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:53.773736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fdfc78b2-2ecc-4414-b300-8e83d063f949 admin admin] The token cache is being invalidate because project b5090dad094a419cb6f3652115b73648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:53.774315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fdfc78b2-2ecc-4414-b300-8e83d063f949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:53.775149 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fdfc78b2-2ecc-4414-b300-8e83d063f949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:53.777179 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1079/2178] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:53 2022] DELETE /identity/v3/projects/b5090dad094a419cb6f3652115b73648 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:53.784175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18bf70-ae1e-4731-b131-d2b72d4da105 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:53.784720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18bf70-ae1e-4731-b131-d2b72d4da105 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:53.785200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18bf70-ae1e-4731-b131-d2b72d4da105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:53.807313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5a18bf70-ae1e-4731-b131-d2b72d4da105 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:53.808679 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5a18bf70-ae1e-4731-b131-d2b72d4da105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:53.849005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:53.896942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1100/2179] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:53.906719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1637d1c-fa5c-456b-b37f-45ef0f6ba47f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:53.907450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1637d1c-fa5c-456b-b37f-45ef0f6ba47f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:53.908006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1637d1c-fa5c-456b-b37f-45ef0f6ba47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:53.931065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e1637d1c-fa5c-456b-b37f-45ef0f6ba47f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:53.932334 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e1637d1c-fa5c-456b-b37f-45ef0f6ba47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:53.941149 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1080/2180] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:53.946543 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18bf70-ae1e-4731-b131-d2b72d4da105 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:53.959627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18bf70-ae1e-4731-b131-d2b72d4da105 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:53.967204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bb7ec-4f39-4dfd-a609-19025b7037cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:53.968231 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bb7ec-4f39-4dfd-a609-19025b7037cb admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:53.968735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bb7ec-4f39-4dfd-a609-19025b7037cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:53.969373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bb7ec-4f39-4dfd-a609-19025b7037cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:53.970334 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bb7ec-4f39-4dfd-a609-19025b7037cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:53.970808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bb7ec-4f39-4dfd-a609-19025b7037cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:53.972630 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bb7ec-4f39-4dfd-a609-19025b7037cb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:53.991387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1101/2181] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:53.992674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1637d1c-fa5c-456b-b37f-45ef0f6ba47f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:54.002479 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1637d1c-fa5c-456b-b37f-45ef0f6ba47f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:54.008642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123921-ff46-44da-8d61-9e88e6904bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:54.009809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123921-ff46-44da-8d61-9e88e6904bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:54.010476 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123921-ff46-44da-8d61-9e88e6904bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:54.010476 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123921-ff46-44da-8d61-9e88e6904bb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:54.011239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123921-ff46-44da-8d61-9e88e6904bb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:54.013346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123921-ff46-44da-8d61-9e88e6904bb2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:54.049343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1081/2182] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:53 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:54.053289 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bb7ec-4f39-4dfd-a609-19025b7037cb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:54.070466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bb7ec-4f39-4dfd-a609-19025b7037cb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:54.140608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c667f-dc41-46e9-b4b3-22af9860e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:54.141621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c667f-dc41-46e9-b4b3-22af9860e1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:54.142068 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c667f-dc41-46e9-b4b3-22af9860e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:54.142352 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c667f-dc41-46e9-b4b3-22af9860e1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:54.143059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c667f-dc41-46e9-b4b3-22af9860e1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:54.145098 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c667f-dc41-46e9-b4b3-22af9860e1a0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:54.174030 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1102/2183] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:54 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:54.175713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123921-ff46-44da-8d61-9e88e6904bb2 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:54.191976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123921-ff46-44da-8d61-9e88e6904bb2 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:54.199777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65dc03-a77e-4edb-aa6c-e3a2e3bf2980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:54.200865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65dc03-a77e-4edb-aa6c-e3a2e3bf2980 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:54.201281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65dc03-a77e-4edb-aa6c-e3a2e3bf2980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:54.201804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65dc03-a77e-4edb-aa6c-e3a2e3bf2980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:54.202857 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65dc03-a77e-4edb-aa6c-e3a2e3bf2980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:54.204592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65dc03-a77e-4edb-aa6c-e3a2e3bf2980 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:54.223294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1082/2184] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:54.225008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c667f-dc41-46e9-b4b3-22af9860e1a0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:54.235932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c667f-dc41-46e9-b4b3-22af9860e1a0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:54.241133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08f2b8-605d-4fa3-8c24-d190b1718803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:54.242478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08f2b8-605d-4fa3-8c24-d190b1718803 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:54.242774 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08f2b8-605d-4fa3-8c24-d190b1718803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:54.243574 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08f2b8-605d-4fa3-8c24-d190b1718803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:54.244339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08f2b8-605d-4fa3-8c24-d190b1718803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:54.246375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08f2b8-605d-4fa3-8c24-d190b1718803 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:54.259341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1103/2185] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:54.263899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65dc03-a77e-4edb-aa6c-e3a2e3bf2980 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:54.282817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65dc03-a77e-4edb-aa6c-e3a2e3bf2980 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:54.289977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce40b3-752f-4f20-9adb-3a36e92ae027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:54.291539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce40b3-752f-4f20-9adb-3a36e92ae027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:54.292114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce40b3-752f-4f20-9adb-3a36e92ae027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:54.292702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce40b3-752f-4f20-9adb-3a36e92ae027 admin admin] PATH_INFO: `/v3/projects/010c7de454ac4a04a92e73c104962a55/users/6a6e163772a64a708bf5863dacaf0633/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:54.321413 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce40b3-752f-4f20-9adb-3a36e92ae027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=010c7de454ac4a04a92e73c104962a55, user_id=6a6e163772a64a708bf5863dacaf0633, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:54.326908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce40b3-752f-4f20-9adb-3a36e92ae027 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:54.348136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1083/2186] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:54 2022] PUT /identity/v3/projects/010c7de454ac4a04a92e73c104962a55/users/6a6e163772a64a708bf5863dacaf0633/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:54.366784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da489-494a-46fb-9110-cbda8e40236e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:54.367616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da489-494a-46fb-9110-cbda8e40236e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:54.368089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da489-494a-46fb-9110-cbda8e40236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:54.414886 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-bb2da489-494a-46fb-9110-cbda8e40236e None None] MFA Rules not processed for user `6a6e163772a64a708bf5863dacaf0633`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:54.416121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bb2da489-494a-46fb-9110-cbda8e40236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:54.494053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1104/2187] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:54.508243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce40b3-752f-4f20-9adb-3a36e92ae027 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:54.510178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f3ce40b3-752f-4f20-9adb-3a36e92ae027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:54.631315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce40b3-752f-4f20-9adb-3a36e92ae027 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:54.637910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27d901-c769-4fb5-884e-0006e057aa26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:54.637910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27d901-c769-4fb5-884e-0006e057aa26 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:54.637910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27d901-c769-4fb5-884e-0006e057aa26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:54.638285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27d901-c769-4fb5-884e-0006e057aa26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:54.650165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27d901-c769-4fb5-884e-0006e057aa26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:54.651964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27d901-c769-4fb5-884e-0006e057aa26 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:54.681189 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1084/2188] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:54.707883 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2da489-494a-46fb-9110-cbda8e40236e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:54.786477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:54.874610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2da489-494a-46fb-9110-cbda8e40236e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:54.917277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:54.920633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:54.921182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:54.922382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] PATH_INFO: `/v3/users/6a6e163772a64a708bf5863dacaf0633` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:54.927129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6e163772a64a708bf5863dacaf0633)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:54.933805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:55.080091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6e163772a64a708bf5863dacaf0633'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:55.126181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6e163772a64a708bf5863dacaf0633'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:55.160562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6e163772a64a708bf5863dacaf0633'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:55.176534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6e163772a64a708bf5863dacaf0633'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:55.181084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6e163772a64a708bf5863dacaf0633'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:55.207166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1105/2189] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:54 2022] DELETE /identity/v3/users/6a6e163772a64a708bf5863dacaf0633 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:55.212841 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0f504-0418-4556-b893-45ebe02dbf6b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:55.213462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0f504-0418-4556-b893-45ebe02dbf6b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:55.213857 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0f504-0418-4556-b893-45ebe02dbf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:55.248689 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6ef0f504-0418-4556-b893-45ebe02dbf6b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:55.252461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6ef0f504-0418-4556-b893-45ebe02dbf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:55.357102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:55.429948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1085/2190] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:55.442649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:55.444293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:55.541585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f157c0-9485-4211-805b-8cbd02b4335c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:55.545545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208797-530e-421f-867d-16329bc79551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:55.546388 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208797-530e-421f-867d-16329bc79551 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:55.546933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208797-530e-421f-867d-16329bc79551 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:55.547319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208797-530e-421f-867d-16329bc79551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:55.558766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9208797-530e-421f-867d-16329bc79551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:55.560958 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9208797-530e-421f-867d-16329bc79551 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:55.577277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1106/2191] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:55.797550 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0f504-0418-4556-b893-45ebe02dbf6b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:55.799075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6ef0f504-0418-4556-b893-45ebe02dbf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:55.816480 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0f504-0418-4556-b893-45ebe02dbf6b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:55.829955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:55.830945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:55.831237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:55.831632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] PATH_INFO: `/v3/users/29b465d5c26f4071a88eb65d73edac2f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:55.832969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b465d5c26f4071a88eb65d73edac2f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:55.836074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:55.906438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b465d5c26f4071a88eb65d73edac2f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:55.926028 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b465d5c26f4071a88eb65d73edac2f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:55.939586 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b465d5c26f4071a88eb65d73edac2f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:55.947916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b465d5c26f4071a88eb65d73edac2f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:55.948777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b465d5c26f4071a88eb65d73edac2f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:55.959511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1086/2192] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:55 2022] DELETE /identity/v3/users/29b465d5c26f4071a88eb65d73edac2f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:56.011058 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208797-530e-421f-867d-16329bc79551 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:56.012853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c9208797-530e-421f-867d-16329bc79551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:56.048502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208797-530e-421f-867d-16329bc79551 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:56.119380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:56.130464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe53be-0dc5-45fa-8eec-32482054dd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:56.131625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe53be-0dc5-45fa-8eec-32482054dd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.132103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe53be-0dc5-45fa-8eec-32482054dd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.132389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe53be-0dc5-45fa-8eec-32482054dd9a admin admin] PATH_INFO: `/v3/projects/010c7de454ac4a04a92e73c104962a55` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.134090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe53be-0dc5-45fa-8eec-32482054dd9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=010c7de454ac4a04a92e73c104962a55)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:56.136796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe53be-0dc5-45fa-8eec-32482054dd9a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:56.196252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d5fe53be-0dc5-45fa-8eec-32482054dd9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '010c7de454ac4a04a92e73c104962a55', 'request_id': 'req-d5fe53be-0dc5-45fa-8eec-32482054dd9a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:56.199763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:56.201599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:56.220620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d5fe53be-0dc5-45fa-8eec-32482054dd9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '010c7de454ac4a04a92e73c104962a55', 'request_id': 'req-d5fe53be-0dc5-45fa-8eec-32482054dd9a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:56.229696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d5fe53be-0dc5-45fa-8eec-32482054dd9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '010c7de454ac4a04a92e73c104962a55', 'request_id': 'req-d5fe53be-0dc5-45fa-8eec-32482054dd9a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:56.231275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68dfde-808e-41c1-b294-f4a084758cc8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:56.243060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d5fe53be-0dc5-45fa-8eec-32482054dd9a admin admin] The token cache is being invalidate because project 010c7de454ac4a04a92e73c104962a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:56.243498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d5fe53be-0dc5-45fa-8eec-32482054dd9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:56.244488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d5fe53be-0dc5-45fa-8eec-32482054dd9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:56.246614 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1107/2193] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:56 2022] DELETE /identity/v3/projects/010c7de454ac4a04a92e73c104962a55 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:56.252546 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf54da7-589c-4fac-bbc6-96fb6b708ae2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.253102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf54da7-589c-4fac-bbc6-96fb6b708ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.253686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf54da7-589c-4fac-bbc6-96fb6b708ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.275827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6bf54da7-589c-4fac-bbc6-96fb6b708ae2 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:56.279090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6bf54da7-589c-4fac-bbc6-96fb6b708ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:56.312800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5bc8f-f228-4af2-b58a-af1f612a807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:56.314002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5bc8f-f228-4af2-b58a-af1f612a807e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.314288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5bc8f-f228-4af2-b58a-af1f612a807e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.314735 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5bc8f-f228-4af2-b58a-af1f612a807e admin admin] PATH_INFO: `/v3/projects/4b94dc2b731a47408e97fef37b3770c6` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.315980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5bc8f-f228-4af2-b58a-af1f612a807e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b94dc2b731a47408e97fef37b3770c6)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:56.318637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5bc8f-f228-4af2-b58a-af1f612a807e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:56.350165 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1108/2194] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:56.358839 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad1ed5-cbda-40a2-87c3-f5384748f16c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.359140 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad1ed5-cbda-40a2-87c3-f5384748f16c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.359429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad1ed5-cbda-40a2-87c3-f5384748f16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.373003 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:56.376506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1fa5bc8f-f228-4af2-b58a-af1f612a807e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b94dc2b731a47408e97fef37b3770c6', 'request_id': 'req-1fa5bc8f-f228-4af2-b58a-af1f612a807e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:56.378749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5bad1ed5-cbda-40a2-87c3-f5384748f16c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:56.380043 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5bad1ed5-cbda-40a2-87c3-f5384748f16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:56.386472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1fa5bc8f-f228-4af2-b58a-af1f612a807e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b94dc2b731a47408e97fef37b3770c6', 'request_id': 'req-1fa5bc8f-f228-4af2-b58a-af1f612a807e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:56.394151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1fa5bc8f-f228-4af2-b58a-af1f612a807e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b94dc2b731a47408e97fef37b3770c6', 'request_id': 'req-1fa5bc8f-f228-4af2-b58a-af1f612a807e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:56.407285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1fa5bc8f-f228-4af2-b58a-af1f612a807e admin admin] The token cache is being invalidate because project 4b94dc2b731a47408e97fef37b3770c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:56.407939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1fa5bc8f-f228-4af2-b58a-af1f612a807e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:56.408452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1fa5bc8f-f228-4af2-b58a-af1f612a807e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:56.413807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1087/2195] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:56 2022] DELETE /identity/v3/projects/4b94dc2b731a47408e97fef37b3770c6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:56.415777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e9574-b33d-48b3-b9f8-0d88d986392a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.416074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e9574-b33d-48b3-b9f8-0d88d986392a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.416373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e9574-b33d-48b3-b9f8-0d88d986392a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.438133 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9d0e9574-b33d-48b3-b9f8-0d88d986392a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:56.439563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9d0e9574-b33d-48b3-b9f8-0d88d986392a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:56.455362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1109/2196] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:26:56.459676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad1ed5-cbda-40a2-87c3-f5384748f16c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:56.470540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad1ed5-cbda-40a2-87c3-f5384748f16c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:56.478817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37f324-95ba-4cce-bfee-a04069c0bc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:56.479768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37f324-95ba-4cce-bfee-a04069c0bc00 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.480135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37f324-95ba-4cce-bfee-a04069c0bc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.481206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37f324-95ba-4cce-bfee-a04069c0bc00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.481757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37f324-95ba-4cce-bfee-a04069c0bc00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:56.482144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37f324-95ba-4cce-bfee-a04069c0bc00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:56.483875 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37f324-95ba-4cce-bfee-a04069c0bc00 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:56.500378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1110/2197] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:26:56.504907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37f324-95ba-4cce-bfee-a04069c0bc00 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:56.516752 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37f324-95ba-4cce-bfee-a04069c0bc00 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:56.519986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1088/2198] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:26:56.530404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cced2-2625-4d2f-9b36-678a939ae0c8 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.530992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cced2-2625-4d2f-9b36-678a939ae0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.531471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcc5de-0d39-4f9e-b56a-71198982e0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:56.532160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcc5de-0d39-4f9e-b56a-71198982e0ba admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.532445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcc5de-0d39-4f9e-b56a-71198982e0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.532726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcc5de-0d39-4f9e-b56a-71198982e0ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.532894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cced2-2625-4d2f-9b36-678a939ae0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.533499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcc5de-0d39-4f9e-b56a-71198982e0ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:56.535476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcc5de-0d39-4f9e-b56a-71198982e0ba admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:56.549265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:56.579276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1111/2199] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:56 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:26:56.579276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcc5de-0d39-4f9e-b56a-71198982e0ba admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:56.585352 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c36cced2-2625-4d2f-9b36-678a939ae0c8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:56.586720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c36cced2-2625-4d2f-9b36-678a939ae0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:56.685439 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcc5de-0d39-4f9e-b56a-71198982e0ba admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:56.691647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303a5ff-424c-4cd7-ad4e-d2d083774ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:56.692473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303a5ff-424c-4cd7-ad4e-d2d083774ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.693648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303a5ff-424c-4cd7-ad4e-d2d083774ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.694235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303a5ff-424c-4cd7-ad4e-d2d083774ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.695057 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303a5ff-424c-4cd7-ad4e-d2d083774ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:56.705481 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303a5ff-424c-4cd7-ad4e-d2d083774ad3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:56.713878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1089/2200] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:56.720923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cced2-2625-4d2f-9b36-678a939ae0c8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:56.736715 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cced2-2625-4d2f-9b36-678a939ae0c8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:56.737852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1112/2201] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:56 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:56.743026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303a5ff-424c-4cd7-ad4e-d2d083774ad3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:56.744319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf915a-5196-4bbb-9cce-d413656b0eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:56.745329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf915a-5196-4bbb-9cce-d413656b0eea admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.745726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf915a-5196-4bbb-9cce-d413656b0eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.746116 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf915a-5196-4bbb-9cce-d413656b0eea admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.747107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf915a-5196-4bbb-9cce-d413656b0eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:26:56.747530 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf915a-5196-4bbb-9cce-d413656b0eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:56.750168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf915a-5196-4bbb-9cce-d413656b0eea admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:56.756401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303a5ff-424c-4cd7-ad4e-d2d083774ad3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:56.762208 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fd708-4693-4ea0-8768-42e390bffcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:56.763178 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fd708-4693-4ea0-8768-42e390bffcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.763178 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fd708-4693-4ea0-8768-42e390bffcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.763480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fd708-4693-4ea0-8768-42e390bffcc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.764231 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fd708-4693-4ea0-8768-42e390bffcc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:56.766085 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fd708-4693-4ea0-8768-42e390bffcc1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:56.768255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1090/2202] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:26:56.772332 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf915a-5196-4bbb-9cce-d413656b0eea admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:56.779574 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1113/2203] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:56.783687 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fd708-4693-4ea0-8768-42e390bffcc1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:56.788337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf915a-5196-4bbb-9cce-d413656b0eea admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:56.798534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fd708-4693-4ea0-8768-42e390bffcc1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:56.803815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcee6cf-0ca1-4519-a625-40b75885e197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:56.804496 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcee6cf-0ca1-4519-a625-40b75885e197 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.804786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcee6cf-0ca1-4519-a625-40b75885e197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.805035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79336c-a1a9-4f1d-8e8c-51bded6ad31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:56.805503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcee6cf-0ca1-4519-a625-40b75885e197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.805925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcee6cf-0ca1-4519-a625-40b75885e197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:56.806356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79336c-a1a9-4f1d-8e8c-51bded6ad31a admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.806914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79336c-a1a9-4f1d-8e8c-51bded6ad31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.807336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79336c-a1a9-4f1d-8e8c-51bded6ad31a admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.807529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcee6cf-0ca1-4519-a625-40b75885e197 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:56.808284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79336c-a1a9-4f1d-8e8c-51bded6ad31a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:56.824185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79336c-a1a9-4f1d-8e8c-51bded6ad31a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:56.827012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1114/2204] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:56.832232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcee6cf-0ca1-4519-a625-40b75885e197 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:56.846942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcee6cf-0ca1-4519-a625-40b75885e197 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:56.862932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53121-143a-4f6a-be68-20b3cd58bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:56.863886 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53121-143a-4f6a-be68-20b3cd58bdfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.864179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53121-143a-4f6a-be68-20b3cd58bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.864462 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53121-143a-4f6a-be68-20b3cd58bdfe admin admin] PATH_INFO: `/v3/projects/66865b40b26142948b152ae28028b762/users/5eeeb408cc7944dd9b71a6d333e6687e/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.876161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1091/2205] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:26:56 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:56.880229 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79336c-a1a9-4f1d-8e8c-51bded6ad31a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:56.895063 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd53121-143a-4f6a-be68-20b3cd58bdfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=66865b40b26142948b152ae28028b762, user_id=5eeeb408cc7944dd9b71a6d333e6687e, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:56.897871 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd53121-143a-4f6a-be68-20b3cd58bdfe admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:56.921127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1115/2206] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:56 2022] PUT /identity/v3/projects/66865b40b26142948b152ae28028b762/users/5eeeb408cc7944dd9b71a6d333e6687e/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:56.932244 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4836ee9-a091-48b1-8c68-98dc7ee632ba None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:56.932666 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4836ee9-a091-48b1-8c68-98dc7ee632ba None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:56.932961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4836ee9-a091-48b1-8c68-98dc7ee632ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:56.961613 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d4836ee9-a091-48b1-8c68-98dc7ee632ba None None] MFA Rules not processed for user `5eeeb408cc7944dd9b71a6d333e6687e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:56.962848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d4836ee9-a091-48b1-8c68-98dc7ee632ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:56.966926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:56.995127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79336c-a1a9-4f1d-8e8c-51bded6ad31a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:57.055523 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1116/2207] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:57.063801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4836ee9-a091-48b1-8c68-98dc7ee632ba None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:57.066831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d4836ee9-a091-48b1-8c68-98dc7ee632ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:57.074987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da49c9d-12ff-49c6-bfa1-dcb416ba9a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:57.076279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da49c9d-12ff-49c6-bfa1-dcb416ba9a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:57.076279 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da49c9d-12ff-49c6-bfa1-dcb416ba9a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:57.076511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da49c9d-12ff-49c6-bfa1-dcb416ba9a62 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:57.077433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da49c9d-12ff-49c6-bfa1-dcb416ba9a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:57.079749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da49c9d-12ff-49c6-bfa1-dcb416ba9a62 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:57.105648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1092/2208] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:26:56 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:26:57.108449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:57.111658 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da49c9d-12ff-49c6-bfa1-dcb416ba9a62 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:57.132759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da49c9d-12ff-49c6-bfa1-dcb416ba9a62 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:57.139534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35955f34-a20c-429b-afa1-46687a0705c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:57.140453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35955f34-a20c-429b-afa1-46687a0705c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:57.140853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35955f34-a20c-429b-afa1-46687a0705c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:57.141687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35955f34-a20c-429b-afa1-46687a0705c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:57.142483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35955f34-a20c-429b-afa1-46687a0705c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:57.144556 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35955f34-a20c-429b-afa1-46687a0705c6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:57.156321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1093/2209] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:26:57.160477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35955f34-a20c-429b-afa1-46687a0705c6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:57.163081 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4836ee9-a091-48b1-8c68-98dc7ee632ba None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:57.167206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee5d1f-59a1-41e9-bb2c-9a598efa750d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:57.167868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee5d1f-59a1-41e9-bb2c-9a598efa750d service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:57.168155 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee5d1f-59a1-41e9-bb2c-9a598efa750d service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:57.168481 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee5d1f-59a1-41e9-bb2c-9a598efa750d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:57.172104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35955f34-a20c-429b-afa1-46687a0705c6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:57.177571 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f22215-d916-4b2f-9aca-5f4a92cfa72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:57.178172 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee5d1f-59a1-41e9-bb2c-9a598efa750d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:57.178324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f22215-d916-4b2f-9aca-5f4a92cfa72a admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:57.178543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f22215-d916-4b2f-9aca-5f4a92cfa72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:57.178980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f22215-d916-4b2f-9aca-5f4a92cfa72a admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:57.179668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee5d1f-59a1-41e9-bb2c-9a598efa750d service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:57.179792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f22215-d916-4b2f-9aca-5f4a92cfa72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:57.181395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f22215-d916-4b2f-9aca-5f4a92cfa72a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:57.198760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1117/2210] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:57.204278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1094/2211] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:26:57.205750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee5d1f-59a1-41e9-bb2c-9a598efa750d service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:57.219356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee5d1f-59a1-41e9-bb2c-9a598efa750d service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:57.225178 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc282-bd34-425b-9e41-deb40994f0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:57.225988 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc282-bd34-425b-9e41-deb40994f0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:57.226277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc282-bd34-425b-9e41-deb40994f0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:57.226552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc282-bd34-425b-9e41-deb40994f0e7 admin admin] PATH_INFO: `/v3/projects/1735c3f344a24ae6821ab233c3537cd1/users/c0023517ec494a01a7bc4bae3fdfb562/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:57.243248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fc282-bd34-425b-9e41-deb40994f0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1735c3f344a24ae6821ab233c3537cd1, user_id=c0023517ec494a01a7bc4bae3fdfb562, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:57.246282 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fc282-bd34-425b-9e41-deb40994f0e7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:57.261952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1118/2212] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:26:57 2022] PUT /identity/v3/projects/1735c3f344a24ae6821ab233c3537cd1/users/c0023517ec494a01a7bc4bae3fdfb562/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:57.268038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205274f2-5be0-49f8-a410-c3214887ec64 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:57.268731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205274f2-5be0-49f8-a410-c3214887ec64 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:57.269311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205274f2-5be0-49f8-a410-c3214887ec64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:57.290776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-205274f2-5be0-49f8-a410-c3214887ec64 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:57.292043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-205274f2-5be0-49f8-a410-c3214887ec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:57.372905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1095/2213] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:57.384684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc282-bd34-425b-9e41-deb40994f0e7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:57.386823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-079fc282-bd34-425b-9e41-deb40994f0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:57.469765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc282-bd34-425b-9e41-deb40994f0e7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:57.475339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a62496-818e-493b-85cc-9daab8f2d460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:57.476227 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a62496-818e-493b-85cc-9daab8f2d460 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:57.476792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a62496-818e-493b-85cc-9daab8f2d460 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:57.477299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a62496-818e-493b-85cc-9daab8f2d460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:57.488838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a62496-818e-493b-85cc-9daab8f2d460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:57.491394 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a62496-818e-493b-85cc-9daab8f2d460 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:57.513148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1119/2214] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:58.026776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205274f2-5be0-49f8-a410-c3214887ec64 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:58.028642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-205274f2-5be0-49f8-a410-c3214887ec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:58.044563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205274f2-5be0-49f8-a410-c3214887ec64 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:58.050172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:58.051175 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:58.051853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:58.052432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] PATH_INFO: `/v3/users/b262e4e4d19d40f4b89ab79547783658` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:58.054828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b262e4e4d19d40f4b89ab79547783658)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:58.058699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:58.112462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b262e4e4d19d40f4b89ab79547783658'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:58.114449 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:58.130268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b262e4e4d19d40f4b89ab79547783658'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:58.142428 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b262e4e4d19d40f4b89ab79547783658'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:58.153822 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b262e4e4d19d40f4b89ab79547783658'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:58.155823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b262e4e4d19d40f4b89ab79547783658'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:58.166047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1096/2215] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:58 2022] DELETE /identity/v3/users/b262e4e4d19d40f4b89ab79547783658 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:58.170479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68565185-5d0f-4a80-ba42-6a45d26bab78 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:58.170979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68565185-5d0f-4a80-ba42-6a45d26bab78 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:58.171368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68565185-5d0f-4a80-ba42-6a45d26bab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:58.193731 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-68565185-5d0f-4a80-ba42-6a45d26bab78 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:58.195166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-68565185-5d0f-4a80-ba42-6a45d26bab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:58.277354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1120/2216] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:58.288220 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:58.290811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:58.361708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b27bf-2bd5-44ac-89a2-ba5b134b14e4 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:58.367253 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab61c6e-5a25-4291-b810-b8a8af204181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:58.368298 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab61c6e-5a25-4291-b810-b8a8af204181 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:58.368712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab61c6e-5a25-4291-b810-b8a8af204181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:58.369390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab61c6e-5a25-4291-b810-b8a8af204181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:58.390573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab61c6e-5a25-4291-b810-b8a8af204181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:58.393363 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab61c6e-5a25-4291-b810-b8a8af204181 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:58.411997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1097/2217] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:26:58.687607 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67741bda-1800-45ce-a332-2dbf005375f9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:58.688320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67741bda-1800-45ce-a332-2dbf005375f9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:58.688680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67741bda-1800-45ce-a332-2dbf005375f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:58.709474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-67741bda-1800-45ce-a332-2dbf005375f9 None None] MFA Rules not processed for user `5eeeb408cc7944dd9b71a6d333e6687e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:58.710483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-67741bda-1800-45ce-a332-2dbf005375f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:58.800215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:58.835310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1121/2218] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:58.888304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab61c6e-5a25-4291-b810-b8a8af204181 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:58.891646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cab61c6e-5a25-4291-b810-b8a8af204181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:58.956393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67741bda-1800-45ce-a332-2dbf005375f9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:58.958032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-67741bda-1800-45ce-a332-2dbf005375f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:58.986902 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67741bda-1800-45ce-a332-2dbf005375f9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:58.989650 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab61c6e-5a25-4291-b810-b8a8af204181 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:59.001634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf290e7-a349-4d22-81a4-a5de744b51cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:59.007174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:59.008056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:59.008341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:59.008617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] PATH_INFO: `/v3/projects/0fc2a3f18be8494397e19521c8e808f8` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:59.009817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf290e7-a349-4d22-81a4-a5de744b51cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:59.009944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc2a3f18be8494397e19521c8e808f8)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:59.010562 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf290e7-a349-4d22-81a4-a5de744b51cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:59.011047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf290e7-a349-4d22-81a4-a5de744b51cd admin admin] PATH_INFO: `/v3/users/887b447484e94478bab6a7ba2166dbc5` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:59.011946 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:59.012975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf290e7-a349-4d22-81a4-a5de744b51cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=887b447484e94478bab6a7ba2166dbc5)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:59.015536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf290e7-a349-4d22-81a4-a5de744b51cd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:59.120081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ecf290e7-a349-4d22-81a4-a5de744b51cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887b447484e94478bab6a7ba2166dbc5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.124961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc2a3f18be8494397e19521c8e808f8', 'request_id': 'req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.134452 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc2a3f18be8494397e19521c8e808f8', 'request_id': 'req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.141889 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ecf290e7-a349-4d22-81a4-a5de744b51cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887b447484e94478bab6a7ba2166dbc5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.153474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ecf290e7-a349-4d22-81a4-a5de744b51cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887b447484e94478bab6a7ba2166dbc5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.157260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc2a3f18be8494397e19521c8e808f8', 'request_id': 'req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.168596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ecf290e7-a349-4d22-81a4-a5de744b51cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887b447484e94478bab6a7ba2166dbc5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.169708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ecf290e7-a349-4d22-81a4-a5de744b51cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887b447484e94478bab6a7ba2166dbc5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.180037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] The token cache is being invalidate because project 0fc2a3f18be8494397e19521c8e808f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:26:59.180360 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1098/2219] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:58 2022] DELETE /identity/v3/users/887b447484e94478bab6a7ba2166dbc5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:26:59.180441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.182163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.183977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1122/2220] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:26:58 2022] DELETE /identity/v3/projects/0fc2a3f18be8494397e19521c8e808f8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:26:59.188837 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:59.193336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de849c7c-74d5-4bb6-84cb-1b800ac7ce9d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:59.194629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de849c7c-74d5-4bb6-84cb-1b800ac7ce9d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:59.196345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de849c7c-74d5-4bb6-84cb-1b800ac7ce9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:59.216112 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:59.222548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-de849c7c-74d5-4bb6-84cb-1b800ac7ce9d None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:26:59.224079 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-de849c7c-74d5-4bb6-84cb-1b800ac7ce9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:59.302137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:59.356214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1099/2221] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:26:59.363319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726ba8e-b4ae-43c4-a69b-48e6c915c79e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:59.374163 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de849c7c-74d5-4bb6-84cb-1b800ac7ce9d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:26:59.382361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:59.383825 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:59.384303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:59.384766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] PATH_INFO: `/v3/users/f181334bdc754706bfebdc5a62b913de` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:59.386637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f181334bdc754706bfebdc5a62b913de)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:59.386938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-de849c7c-74d5-4bb6-84cb-1b800ac7ce9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:26:59.389027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:59.503311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de849c7c-74d5-4bb6-84cb-1b800ac7ce9d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:26:59.507591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f181334bdc754706bfebdc5a62b913de'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.509172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11734ddd-3310-4add-9c62-e20c97724246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:26:59.510142 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734ddd-3310-4add-9c62-e20c97724246 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:26:59.510589 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734ddd-3310-4add-9c62-e20c97724246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:26:59.510919 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734ddd-3310-4add-9c62-e20c97724246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:26:59.525753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f181334bdc754706bfebdc5a62b913de'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.527580 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11734ddd-3310-4add-9c62-e20c97724246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:26:59.529307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11734ddd-3310-4add-9c62-e20c97724246 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:26:59.541416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f181334bdc754706bfebdc5a62b913de'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.545220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:59.549945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1100/2222] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:26:59.558291 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f181334bdc754706bfebdc5a62b913de'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.559342 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f181334bdc754706bfebdc5a62b913de'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:26:59.570221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1123/2223] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:26:59 2022] DELETE /identity/v3/users/f181334bdc754706bfebdc5a62b913de => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:00.415005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11734ddd-3310-4add-9c62-e20c97724246 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:00.434247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11734ddd-3310-4add-9c62-e20c97724246 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:00.637870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:00.639666 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:00.640245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:00.641246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] PATH_INFO: `/v3/projects/968687be13734188a3cf0e11b325d7ef` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:00.643889 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=968687be13734188a3cf0e11b325d7ef)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:00.647235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:00.666347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:00.668701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:00.707287 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d0579-57bf-4536-9797-073f227b3c2c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:00.720117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:00.721148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:00.721406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:00.721863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] PATH_INFO: `/v3/projects/5127e031d5904de49d81a0c053c23d92` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:00.723734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5127e031d5904de49d81a0c053c23d92)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:00.730363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:00.778974 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968687be13734188a3cf0e11b325d7ef', 'request_id': 'req-ef5d79c2-c5e1-417b-a265-f4832efc3776'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:00.797932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968687be13734188a3cf0e11b325d7ef', 'request_id': 'req-ef5d79c2-c5e1-417b-a265-f4832efc3776'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:00.815448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968687be13734188a3cf0e11b325d7ef', 'request_id': 'req-ef5d79c2-c5e1-417b-a265-f4832efc3776'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:00.832593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5127e031d5904de49d81a0c053c23d92', 'request_id': 'req-e9da112f-8aa4-464f-b981-ac464b81758a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:00.838674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] The token cache is being invalidate because project 968687be13734188a3cf0e11b325d7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:00.843487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:00.847694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:00.853564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1101/2224] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:00 2022] DELETE /identity/v3/projects/968687be13734188a3cf0e11b325d7ef => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:00.855103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5127e031d5904de49d81a0c053c23d92', 'request_id': 'req-e9da112f-8aa4-464f-b981-ac464b81758a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:00.858511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:00.864076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:00.882159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5127e031d5904de49d81a0c053c23d92', 'request_id': 'req-e9da112f-8aa4-464f-b981-ac464b81758a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:00.906885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] The token cache is being invalidate because project 5127e031d5904de49d81a0c053c23d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:00.907516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:00.913467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:00.917484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:00.919255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1124/2225] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:00 2022] DELETE /identity/v3/projects/5127e031d5904de49d81a0c053c23d92 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:00.924929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:00.926804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:01.095529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d79c2-c5e1-417b-a265-f4832efc3776 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:01.101882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da112f-8aa4-464f-b981-ac464b81758a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:01.107640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:01.108987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:01.109489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:01.110310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] PATH_INFO: `/v3/users/f3cd5366a9d84e68b9d406b9cc55a004` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:01.111178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:01.112247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:01.112438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3cd5366a9d84e68b9d406b9cc55a004)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:01.114118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:01.114465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] PATH_INFO: `/v3/users/974a2bde499f4724a036e7cbcf24c82c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:01.115702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:01.115954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] RBAC: Authorizing `identity:delete_user(user_id=974a2bde499f4724a036e7cbcf24c82c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:01.119549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:01.225910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974a2bde499f4724a036e7cbcf24c82c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:01.228022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3cd5366a9d84e68b9d406b9cc55a004'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:01.245535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974a2bde499f4724a036e7cbcf24c82c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:01.264768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3cd5366a9d84e68b9d406b9cc55a004'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:01.282590 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974a2bde499f4724a036e7cbcf24c82c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:01.282996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3cd5366a9d84e68b9d406b9cc55a004'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:01.293157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:01.297211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974a2bde499f4724a036e7cbcf24c82c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:01.299549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974a2bde499f4724a036e7cbcf24c82c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:01.303486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3cd5366a9d84e68b9d406b9cc55a004'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:01.304282 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3cd5366a9d84e68b9d406b9cc55a004'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:01.316482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1125/2226] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:27:00 2022] DELETE /identity/v3/users/f3cd5366a9d84e68b9d406b9cc55a004 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:27:01.331288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1102/2227] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:27:00 2022] DELETE /identity/v3/users/974a2bde499f4724a036e7cbcf24c82c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:02.126819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:02.128287 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:02.253658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160119c-de03-42a2-9024-977389c27fce admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:02.419290 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:02.420734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:02.421241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:02.421759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab admin admin] PATH_INFO: `/v3/projects/13ab86ca1ab64bd5863015827736363c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:02.423446 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ab86ca1ab64bd5863015827736363c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:02.426307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:02.498056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:02.501984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:02.523086 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e1259-4e97-4ffc-a716-6994a957077a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:02.541100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ab86ca1ab64bd5863015827736363c', 'request_id': 'req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:02.567964 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ab86ca1ab64bd5863015827736363c', 'request_id': 'req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:02.588528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ab86ca1ab64bd5863015827736363c', 'request_id': 'req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:02.613000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab admin admin] The token cache is being invalidate because project 13ab86ca1ab64bd5863015827736363c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:02.613000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:02.617564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7141b4a1-6991-46d9-9d0b-a1a9d9bd3cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:02.619101 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1126/2228] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:02 2022] DELETE /identity/v3/projects/13ab86ca1ab64bd5863015827736363c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:02.625744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e85252-9c76-4cc5-9a5b-9abfe40373e0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:02.625744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e85252-9c76-4cc5-9a5b-9abfe40373e0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:02.626072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e85252-9c76-4cc5-9a5b-9abfe40373e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:02.683250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c7e85252-9c76-4cc5-9a5b-9abfe40373e0 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:02.684568 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c7e85252-9c76-4cc5-9a5b-9abfe40373e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:02.715315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c397d-18f2-45ec-916f-3a1ead199ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:02.716227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c397d-18f2-45ec-916f-3a1ead199ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:02.716517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c397d-18f2-45ec-916f-3a1ead199ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:02.716796 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c397d-18f2-45ec-916f-3a1ead199ef7 admin admin] PATH_INFO: `/v3/projects/bdd3aa9bb0bd44f49c3356985ef8d3db` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:02.719490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c397d-18f2-45ec-916f-3a1ead199ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd3aa9bb0bd44f49c3356985ef8d3db)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:02.726119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c397d-18f2-45ec-916f-3a1ead199ef7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:02.755401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:02.811850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:02.826721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-913c397d-18f2-45ec-916f-3a1ead199ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd3aa9bb0bd44f49c3356985ef8d3db', 'request_id': 'req-913c397d-18f2-45ec-916f-3a1ead199ef7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:02.836897 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-913c397d-18f2-45ec-916f-3a1ead199ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd3aa9bb0bd44f49c3356985ef8d3db', 'request_id': 'req-913c397d-18f2-45ec-916f-3a1ead199ef7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:02.854691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-913c397d-18f2-45ec-916f-3a1ead199ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd3aa9bb0bd44f49c3356985ef8d3db', 'request_id': 'req-913c397d-18f2-45ec-916f-3a1ead199ef7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:02.861851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1127/2229] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:02.872012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280934c1-a6c7-47c8-88a5-f2d3a930a5b5 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:02.872398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280934c1-a6c7-47c8-88a5-f2d3a930a5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:02.872685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280934c1-a6c7-47c8-88a5-f2d3a930a5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:02.905481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-913c397d-18f2-45ec-916f-3a1ead199ef7 admin admin] The token cache is being invalidate because project bdd3aa9bb0bd44f49c3356985ef8d3db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:02.906501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-913c397d-18f2-45ec-916f-3a1ead199ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:02.910151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-913c397d-18f2-45ec-916f-3a1ead199ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:02.913445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-280934c1-a6c7-47c8-88a5-f2d3a930a5b5 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:02.915390 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-280934c1-a6c7-47c8-88a5-f2d3a930a5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:02.916812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1103/2230] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:02 2022] DELETE /identity/v3/projects/bdd3aa9bb0bd44f49c3356985ef8d3db => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:02.924280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e622-4367-443b-8c38-7d580e6916fa None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:02.925056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e622-4367-443b-8c38-7d580e6916fa None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:02.925460 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e622-4367-443b-8c38-7d580e6916fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:02.958019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f3e1e622-4367-443b-8c38-7d580e6916fa None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:02.962403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f3e1e622-4367-443b-8c38-7d580e6916fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:03.030219 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1128/2231] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:03.031321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280934c1-a6c7-47c8-88a5-f2d3a930a5b5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:03.032666 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-280934c1-a6c7-47c8-88a5-f2d3a930a5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:03.099371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1104/2232] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:03.100348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1e622-4367-443b-8c38-7d580e6916fa None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:03.136970 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1e622-4367-443b-8c38-7d580e6916fa None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:03.145712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280934c1-a6c7-47c8-88a5-f2d3a930a5b5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:03.155629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f9d3d-b063-4942-b033-1e6786bacaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:03.157758 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f9d3d-b063-4942-b033-1e6786bacaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:03.158124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f9d3d-b063-4942-b033-1e6786bacaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:03.159399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f9d3d-b063-4942-b033-1e6786bacaf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:03.159670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca2e2e-5bad-4fce-96e9-3817c9559c61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:03.160404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca2e2e-5bad-4fce-96e9-3817c9559c61 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:03.160690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca2e2e-5bad-4fce-96e9-3817c9559c61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:03.160814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f9d3d-b063-4942-b033-1e6786bacaf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:27:03.160996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca2e2e-5bad-4fce-96e9-3817c9559c61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:03.162227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f9d3d-b063-4942-b033-1e6786bacaf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:03.164093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-12ca2e2e-5bad-4fce-96e9-3817c9559c61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:03.169940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f9d3d-b063-4942-b033-1e6786bacaf8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:03.194371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1105/2233] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:27:03.199624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183d7e-581d-4a0f-a712-87083ad05337 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:03.200365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183d7e-581d-4a0f-a712-87083ad05337 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:03.200365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183d7e-581d-4a0f-a712-87083ad05337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:03.251081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3c183d7e-581d-4a0f-a712-87083ad05337 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:03.254091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3c183d7e-581d-4a0f-a712-87083ad05337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:03.288158 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1106/2234] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:03.289946 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c183d7e-581d-4a0f-a712-87083ad05337 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:03.312198 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c183d7e-581d-4a0f-a712-87083ad05337 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:03.320006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca2e2e-5bad-4fce-96e9-3817c9559c61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:03.321914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca2e2e-5bad-4fce-96e9-3817c9559c61 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:03.336200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1129/2235] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:03.337398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca2e2e-5bad-4fce-96e9-3817c9559c61 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:03.337497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35768a87-c4b6-4a48-8667-1ef5b5d48b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:03.338287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35768a87-c4b6-4a48-8667-1ef5b5d48b82 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:03.338818 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35768a87-c4b6-4a48-8667-1ef5b5d48b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:03.339211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35768a87-c4b6-4a48-8667-1ef5b5d48b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:03.340024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35768a87-c4b6-4a48-8667-1ef5b5d48b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:03.344973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35768a87-c4b6-4a48-8667-1ef5b5d48b82 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:03.350725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca2e2e-5bad-4fce-96e9-3817c9559c61 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:03.372507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08067640-cafb-408e-8724-eb1758c3a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:03.373235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08067640-cafb-408e-8724-eb1758c3a7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:03.373529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08067640-cafb-408e-8724-eb1758c3a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:03.373811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08067640-cafb-408e-8724-eb1758c3a7b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:03.374561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08067640-cafb-408e-8724-eb1758c3a7b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:27:03.374862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08067640-cafb-408e-8724-eb1758c3a7b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:03.377920 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08067640-cafb-408e-8724-eb1758c3a7b0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:03.408597 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1107/2237] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:27:03 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:27:03.408983 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1130/2237] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:27:03.410205 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08067640-cafb-408e-8724-eb1758c3a7b0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:03.410432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35768a87-c4b6-4a48-8667-1ef5b5d48b82 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:03.437433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08067640-cafb-408e-8724-eb1758c3a7b0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:03.469545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:03.630879 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879f170-f1e8-4369-b3b7-444ee64e406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:03.631743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879f170-f1e8-4369-b3b7-444ee64e406c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:03.634142 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879f170-f1e8-4369-b3b7-444ee64e406c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:03.634589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879f170-f1e8-4369-b3b7-444ee64e406c admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:03.635456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879f170-f1e8-4369-b3b7-444ee64e406c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:03.640023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879f170-f1e8-4369-b3b7-444ee64e406c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:03.658873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35768a87-c4b6-4a48-8667-1ef5b5d48b82 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:03.673685 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafad990-3c78-43f9-9c81-5c67388f6dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:03.676236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafad990-3c78-43f9-9c81-5c67388f6dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:03.676750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafad990-3c78-43f9-9c81-5c67388f6dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:03.679044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafad990-3c78-43f9-9c81-5c67388f6dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:03.680979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafad990-3c78-43f9-9c81-5c67388f6dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:03.688467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafad990-3c78-43f9-9c81-5c67388f6dcb admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:03.693718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1131/2238] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:27:03 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:27:03.698458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879f170-f1e8-4369-b3b7-444ee64e406c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:03.725006 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879f170-f1e8-4369-b3b7-444ee64e406c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:03.739213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694dadc-8047-41d9-9e7a-7e8abb6218f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:03.740732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694dadc-8047-41d9-9e7a-7e8abb6218f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:03.741242 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694dadc-8047-41d9-9e7a-7e8abb6218f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:03.741676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694dadc-8047-41d9-9e7a-7e8abb6218f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:03.742595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694dadc-8047-41d9-9e7a-7e8abb6218f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:03.744456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694dadc-8047-41d9-9e7a-7e8abb6218f8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:03.772416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1132/2239] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:03.774592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694dadc-8047-41d9-9e7a-7e8abb6218f8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:03.784836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1108/2240] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:27:03 2022] POST /identity/v3/projects => generated 399 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:27:03.785637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafad990-3c78-43f9-9c81-5c67388f6dcb admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:03.806501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694dadc-8047-41d9-9e7a-7e8abb6218f8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:03.811980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:03.885458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2701315-39ef-4742-b090-f601e86d5357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:03.886378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2701315-39ef-4742-b090-f601e86d5357 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:03.886775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2701315-39ef-4742-b090-f601e86d5357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:03.887448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2701315-39ef-4742-b090-f601e86d5357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:03.888420 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2701315-39ef-4742-b090-f601e86d5357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:03.893035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2701315-39ef-4742-b090-f601e86d5357 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:03.909521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1133/2241] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:03.913683 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2701315-39ef-4742-b090-f601e86d5357 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:03.926452 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2701315-39ef-4742-b090-f601e86d5357 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:03.934527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafad990-3c78-43f9-9c81-5c67388f6dcb admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:03.941838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f2fd5-70e2-4db6-856f-51639c7a84eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:03.944080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f2fd5-70e2-4db6-856f-51639c7a84eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:03.944580 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f2fd5-70e2-4db6-856f-51639c7a84eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:03.945382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c339cd9-eb4b-4670-a53a-c8cdf0b6c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:03.946388 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f2fd5-70e2-4db6-856f-51639c7a84eb admin admin] PATH_INFO: `/v3/projects/2715f9d5854c4c9792daf31771f79b3c/users/c1c00f56e20b4b02bcd57ae80f5d7004/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:03.946836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c339cd9-eb4b-4670-a53a-c8cdf0b6c58d admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:03.947592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c339cd9-eb4b-4670-a53a-c8cdf0b6c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:03.948534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c339cd9-eb4b-4670-a53a-c8cdf0b6c58d admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:03.949408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c339cd9-eb4b-4670-a53a-c8cdf0b6c58d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:03.954467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c339cd9-eb4b-4670-a53a-c8cdf0b6c58d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:03.981401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f2fd5-70e2-4db6-856f-51639c7a84eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2715f9d5854c4c9792daf31771f79b3c, user_id=c1c00f56e20b4b02bcd57ae80f5d7004, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:03.985306 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f2fd5-70e2-4db6-856f-51639c7a84eb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:04.002517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1109/2242] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:27:03 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:27:04.007717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c339cd9-eb4b-4670-a53a-c8cdf0b6c58d admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:04.012559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1134/2243] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:27:03 2022] PUT /identity/v3/projects/2715f9d5854c4c9792daf31771f79b3c/users/c1c00f56e20b4b02bcd57ae80f5d7004/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:04.030040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652cc1e-cbda-4081-99c1-8dfc0b4df55f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:04.030587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652cc1e-cbda-4081-99c1-8dfc0b4df55f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:04.030942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652cc1e-cbda-4081-99c1-8dfc0b4df55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:04.059674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c339cd9-eb4b-4670-a53a-c8cdf0b6c58d admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:04.109807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8652cc1e-cbda-4081-99c1-8dfc0b4df55f None None] MFA Rules not processed for user `c1c00f56e20b4b02bcd57ae80f5d7004`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:04.115129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8652cc1e-cbda-4081-99c1-8dfc0b4df55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:04.187276 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a103d3b-a7ff-45df-97eb-f20a5f4aeb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:04.188440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a103d3b-a7ff-45df-97eb-f20a5f4aeb75 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:04.188440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a103d3b-a7ff-45df-97eb-f20a5f4aeb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:04.188777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a103d3b-a7ff-45df-97eb-f20a5f4aeb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:04.189655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a103d3b-a7ff-45df-97eb-f20a5f4aeb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:04.191404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a103d3b-a7ff-45df-97eb-f20a5f4aeb75 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:04.216856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1110/2244] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:04.219794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a103d3b-a7ff-45df-97eb-f20a5f4aeb75 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:04.221801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:04.248088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a103d3b-a7ff-45df-97eb-f20a5f4aeb75 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:04.250809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1135/2245] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:04.272194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652cc1e-cbda-4081-99c1-8dfc0b4df55f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:04.287128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec0335-78a9-4381-a1d9-5f9738b98118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:04.291640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec0335-78a9-4381-a1d9-5f9738b98118 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:04.292052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec0335-78a9-4381-a1d9-5f9738b98118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:04.292346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec0335-78a9-4381-a1d9-5f9738b98118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:04.293190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec0335-78a9-4381-a1d9-5f9738b98118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:04.294915 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec0335-78a9-4381-a1d9-5f9738b98118 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:04.325277 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1111/2246] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:04.329800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec0335-78a9-4381-a1d9-5f9738b98118 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:04.353844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec0335-78a9-4381-a1d9-5f9738b98118 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:04.361294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d213de-1c6c-4ff0-a111-8be5b141aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:04.364215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d213de-1c6c-4ff0-a111-8be5b141aa4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:04.365539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d213de-1c6c-4ff0-a111-8be5b141aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:04.366181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d213de-1c6c-4ff0-a111-8be5b141aa4e admin admin] PATH_INFO: `/v3/projects/43d2f3deacc943d681cf591054ea09e2/users/7ea4da98b4d34dddb97dca48884fbeb1/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:04.430302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d213de-1c6c-4ff0-a111-8be5b141aa4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d2f3deacc943d681cf591054ea09e2, user_id=7ea4da98b4d34dddb97dca48884fbeb1, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:04.430515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652cc1e-cbda-4081-99c1-8dfc0b4df55f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:04.438974 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d213de-1c6c-4ff0-a111-8be5b141aa4e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:04.451934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969dbcc-b595-445b-aa69-827298d0068e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:04.452629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969dbcc-b595-445b-aa69-827298d0068e service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:04.452920 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969dbcc-b595-445b-aa69-827298d0068e service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:04.454155 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969dbcc-b595-445b-aa69-827298d0068e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:04.501265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1112/2247] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:27:04 2022] PUT /identity/v3/projects/43d2f3deacc943d681cf591054ea09e2/users/7ea4da98b4d34dddb97dca48884fbeb1/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:04.502291 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969dbcc-b595-445b-aa69-827298d0068e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:04.503820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969dbcc-b595-445b-aa69-827298d0068e service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:04.506343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7cc5c-ea65-48c9-8929-558424a804cf None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:04.506642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7cc5c-ea65-48c9-8929-558424a804cf None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:04.508137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7cc5c-ea65-48c9-8929-558424a804cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:04.530829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1136/2248] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:27:04.580496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f9a7cc5c-ea65-48c9-8929-558424a804cf None None] MFA Rules not processed for user `7ea4da98b4d34dddb97dca48884fbeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:04.582253 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f9a7cc5c-ea65-48c9-8929-558424a804cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:04.742727 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:04.807395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1113/2249] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:04.845685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969dbcc-b595-445b-aa69-827298d0068e service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:04.847384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d969dbcc-b595-445b-aa69-827298d0068e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:04.908056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969dbcc-b595-445b-aa69-827298d0068e service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:05.060524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fd9ec-fcce-404d-ab58-f1a158cda1d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:05.062653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fd9ec-fcce-404d-ab58-f1a158cda1d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:05.062945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fd9ec-fcce-404d-ab58-f1a158cda1d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:05.063227 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fd9ec-fcce-404d-ab58-f1a158cda1d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:05.085407 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d95c00-93fa-43ef-be3a-a2531900355b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:05.085709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d95c00-93fa-43ef-be3a-a2531900355b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:05.085996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d95c00-93fa-43ef-be3a-a2531900355b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:05.100255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fd9ec-fcce-404d-ab58-f1a158cda1d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:05.101793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fd9ec-fcce-404d-ab58-f1a158cda1d1 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:05.146692 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1137/2250] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:05.180634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-32d95c00-93fa-43ef-be3a-a2531900355b None None] MFA Rules not processed for user `c0023517ec494a01a7bc4bae3fdfb562`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:05.183023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-32d95c00-93fa-43ef-be3a-a2531900355b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:05.349937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1114/2251] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:05.364841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb812-32da-40c9-863a-0b5ff2756c70 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:05.365347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb812-32da-40c9-863a-0b5ff2756c70 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:05.366096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb812-32da-40c9-863a-0b5ff2756c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:05.414549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-142cb812-32da-40c9-863a-0b5ff2756c70 None None] MFA Rules not processed for user `c0023517ec494a01a7bc4bae3fdfb562`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:05.416004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-142cb812-32da-40c9-863a-0b5ff2756c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:05.433890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1138/2252] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:05.442171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d95c00-93fa-43ef-be3a-a2531900355b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:05.446248 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-32d95c00-93fa-43ef-be3a-a2531900355b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:05.589359 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d95c00-93fa-43ef-be3a-a2531900355b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:05.599554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e6542-6fe2-460a-bc59-bdac0fe6e3fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:05.600237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e6542-6fe2-460a-bc59-bdac0fe6e3fc service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:05.600537 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e6542-6fe2-460a-bc59-bdac0fe6e3fc service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:05.600806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e6542-6fe2-460a-bc59-bdac0fe6e3fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:05.611356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e6542-6fe2-460a-bc59-bdac0fe6e3fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:05.613699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e6542-6fe2-460a-bc59-bdac0fe6e3fc service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:05.625663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1115/2253] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:06.387244 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27cd5e-ad01-4d21-bd60-03f7c802591e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:06.387751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27cd5e-ad01-4d21-bd60-03f7c802591e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:06.387845 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27cd5e-ad01-4d21-bd60-03f7c802591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:06.410457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0c27cd5e-ad01-4d21-bd60-03f7c802591e None None] MFA Rules not processed for user `c0023517ec494a01a7bc4bae3fdfb562`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:06.412588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0c27cd5e-ad01-4d21-bd60-03f7c802591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:06.428278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1139/2254] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:08.608507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e6542-6fe2-460a-bc59-bdac0fe6e3fc service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:08.610778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6f3e6542-6fe2-460a-bc59-bdac0fe6e3fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:08.809481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e6542-6fe2-460a-bc59-bdac0fe6e3fc service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:08.837646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:08.841795 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:08.844239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:08.844239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] PATH_INFO: `/v3/users/2edeff9a6c70433eb0b0df7b3d05df1e` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:08.849805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2edeff9a6c70433eb0b0df7b3d05df1e)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:08.854916 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:08.866084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:09.024782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2edeff9a6c70433eb0b0df7b3d05df1e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:09.043297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2edeff9a6c70433eb0b0df7b3d05df1e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:09.052547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2edeff9a6c70433eb0b0df7b3d05df1e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:09.081446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2edeff9a6c70433eb0b0df7b3d05df1e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:09.087738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2edeff9a6c70433eb0b0df7b3d05df1e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:09.097410 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1116/2255] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:27:08 2022] DELETE /identity/v3/users/2edeff9a6c70433eb0b0df7b3d05df1e => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:09.102044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3f94f-5da7-4b27-b595-f39513dfe2ab None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:09.102930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3f94f-5da7-4b27-b595-f39513dfe2ab None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:09.103419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3f94f-5da7-4b27-b595-f39513dfe2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:09.154493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e8b3f94f-5da7-4b27-b595-f39513dfe2ab None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:09.156166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e8b3f94f-5da7-4b27-b595-f39513dfe2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:09.334716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1140/2256] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:09.395492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:09.399704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:09.538875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd21c13-6e72-4b93-8b83-3bfad3fbe1e9 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:09.554539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a3a0-c6c0-4412-a04d-fa5c15e28e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:09.555469 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a3a0-c6c0-4412-a04d-fa5c15e28e3e service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:09.555585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a3a0-c6c0-4412-a04d-fa5c15e28e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:09.555978 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a3a0-c6c0-4412-a04d-fa5c15e28e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:09.569153 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084a3a0-c6c0-4412-a04d-fa5c15e28e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:09.570715 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084a3a0-c6c0-4412-a04d-fa5c15e28e3e service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:09.584873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1117/2257] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:10.670782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3f94f-5da7-4b27-b595-f39513dfe2ab None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:10.672945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e8b3f94f-5da7-4b27-b595-f39513dfe2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:10.702527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3f94f-5da7-4b27-b595-f39513dfe2ab None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:10.715268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52747-8bb3-49c2-9565-4297f5cb6035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:10.716264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52747-8bb3-49c2-9565-4297f5cb6035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:10.716623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52747-8bb3-49c2-9565-4297f5cb6035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:10.717519 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52747-8bb3-49c2-9565-4297f5cb6035 admin admin] PATH_INFO: `/v3/projects/ab8f7ea5d382423dbf310f22088c676c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:10.718850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff52747-8bb3-49c2-9565-4297f5cb6035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8f7ea5d382423dbf310f22088c676c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:10.721003 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff52747-8bb3-49c2-9565-4297f5cb6035 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:10.752084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:10.791468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7ff52747-8bb3-49c2-9565-4297f5cb6035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8f7ea5d382423dbf310f22088c676c', 'request_id': 'req-7ff52747-8bb3-49c2-9565-4297f5cb6035'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:10.800734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7ff52747-8bb3-49c2-9565-4297f5cb6035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8f7ea5d382423dbf310f22088c676c', 'request_id': 'req-7ff52747-8bb3-49c2-9565-4297f5cb6035'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:10.810504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7ff52747-8bb3-49c2-9565-4297f5cb6035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8f7ea5d382423dbf310f22088c676c', 'request_id': 'req-7ff52747-8bb3-49c2-9565-4297f5cb6035'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:10.823776 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7ff52747-8bb3-49c2-9565-4297f5cb6035 admin admin] The token cache is being invalidate because project ab8f7ea5d382423dbf310f22088c676c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:10.824392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7ff52747-8bb3-49c2-9565-4297f5cb6035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:10.825186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7ff52747-8bb3-49c2-9565-4297f5cb6035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:10.827102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1141/2258] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:10 2022] DELETE /identity/v3/projects/ab8f7ea5d382423dbf310f22088c676c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:27:10.832066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4b71-e623-40ce-a483-db2cd25b52b6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:10.832538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4b71-e623-40ce-a483-db2cd25b52b6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:10.832644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4b71-e623-40ce-a483-db2cd25b52b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:10.852618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-674c4b71-e623-40ce-a483-db2cd25b52b6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:10.853880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-674c4b71-e623-40ce-a483-db2cd25b52b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:10.939304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1118/2259] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:10.947641 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebd688-2a15-4625-9de3-27a41e55dd13 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:10.948023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebd688-2a15-4625-9de3-27a41e55dd13 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:10.948328 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebd688-2a15-4625-9de3-27a41e55dd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:10.973210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c4b71-e623-40ce-a483-db2cd25b52b6 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:10.973993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-69ebd688-2a15-4625-9de3-27a41e55dd13 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:10.974796 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-674c4b71-e623-40ce-a483-db2cd25b52b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:10.975185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-69ebd688-2a15-4625-9de3-27a41e55dd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:10.983313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1142/2260] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:10.987058 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebd688-2a15-4625-9de3-27a41e55dd13 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:10.987331 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c4b71-e623-40ce-a483-db2cd25b52b6 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:10.992554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae442f1-e0ea-4fee-9b5b-003a4bb2c767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:10.993547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae442f1-e0ea-4fee-9b5b-003a4bb2c767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:10.993829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae442f1-e0ea-4fee-9b5b-003a4bb2c767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:10.994104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae442f1-e0ea-4fee-9b5b-003a4bb2c767 admin admin] PATH_INFO: `/v3/users/7ea4da98b4d34dddb97dca48884fbeb1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:10.995313 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae442f1-e0ea-4fee-9b5b-003a4bb2c767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea4da98b4d34dddb97dca48884fbeb1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:10.996498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebd688-2a15-4625-9de3-27a41e55dd13 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:10.997269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae442f1-e0ea-4fee-9b5b-003a4bb2c767 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:11.001122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07136ee-2a47-4025-8d23-7b1c4768a8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:11.001768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07136ee-2a47-4025-8d23-7b1c4768a8ef admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:11.002057 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07136ee-2a47-4025-8d23-7b1c4768a8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:11.002335 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07136ee-2a47-4025-8d23-7b1c4768a8ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:11.003415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07136ee-2a47-4025-8d23-7b1c4768a8ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:27:11.003415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07136ee-2a47-4025-8d23-7b1c4768a8ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:11.004997 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07136ee-2a47-4025-8d23-7b1c4768a8ef admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:11.019239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1143/2261] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:27:11.023765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07136ee-2a47-4025-8d23-7b1c4768a8ef admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:11.024325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:11.037743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07136ee-2a47-4025-8d23-7b1c4768a8ef admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:11.042919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeb2fc-46e8-44ed-93cb-b0e2756393c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:11.043800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb2fc-46e8-44ed-93cb-b0e2756393c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:11.044141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb2fc-46e8-44ed-93cb-b0e2756393c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:11.044538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb2fc-46e8-44ed-93cb-b0e2756393c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:11.045512 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aeb2fc-46e8-44ed-93cb-b0e2756393c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:11.047855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aeb2fc-46e8-44ed-93cb-b0e2756393c6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:11.057714 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1ae442f1-e0ea-4fee-9b5b-003a4bb2c767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea4da98b4d34dddb97dca48884fbeb1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:11.072723 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1ae442f1-e0ea-4fee-9b5b-003a4bb2c767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea4da98b4d34dddb97dca48884fbeb1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:11.079203 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1144/2262] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:27:11 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:27:11.081761 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1ae442f1-e0ea-4fee-9b5b-003a4bb2c767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea4da98b4d34dddb97dca48884fbeb1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:11.083345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeb2fc-46e8-44ed-93cb-b0e2756393c6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:11.112670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1ae442f1-e0ea-4fee-9b5b-003a4bb2c767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea4da98b4d34dddb97dca48884fbeb1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:11.113464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-1ae442f1-e0ea-4fee-9b5b-003a4bb2c767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea4da98b4d34dddb97dca48884fbeb1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:11.123711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1119/2263] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:27:10 2022] DELETE /identity/v3/users/7ea4da98b4d34dddb97dca48884fbeb1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:27:11.129316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019be654-b46c-44d6-ad41-c3fbdc825b81 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:11.129637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019be654-b46c-44d6-ad41-c3fbdc825b81 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:11.141816 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019be654-b46c-44d6-ad41-c3fbdc825b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:11.189575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-019be654-b46c-44d6-ad41-c3fbdc825b81 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:11.198852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-019be654-b46c-44d6-ad41-c3fbdc825b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:11.200813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeb2fc-46e8-44ed-93cb-b0e2756393c6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:11.291265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738464df-fbd0-46c6-b577-89bb053cd772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:11.292271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738464df-fbd0-46c6-b577-89bb053cd772 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:11.292696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738464df-fbd0-46c6-b577-89bb053cd772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:11.292957 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738464df-fbd0-46c6-b577-89bb053cd772 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:11.294060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738464df-fbd0-46c6-b577-89bb053cd772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:11.297722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738464df-fbd0-46c6-b577-89bb053cd772 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:11.332076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1145/2264] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:27:11 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:27:11.332970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738464df-fbd0-46c6-b577-89bb053cd772 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:11.338112 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-738464df-fbd0-46c6-b577-89bb053cd772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:11.345589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:11.352329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738464df-fbd0-46c6-b577-89bb053cd772 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:11.366473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:11.367446 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:11.369268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:11.369601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] PATH_INFO: `/v3/users/c1c00f56e20b4b02bcd57ae80f5d7004` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:11.371586 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1120/2265] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:11.372629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c00f56e20b4b02bcd57ae80f5d7004)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:11.374350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019be654-b46c-44d6-ad41-c3fbdc825b81 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:11.375682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:11.378805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-019be654-b46c-44d6-ad41-c3fbdc825b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:11.408263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019be654-b46c-44d6-ad41-c3fbdc825b81 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:11.420194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f60e36-12d9-4db8-8a06-4488246a6fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:11.421772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f60e36-12d9-4db8-8a06-4488246a6fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:11.422064 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f60e36-12d9-4db8-8a06-4488246a6fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:11.422347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f60e36-12d9-4db8-8a06-4488246a6fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:11.423095 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f60e36-12d9-4db8-8a06-4488246a6fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:11.425903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f60e36-12d9-4db8-8a06-4488246a6fd3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:11.439820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1121/2266] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:11.442431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f60e36-12d9-4db8-8a06-4488246a6fd3 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:11.446203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-63f60e36-12d9-4db8-8a06-4488246a6fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:11.486918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c00f56e20b4b02bcd57ae80f5d7004'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:11.506171 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c00f56e20b4b02bcd57ae80f5d7004'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:11.521387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f60e36-12d9-4db8-8a06-4488246a6fd3 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:11.524771 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c00f56e20b4b02bcd57ae80f5d7004'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:11.525546 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40340ca-20e8-438a-8f88-7268248d0aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:11.525851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40340ca-20e8-438a-8f88-7268248d0aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:11.526536 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40340ca-20e8-438a-8f88-7268248d0aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:11.526790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40340ca-20e8-438a-8f88-7268248d0aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:11.535677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c00f56e20b4b02bcd57ae80f5d7004'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:11.537588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c00f56e20b4b02bcd57ae80f5d7004'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:11.539254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40340ca-20e8-438a-8f88-7268248d0aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:11.540831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40340ca-20e8-438a-8f88-7268248d0aa9 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:11.545465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1146/2267] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:27:11 2022] DELETE /identity/v3/users/c1c00f56e20b4b02bcd57ae80f5d7004 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:11.546543 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:11.548794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:11.553455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1122/2268] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:11.554919 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feda9a-9ff8-4170-9bff-ad87554c5f15 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:11.555362 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feda9a-9ff8-4170-9bff-ad87554c5f15 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:11.555690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feda9a-9ff8-4170-9bff-ad87554c5f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:11.580518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-50feda9a-9ff8-4170-9bff-ad87554c5f15 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:11.582483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-50feda9a-9ff8-4170-9bff-ad87554c5f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:11.633770 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:11.636475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefedc4c-2ca9-4a7a-ac97-14665fd83ad7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:11.648168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46740254-6747-4c66-8f54-fb979ccb7493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:11.649160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46740254-6747-4c66-8f54-fb979ccb7493 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:11.649441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46740254-6747-4c66-8f54-fb979ccb7493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:11.649890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46740254-6747-4c66-8f54-fb979ccb7493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:11.652537 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46740254-6747-4c66-8f54-fb979ccb7493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:11.659827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46740254-6747-4c66-8f54-fb979ccb7493 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:11.696749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1147/2269] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:11.699112 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46740254-6747-4c66-8f54-fb979ccb7493 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:11.725864 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1123/2270] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:11.737630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feda9a-9ff8-4170-9bff-ad87554c5f15 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:11.739370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-50feda9a-9ff8-4170-9bff-ad87554c5f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:11.739575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46740254-6747-4c66-8f54-fb979ccb7493 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:11.751318 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3023a95-4b26-4871-9741-2c39a2e0fb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:11.752369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023a95-4b26-4871-9741-2c39a2e0fb43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:11.752792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023a95-4b26-4871-9741-2c39a2e0fb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:11.753122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023a95-4b26-4871-9741-2c39a2e0fb43 admin admin] PATH_INFO: `/v3/projects/f74e68bc881a42fca64f109abfc2020b/users/bb0e967f34c0493ea35911abd31586a2/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:11.785524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3023a95-4b26-4871-9741-2c39a2e0fb43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74e68bc881a42fca64f109abfc2020b, user_id=bb0e967f34c0493ea35911abd31586a2, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:11.789556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3023a95-4b26-4871-9741-2c39a2e0fb43 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:11.830410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1148/2271] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:27:11 2022] PUT /identity/v3/projects/f74e68bc881a42fca64f109abfc2020b/users/bb0e967f34c0493ea35911abd31586a2/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:11.851002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deddea1-0ae2-4917-90f5-30433a6debae None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:11.851669 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deddea1-0ae2-4917-90f5-30433a6debae None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:11.851825 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deddea1-0ae2-4917-90f5-30433a6debae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:11.879037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feda9a-9ff8-4170-9bff-ad87554c5f15 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:11.905904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9deddea1-0ae2-4917-90f5-30433a6debae None None] MFA Rules not processed for user `bb0e967f34c0493ea35911abd31586a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:11.907817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9deddea1-0ae2-4917-90f5-30433a6debae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:11.964300 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:11.994682 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fa0ab-a325-426c-97d3-ffc73fdb7a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:11.995472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fa0ab-a325-426c-97d3-ffc73fdb7a5a service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:11.995771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fa0ab-a325-426c-97d3-ffc73fdb7a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:11.996056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fa0ab-a325-426c-97d3-ffc73fdb7a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:12.032212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1149/2272] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:12.045467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deddea1-0ae2-4917-90f5-30433a6debae None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:12.047881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9deddea1-0ae2-4917-90f5-30433a6debae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:12.126944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deddea1-0ae2-4917-90f5-30433a6debae None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:12.130823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37437982-e745-464e-8045-3107a933ce27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:12.131574 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37437982-e745-464e-8045-3107a933ce27 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:12.131813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37437982-e745-464e-8045-3107a933ce27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:12.132096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37437982-e745-464e-8045-3107a933ce27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:12.132804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fa0ab-a325-426c-97d3-ffc73fdb7a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:12.134911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fa0ab-a325-426c-97d3-ffc73fdb7a5a service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:12.143659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37437982-e745-464e-8045-3107a933ce27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:12.146707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37437982-e745-464e-8045-3107a933ce27 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:12.156534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1150/2273] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:12.181526 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1124/2274] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:27:13.075785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37437982-e745-464e-8045-3107a933ce27 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:13.077500 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-37437982-e745-464e-8045-3107a933ce27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:13.103214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37437982-e745-464e-8045-3107a933ce27 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:13.108632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:13.109555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:13.109841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:13.110118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] PATH_INFO: `/v3/projects/2715f9d5854c4c9792daf31771f79b3c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:13.111565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2715f9d5854c4c9792daf31771f79b3c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:13.113579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:13.183445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2715f9d5854c4c9792daf31771f79b3c', 'request_id': 'req-92280f9d-147b-43a7-9d68-1d36cd1262ef'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:13.203089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2715f9d5854c4c9792daf31771f79b3c', 'request_id': 'req-92280f9d-147b-43a7-9d68-1d36cd1262ef'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:13.218552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2715f9d5854c4c9792daf31771f79b3c', 'request_id': 'req-92280f9d-147b-43a7-9d68-1d36cd1262ef'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:13.257417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] The token cache is being invalidate because project 2715f9d5854c4c9792daf31771f79b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:13.260571 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:13.266297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:13.271426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1151/2275] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:13 2022] DELETE /identity/v3/projects/2715f9d5854c4c9792daf31771f79b3c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:13.278619 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800de471-eaa9-4785-9a74-04b092eaa99c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:13.279155 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800de471-eaa9-4785-9a74-04b092eaa99c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:13.279155 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800de471-eaa9-4785-9a74-04b092eaa99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:13.292730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:13.299249 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:13.356455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-800de471-eaa9-4785-9a74-04b092eaa99c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:13.361944 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-800de471-eaa9-4785-9a74-04b092eaa99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:13.434046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:13.482806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92280f9d-147b-43a7-9d68-1d36cd1262ef admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:13.494035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1125/2276] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:13.502564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57aee10-1789-4341-a10e-3cffa4c0de44 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:13.503213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57aee10-1789-4341-a10e-3cffa4c0de44 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:13.503685 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57aee10-1789-4341-a10e-3cffa4c0de44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:13.506296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:13.513237 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:13.513237 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:13.513237 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] PATH_INFO: `/v3/projects/43d2f3deacc943d681cf591054ea09e2` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:13.515260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d2f3deacc943d681cf591054ea09e2)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:13.546407 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:13.551132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:13.581315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b57aee10-1789-4341-a10e-3cffa4c0de44 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:13.582963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b57aee10-1789-4341-a10e-3cffa4c0de44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:13.608315 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1126/2277] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:13.614704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57aee10-1789-4341-a10e-3cffa4c0de44 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:13.627275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57aee10-1789-4341-a10e-3cffa4c0de44 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:13.652349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d2f3deacc943d681cf591054ea09e2', 'request_id': 'req-f1c24bd8-438f-4205-9f10-a16df6b29a7c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:13.664144 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d2f3deacc943d681cf591054ea09e2', 'request_id': 'req-f1c24bd8-438f-4205-9f10-a16df6b29a7c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:13.678310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d2f3deacc943d681cf591054ea09e2', 'request_id': 'req-f1c24bd8-438f-4205-9f10-a16df6b29a7c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:13.721795 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] The token cache is being invalidate because project 43d2f3deacc943d681cf591054ea09e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:13.722044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:13.724805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:13.729584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1152/2278] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:13 2022] DELETE /identity/v3/projects/43d2f3deacc943d681cf591054ea09e2 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:13.739007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c8078-48d8-4671-a444-7059056e5e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:13.747348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c8078-48d8-4671-a444-7059056e5e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:13.747982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c8078-48d8-4671-a444-7059056e5e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:13.748349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c8078-48d8-4671-a444-7059056e5e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:13.749776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c8078-48d8-4671-a444-7059056e5e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:27:13.751912 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c8078-48d8-4671-a444-7059056e5e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:13.758134 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c8078-48d8-4671-a444-7059056e5e99 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:13.804376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:13.806457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1127/2279] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:27:13.808573 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:13.829116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c24bd8-438f-4205-9f10-a16df6b29a7c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:13.840029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88098205-e997-4406-853f-e6d72b9d233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:13.840917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88098205-e997-4406-853f-e6d72b9d233e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:13.841442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88098205-e997-4406-853f-e6d72b9d233e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:13.842314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88098205-e997-4406-853f-e6d72b9d233e admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:13.842919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88098205-e997-4406-853f-e6d72b9d233e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:13.845535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88098205-e997-4406-853f-e6d72b9d233e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:13.946541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c8078-48d8-4671-a444-7059056e5e99 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:13.953200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1153/2280] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:27:13 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:27:13.980625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c8078-48d8-4671-a444-7059056e5e99 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:14.102600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41aee7-71b1-4269-96bc-9f2625c7a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:14.103454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41aee7-71b1-4269-96bc-9f2625c7a110 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:14.103849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41aee7-71b1-4269-96bc-9f2625c7a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:14.104230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41aee7-71b1-4269-96bc-9f2625c7a110 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:14.105104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41aee7-71b1-4269-96bc-9f2625c7a110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:14.107637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41aee7-71b1-4269-96bc-9f2625c7a110 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:14.155448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88098205-e997-4406-853f-e6d72b9d233e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:14.162283 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1128/2281] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:27:13 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:27:14.180789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88098205-e997-4406-853f-e6d72b9d233e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:14.188989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb592e8-53b5-4057-9818-b6c6b4ec8f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:14.189932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb592e8-53b5-4057-9818-b6c6b4ec8f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:14.190410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb592e8-53b5-4057-9818-b6c6b4ec8f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:14.190697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb592e8-53b5-4057-9818-b6c6b4ec8f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:14.191457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb592e8-53b5-4057-9818-b6c6b4ec8f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:14.193430 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb592e8-53b5-4057-9818-b6c6b4ec8f2b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:14.213822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1154/2282] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:14.218024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41aee7-71b1-4269-96bc-9f2625c7a110 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:14.229903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41aee7-71b1-4269-96bc-9f2625c7a110 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:14.237503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223ce2a-2c42-4899-99fc-95a32ed26958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:14.238625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223ce2a-2c42-4899-99fc-95a32ed26958 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:14.239117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223ce2a-2c42-4899-99fc-95a32ed26958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:14.240063 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223ce2a-2c42-4899-99fc-95a32ed26958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:14.241091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223ce2a-2c42-4899-99fc-95a32ed26958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:14.243133 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223ce2a-2c42-4899-99fc-95a32ed26958 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:14.269867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1129/2283] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:14.274475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb592e8-53b5-4057-9818-b6c6b4ec8f2b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:14.286882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb592e8-53b5-4057-9818-b6c6b4ec8f2b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:14.293162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008bfce-5820-4575-a76c-b7e0118be7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:14.293897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008bfce-5820-4575-a76c-b7e0118be7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:14.294183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008bfce-5820-4575-a76c-b7e0118be7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:14.294460 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008bfce-5820-4575-a76c-b7e0118be7e4 admin admin] PATH_INFO: `/v3/projects/e18f2c951a534d5da3ba5eb6cc2847ab/users/a70a40c7593f44bbbcb63d7000ada9b9/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:14.313426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008bfce-5820-4575-a76c-b7e0118be7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18f2c951a534d5da3ba5eb6cc2847ab, user_id=a70a40c7593f44bbbcb63d7000ada9b9, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:14.316156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008bfce-5820-4575-a76c-b7e0118be7e4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:14.330539 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1155/2284] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:27:14 2022] PUT /identity/v3/projects/e18f2c951a534d5da3ba5eb6cc2847ab/users/a70a40c7593f44bbbcb63d7000ada9b9/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:14.335835 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a25a2-537c-4dca-a69e-da4c11a5a716 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:14.336355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a25a2-537c-4dca-a69e-da4c11a5a716 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:14.336717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a25a2-537c-4dca-a69e-da4c11a5a716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:14.360250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-db2a25a2-537c-4dca-a69e-da4c11a5a716 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:14.365319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-db2a25a2-537c-4dca-a69e-da4c11a5a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:14.436648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:14.466141 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1130/2285] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:14.477118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008bfce-5820-4575-a76c-b7e0118be7e4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:14.479288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9008bfce-5820-4575-a76c-b7e0118be7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:14.565259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008bfce-5820-4575-a76c-b7e0118be7e4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:14.570975 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9876b-174e-4543-8c3d-c9dd03f56837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:14.571866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9876b-174e-4543-8c3d-c9dd03f56837 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:14.572189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9876b-174e-4543-8c3d-c9dd03f56837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:14.572462 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9876b-174e-4543-8c3d-c9dd03f56837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:14.584617 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9876b-174e-4543-8c3d-c9dd03f56837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:14.586350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9876b-174e-4543-8c3d-c9dd03f56837 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:14.601117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1156/2286] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:15.719303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a25a2-537c-4dca-a69e-da4c11a5a716 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:15.721448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-db2a25a2-537c-4dca-a69e-da4c11a5a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:15.737013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a25a2-537c-4dca-a69e-da4c11a5a716 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:15.742659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:15.743863 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:15.744367 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:15.744861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] PATH_INFO: `/v3/users/bb0e967f34c0493ea35911abd31586a2` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:15.747075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0e967f34c0493ea35911abd31586a2)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:15.749191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:15.806985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0e967f34c0493ea35911abd31586a2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:15.822426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0e967f34c0493ea35911abd31586a2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:15.831196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0e967f34c0493ea35911abd31586a2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:15.839930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0e967f34c0493ea35911abd31586a2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:15.840680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0e967f34c0493ea35911abd31586a2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:15.849484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1131/2287] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:27:15 2022] DELETE /identity/v3/users/bb0e967f34c0493ea35911abd31586a2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:15.854694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc239db-611e-4ee9-a8a3-472401df308c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:15.855592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc239db-611e-4ee9-a8a3-472401df308c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:15.856184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc239db-611e-4ee9-a8a3-472401df308c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:15.885818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5cc239db-611e-4ee9-a8a3-472401df308c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:15.888200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5cc239db-611e-4ee9-a8a3-472401df308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:15.924359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:15.959946 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1157/2288] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:15.971528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:15.973445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:16.056445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00c455-5a3d-410f-a013-894fb9757027 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:16.060596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc66dd-24c0-43ce-9e9c-b3291b934ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:16.065127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc66dd-24c0-43ce-9e9c-b3291b934ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:16.065127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc66dd-24c0-43ce-9e9c-b3291b934ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:16.065127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc66dd-24c0-43ce-9e9c-b3291b934ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:16.072999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552d466-7a9f-46ff-95c7-f7276c23984f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:16.073594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552d466-7a9f-46ff-95c7-f7276c23984f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:16.074184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552d466-7a9f-46ff-95c7-f7276c23984f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:16.086559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc66dd-24c0-43ce-9e9c-b3291b934ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:16.088862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc66dd-24c0-43ce-9e9c-b3291b934ed6 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:16.115250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1132/2289] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:27:16.118040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8552d466-7a9f-46ff-95c7-f7276c23984f None None] MFA Rules not processed for user `a70a40c7593f44bbbcb63d7000ada9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:16.119812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8552d466-7a9f-46ff-95c7-f7276c23984f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:16.228688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1158/2290] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:27:16.241542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc66dd-24c0-43ce-9e9c-b3291b934ed6 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:16.243446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-18cc66dd-24c0-43ce-9e9c-b3291b934ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:16.347139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc66dd-24c0-43ce-9e9c-b3291b934ed6 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:16.352864 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834eaa2-8dbc-4372-8473-487cd62b5e08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:16.353778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834eaa2-8dbc-4372-8473-487cd62b5e08 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:16.354217 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834eaa2-8dbc-4372-8473-487cd62b5e08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:16.354714 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834eaa2-8dbc-4372-8473-487cd62b5e08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:16.375934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834eaa2-8dbc-4372-8473-487cd62b5e08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:16.377788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834eaa2-8dbc-4372-8473-487cd62b5e08 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:16.398729 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1133/2291] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:16.601472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552d466-7a9f-46ff-95c7-f7276c23984f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:16.618092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8552d466-7a9f-46ff-95c7-f7276c23984f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:16.638722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552d466-7a9f-46ff-95c7-f7276c23984f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:16.651683 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:16.652577 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:16.652851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:16.653341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1 admin admin] PATH_INFO: `/v3/projects/f74e68bc881a42fca64f109abfc2020b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:16.655763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74e68bc881a42fca64f109abfc2020b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:16.659473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:16.784394 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74e68bc881a42fca64f109abfc2020b', 'request_id': 'req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:16.799825 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74e68bc881a42fca64f109abfc2020b', 'request_id': 'req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:16.822147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74e68bc881a42fca64f109abfc2020b', 'request_id': 'req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:16.844047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1 admin admin] The token cache is being invalidate because project f74e68bc881a42fca64f109abfc2020b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:16.844412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:16.845256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-50a5e37b-725a-4b0b-9e51-afd2428fd0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:16.851795 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1159/2292] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:16 2022] DELETE /identity/v3/projects/f74e68bc881a42fca64f109abfc2020b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:16.855498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3bb3f-821d-4ff6-bbe6-7c4303895e63 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:16.856016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3bb3f-821d-4ff6-bbe6-7c4303895e63 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:16.856116 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3bb3f-821d-4ff6-bbe6-7c4303895e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:16.866959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:16.906325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-53d3bb3f-821d-4ff6-bbe6-7c4303895e63 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:16.908173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-53d3bb3f-821d-4ff6-bbe6-7c4303895e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:17.019089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1134/2293] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:17.027162 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8acbe-601a-480d-9ce3-3e9280658502 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:17.027754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8acbe-601a-480d-9ce3-3e9280658502 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:17.027754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8acbe-601a-480d-9ce3-3e9280658502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:17.073701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8de8acbe-601a-480d-9ce3-3e9280658502 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:17.075559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8de8acbe-601a-480d-9ce3-3e9280658502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:17.084629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1160/2294] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:27:17.089973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3bb3f-821d-4ff6-bbe6-7c4303895e63 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:17.101836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3bb3f-821d-4ff6-bbe6-7c4303895e63 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:17.107645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cb0ed-191d-4459-998e-ce8b0bb09ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:17.108511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cb0ed-191d-4459-998e-ce8b0bb09ded admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:17.108871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cb0ed-191d-4459-998e-ce8b0bb09ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:17.109271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cb0ed-191d-4459-998e-ce8b0bb09ded admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:17.110100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cb0ed-191d-4459-998e-ce8b0bb09ded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:27:17.110486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cb0ed-191d-4459-998e-ce8b0bb09ded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:17.112404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cb0ed-191d-4459-998e-ce8b0bb09ded admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:17.127230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1135/2295] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:27:17.133970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8acbe-601a-480d-9ce3-3e9280658502 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:17.150440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8acbe-601a-480d-9ce3-3e9280658502 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:17.156762 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102bc03-897e-4469-b74e-31d4a7607fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:17.157451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102bc03-897e-4469-b74e-31d4a7607fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:17.157736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102bc03-897e-4469-b74e-31d4a7607fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:17.158020 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102bc03-897e-4469-b74e-31d4a7607fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:17.158723 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102bc03-897e-4469-b74e-31d4a7607fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:17.160636 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102bc03-897e-4469-b74e-31d4a7607fa9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:17.188646 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1161/2296] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:27:17 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:27:17.193339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cb0ed-191d-4459-998e-ce8b0bb09ded admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:17.204746 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cb0ed-191d-4459-998e-ce8b0bb09ded admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:17.268037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c42bf3-dfd1-4b84-81bf-1de83f8d07d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:17.268440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c42bf3-dfd1-4b84-81bf-1de83f8d07d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:17.269040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c42bf3-dfd1-4b84-81bf-1de83f8d07d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:17.269603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c42bf3-dfd1-4b84-81bf-1de83f8d07d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:17.271769 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c42bf3-dfd1-4b84-81bf-1de83f8d07d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:17.275659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c42bf3-dfd1-4b84-81bf-1de83f8d07d8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:17.305625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1136/2297] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:27:17 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:27:17.306803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102bc03-897e-4469-b74e-31d4a7607fa9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:17.323141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102bc03-897e-4469-b74e-31d4a7607fa9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:17.328327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eb552-5686-4073-be3b-f13d7d89620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:17.329002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eb552-5686-4073-be3b-f13d7d89620b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:17.329323 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eb552-5686-4073-be3b-f13d7d89620b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:17.329603 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eb552-5686-4073-be3b-f13d7d89620b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:17.330405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8eb552-5686-4073-be3b-f13d7d89620b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:17.332031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8eb552-5686-4073-be3b-f13d7d89620b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:17.350152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1162/2298] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:17.351677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c42bf3-dfd1-4b84-81bf-1de83f8d07d8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:17.365926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c42bf3-dfd1-4b84-81bf-1de83f8d07d8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:17.372117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b03fd-9009-4b7a-9284-2dd739a62e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:17.372896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b03fd-9009-4b7a-9284-2dd739a62e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:17.373271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b03fd-9009-4b7a-9284-2dd739a62e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:17.373602 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b03fd-9009-4b7a-9284-2dd739a62e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:17.374410 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b03fd-9009-4b7a-9284-2dd739a62e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:17.376347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b03fd-9009-4b7a-9284-2dd739a62e4f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:17.389932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1137/2299] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:17.394860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eb552-5686-4073-be3b-f13d7d89620b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:17.408889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eb552-5686-4073-be3b-f13d7d89620b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:17.415350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6557e36-5f93-40c0-b587-80528549d33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:17.416787 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6557e36-5f93-40c0-b587-80528549d33a admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:17.417155 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6557e36-5f93-40c0-b587-80528549d33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:17.417440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6557e36-5f93-40c0-b587-80528549d33a admin admin] PATH_INFO: `/v3/projects/7e9d06b7bdac4815bd2b22c73288ad3e/users/091f004b22da448a872d1cb28ab02f33/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:17.428720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:17.443806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6557e36-5f93-40c0-b587-80528549d33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9d06b7bdac4815bd2b22c73288ad3e, user_id=091f004b22da448a872d1cb28ab02f33, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:17.443806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6557e36-5f93-40c0-b587-80528549d33a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:17.462767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1163/2300] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:27:17 2022] PUT /identity/v3/projects/7e9d06b7bdac4815bd2b22c73288ad3e/users/091f004b22da448a872d1cb28ab02f33/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:17.473832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09956fb9-34f7-44cf-beab-d59d78143146 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:17.474138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09956fb9-34f7-44cf-beab-d59d78143146 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:17.474523 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09956fb9-34f7-44cf-beab-d59d78143146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:17.519375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-09956fb9-34f7-44cf-beab-d59d78143146 None None] MFA Rules not processed for user `091f004b22da448a872d1cb28ab02f33`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:17.521304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-09956fb9-34f7-44cf-beab-d59d78143146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:17.612940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:17.623826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1138/2301] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:17.635446 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6557e36-5f93-40c0-b587-80528549d33a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:17.637466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a6557e36-5f93-40c0-b587-80528549d33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:17.701690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6557e36-5f93-40c0-b587-80528549d33a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:17.705523 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c33d88-9907-4c84-a0b2-9989bc1a5200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:17.706184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c33d88-9907-4c84-a0b2-9989bc1a5200 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:17.706473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c33d88-9907-4c84-a0b2-9989bc1a5200 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:17.706756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c33d88-9907-4c84-a0b2-9989bc1a5200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:17.716548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c33d88-9907-4c84-a0b2-9989bc1a5200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:17.718009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c33d88-9907-4c84-a0b2-9989bc1a5200 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:17.730078 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1164/2302] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:17.942350 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321decb0-0cac-4fe1-a056-ecebf85b57c2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:17.944285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321decb0-0cac-4fe1-a056-ecebf85b57c2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:17.944988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321decb0-0cac-4fe1-a056-ecebf85b57c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:17.972668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-321decb0-0cac-4fe1-a056-ecebf85b57c2 None None] MFA Rules not processed for user `a70a40c7593f44bbbcb63d7000ada9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:17.974729 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-321decb0-0cac-4fe1-a056-ecebf85b57c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:18.051828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1139/2303] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:24.865796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e9d71-6827-425a-b0b4-190442763ab5 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:24.866639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e9d71-6827-425a-b0b4-190442763ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:24.866765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e9d71-6827-425a-b0b4-190442763ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:24.902907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-397e9d71-6827-425a-b0b4-190442763ab5 None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:24.905804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-397e9d71-6827-425a-b0b4-190442763ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:25.130361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1165/2304] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:27:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:25.210020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321decb0-0cac-4fe1-a056-ecebf85b57c2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:25.212159 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-321decb0-0cac-4fe1-a056-ecebf85b57c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:25.297646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321decb0-0cac-4fe1-a056-ecebf85b57c2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:25.302819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03160e5-0265-4d5f-934d-483397d5d4fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:25.303478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03160e5-0265-4d5f-934d-483397d5d4fa service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:25.303760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03160e5-0265-4d5f-934d-483397d5d4fa service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:25.304042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03160e5-0265-4d5f-934d-483397d5d4fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:25.313740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03160e5-0265-4d5f-934d-483397d5d4fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:25.315368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03160e5-0265-4d5f-934d-483397d5d4fa service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:25.325594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1140/2305] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:27:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:27:26.299747 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76a491-3e03-4508-b28c-8ee869858011 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:26.300963 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76a491-3e03-4508-b28c-8ee869858011 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:26.302161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76a491-3e03-4508-b28c-8ee869858011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:26.325724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ee76a491-3e03-4508-b28c-8ee869858011 None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:26.327475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ee76a491-3e03-4508-b28c-8ee869858011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:26.350678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03160e5-0265-4d5f-934d-483397d5d4fa service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:26.359067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1166/2306] 10.222.0.64 () {58 vars in 967 bytes} [Fri Jul 15 15:27:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:26.365421 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03160e5-0265-4d5f-934d-483397d5d4fa service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:26.373039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266a15c-50bd-421f-b267-ba9662eb131b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:26.373900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266a15c-50bd-421f-b267-ba9662eb131b service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:26.374495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266a15c-50bd-421f-b267-ba9662eb131b service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:26.375210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266a15c-50bd-421f-b267-ba9662eb131b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:26.387844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266a15c-50bd-421f-b267-ba9662eb131b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:26.390322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266a15c-50bd-421f-b267-ba9662eb131b service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:26.404667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1141/2307] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:27:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 15:27:26.739506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391ba99-df5b-4207-ba85-677d3f1f6fd9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:26.739768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391ba99-df5b-4207-ba85-677d3f1f6fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:26.740882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391ba99-df5b-4207-ba85-677d3f1f6fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:26.770251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e391ba99-df5b-4207-ba85-677d3f1f6fd9 None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:26.772374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e391ba99-df5b-4207-ba85-677d3f1f6fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:26.788179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1167/2308] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:27:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:26.817101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266a15c-50bd-421f-b267-ba9662eb131b service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:26.836308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266a15c-50bd-421f-b267-ba9662eb131b service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:26.857625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd38d81-6ea0-4cba-b6af-6f483ecbc9a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:26.859560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd38d81-6ea0-4cba-b6af-6f483ecbc9a1 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:26.860002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd38d81-6ea0-4cba-b6af-6f483ecbc9a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:26.860290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd38d81-6ea0-4cba-b6af-6f483ecbc9a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:26.893337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd38d81-6ea0-4cba-b6af-6f483ecbc9a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:26.895545 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd38d81-6ea0-4cba-b6af-6f483ecbc9a1 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:26.910112 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1142/2309] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:27:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:27:27.399947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0985b-c956-408e-970a-29a8e2515bbb None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:27.400534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0985b-c956-408e-970a-29a8e2515bbb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:27.400731 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0985b-c956-408e-970a-29a8e2515bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:27.423668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6bf0985b-c956-408e-970a-29a8e2515bbb None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:27.425404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6bf0985b-c956-408e-970a-29a8e2515bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:27.433354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1168/2310] 10.222.0.64 () {58 vars in 967 bytes} [Fri Jul 15 15:27:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:27.450986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd38d81-6ea0-4cba-b6af-6f483ecbc9a1 service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:27.464051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd38d81-6ea0-4cba-b6af-6f483ecbc9a1 service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:27.471259 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b546154-a6f3-4c39-a33f-7fb8864d86b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:27.471940 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b546154-a6f3-4c39-a33f-7fb8864d86b3 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:27.472236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b546154-a6f3-4c39-a33f-7fb8864d86b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:27.472519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b546154-a6f3-4c39-a33f-7fb8864d86b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:27.482082 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b546154-a6f3-4c39-a33f-7fb8864d86b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:27.483797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b546154-a6f3-4c39-a33f-7fb8864d86b3 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:27.495258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1143/2311] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:27:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:27:29.905737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0985b-c956-408e-970a-29a8e2515bbb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:29.907239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6bf0985b-c956-408e-970a-29a8e2515bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:29.988111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0985b-c956-408e-970a-29a8e2515bbb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:29.994655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:29.995626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:29.995849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:29.996186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] PATH_INFO: `/v3/users/5eeeb408cc7944dd9b71a6d333e6687e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:29.997559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eeeb408cc7944dd9b71a6d333e6687e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:29.999929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:30.020188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:30.067645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eeeb408cc7944dd9b71a6d333e6687e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.084276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eeeb408cc7944dd9b71a6d333e6687e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.103070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eeeb408cc7944dd9b71a6d333e6687e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.120252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eeeb408cc7944dd9b71a6d333e6687e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.121322 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eeeb408cc7944dd9b71a6d333e6687e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.145163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1169/2312] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:27:29 2022] DELETE /identity/v3/users/5eeeb408cc7944dd9b71a6d333e6687e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:30.150074 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3aa71-7f95-4d65-88c2-8a1a3836f0af None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:30.151052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3aa71-7f95-4d65-88c2-8a1a3836f0af None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:30.152269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3aa71-7f95-4d65-88c2-8a1a3836f0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:30.190355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-23a3aa71-7f95-4d65-88c2-8a1a3836f0af None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:30.194009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-23a3aa71-7f95-4d65-88c2-8a1a3836f0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:30.229468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:30.231296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:30.284848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:30.307090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1144/2313] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:30.320292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3aa71-7f95-4d65-88c2-8a1a3836f0af None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:30.321280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-23a3aa71-7f95-4d65-88c2-8a1a3836f0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:30.346539 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088469a-4d49-4698-9349-028f75f0524d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:30.353197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:30.354338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:30.354467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:30.354644 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] PATH_INFO: `/v3/users/091f004b22da448a872d1cb28ab02f33` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:30.357012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091f004b22da448a872d1cb28ab02f33)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:30.359629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:30.394922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3aa71-7f95-4d65-88c2-8a1a3836f0af None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:30.399804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b4e7e-b914-4130-8478-07ab5ce124b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:30.400479 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b4e7e-b914-4130-8478-07ab5ce124b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:30.400771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b4e7e-b914-4130-8478-07ab5ce124b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:30.401271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b4e7e-b914-4130-8478-07ab5ce124b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:30.412593 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b4e7e-b914-4130-8478-07ab5ce124b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:30.414266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b4e7e-b914-4130-8478-07ab5ce124b6 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:30.425258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1145/2314] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:30.429627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091f004b22da448a872d1cb28ab02f33'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.451792 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091f004b22da448a872d1cb28ab02f33'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.460171 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091f004b22da448a872d1cb28ab02f33'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.474622 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091f004b22da448a872d1cb28ab02f33'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.475333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091f004b22da448a872d1cb28ab02f33'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.485328 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1170/2315] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:27:30 2022] DELETE /identity/v3/users/091f004b22da448a872d1cb28ab02f33 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:27:30.490539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4fe33-0506-468b-b580-c2ec50ae892f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:30.491140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4fe33-0506-468b-b580-c2ec50ae892f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:30.491496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4fe33-0506-468b-b580-c2ec50ae892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:30.510775 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-24e4fe33-0506-468b-b580-c2ec50ae892f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:30.513033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-24e4fe33-0506-468b-b580-c2ec50ae892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:30.596296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1146/2316] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:30.621363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:30.624542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:30.651595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:30.685987 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4fe33-0506-468b-b580-c2ec50ae892f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:30.688100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-24e4fe33-0506-468b-b580-c2ec50ae892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:30.705092 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4fe33-0506-468b-b580-c2ec50ae892f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:30.712930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72bc2-8532-4673-9171-8faa08150913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:30.713946 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72bc2-8532-4673-9171-8faa08150913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:30.714338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72bc2-8532-4673-9171-8faa08150913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:30.714720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72bc2-8532-4673-9171-8faa08150913 admin admin] PATH_INFO: `/v3/projects/66865b40b26142948b152ae28028b762` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:30.716782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72bc2-8532-4673-9171-8faa08150913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66865b40b26142948b152ae28028b762)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:30.720464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72bc2-8532-4673-9171-8faa08150913 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:30.771087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326828fd-7652-4f1f-8065-dbc411a7ae57 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:30.781828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-faa72bc2-8532-4673-9171-8faa08150913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66865b40b26142948b152ae28028b762', 'request_id': 'req-faa72bc2-8532-4673-9171-8faa08150913'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.793404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-faa72bc2-8532-4673-9171-8faa08150913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66865b40b26142948b152ae28028b762', 'request_id': 'req-faa72bc2-8532-4673-9171-8faa08150913'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.802567 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-faa72bc2-8532-4673-9171-8faa08150913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66865b40b26142948b152ae28028b762', 'request_id': 'req-faa72bc2-8532-4673-9171-8faa08150913'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.818120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-faa72bc2-8532-4673-9171-8faa08150913 admin admin] The token cache is being invalidate because project 66865b40b26142948b152ae28028b762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:30.818679 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-faa72bc2-8532-4673-9171-8faa08150913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.819713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-faa72bc2-8532-4673-9171-8faa08150913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:30.825435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1147/2317] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:30 2022] DELETE /identity/v3/projects/66865b40b26142948b152ae28028b762 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:27:30.828370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217669a-4de3-4b25-9957-4cfe3c658f05 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:30.828784 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217669a-4de3-4b25-9957-4cfe3c658f05 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:30.829255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217669a-4de3-4b25-9957-4cfe3c658f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:30.831153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c318d-178d-4504-b260-f769f5a61854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:30.832043 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c318d-178d-4504-b260-f769f5a61854 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:30.832489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c318d-178d-4504-b260-f769f5a61854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:30.833498 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c318d-178d-4504-b260-f769f5a61854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:30.835429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eb5c318d-178d-4504-b260-f769f5a61854 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:30.860441 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8217669a-4de3-4b25-9957-4cfe3c658f05 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:30.861965 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8217669a-4de3-4b25-9957-4cfe3c658f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:30.880317 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:30.906580 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c318d-178d-4504-b260-f769f5a61854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:30.908277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c318d-178d-4504-b260-f769f5a61854 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:30.920858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1171/2318] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:30.940995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1148/2319] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:27:30.949279 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94307b-c1cc-4ea5-8274-f928b9483a57 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:30.949597 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94307b-c1cc-4ea5-8274-f928b9483a57 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:30.949889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94307b-c1cc-4ea5-8274-f928b9483a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:30.970828 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3e94307b-c1cc-4ea5-8274-f928b9483a57 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:30.972062 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3e94307b-c1cc-4ea5-8274-f928b9483a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:30.987383 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1172/2320] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:30.989932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217669a-4de3-4b25-9957-4cfe3c658f05 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:31.003686 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217669a-4de3-4b25-9957-4cfe3c658f05 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:31.008997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bfcd1-16ad-42d1-b192-5fbf43f90f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:31.010124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bfcd1-16ad-42d1-b192-5fbf43f90f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.010124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bfcd1-16ad-42d1-b192-5fbf43f90f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.010423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bfcd1-16ad-42d1-b192-5fbf43f90f69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.011855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bfcd1-16ad-42d1-b192-5fbf43f90f69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:27:31.012179 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bfcd1-16ad-42d1-b192-5fbf43f90f69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:31.013993 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bfcd1-16ad-42d1-b192-5fbf43f90f69 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:31.033108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddeea7-0650-4fb6-936d-35a777aa07e6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.033108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddeea7-0650-4fb6-936d-35a777aa07e6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.033108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddeea7-0650-4fb6-936d-35a777aa07e6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.033108 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1173/2321] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:27:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:27:31.033678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1149/2322] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:27:31.034631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddeea7-0650-4fb6-936d-35a777aa07e6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:31.050906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddeea7-0650-4fb6-936d-35a777aa07e6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:31.055951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c588c52-0ed0-47e2-a55b-ca8b6550806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:31.057111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c588c52-0ed0-47e2-a55b-ca8b6550806e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.057302 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c588c52-0ed0-47e2-a55b-ca8b6550806e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.057667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c588c52-0ed0-47e2-a55b-ca8b6550806e admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.058917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c588c52-0ed0-47e2-a55b-ca8b6550806e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:31.060573 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c588c52-0ed0-47e2-a55b-ca8b6550806e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:31.067251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e092b-f41a-4301-bcf5-4eb77534de6a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.067549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e092b-f41a-4301-bcf5-4eb77534de6a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.067838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e092b-f41a-4301-bcf5-4eb77534de6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.093472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-542e092b-f41a-4301-bcf5-4eb77534de6a None None] MFA Rules not processed for user `3ba61318896f43e5a68e80f38ae5f3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:31.095258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-542e092b-f41a-4301-bcf5-4eb77534de6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:31.115113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1174/2323] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:27:31 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:27:31.117262 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c588c52-0ed0-47e2-a55b-ca8b6550806e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:31.186088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1150/2324] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:27:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:27:31.188504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:31.205474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c588c52-0ed0-47e2-a55b-ca8b6550806e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:31.212177 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17366058-17d8-4454-a3af-7657980f2e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:31.212865 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17366058-17d8-4454-a3af-7657980f2e2c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.213209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17366058-17d8-4454-a3af-7657980f2e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.213455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17366058-17d8-4454-a3af-7657980f2e2c admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.214382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17366058-17d8-4454-a3af-7657980f2e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:31.216362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17366058-17d8-4454-a3af-7657980f2e2c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:31.230059 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e092b-f41a-4301-bcf5-4eb77534de6a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:31.231725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-542e092b-f41a-4301-bcf5-4eb77534de6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:31.244382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1175/2325] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:27:31 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:27:31.249801 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e092b-f41a-4301-bcf5-4eb77534de6a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:31.255812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17366058-17d8-4454-a3af-7657980f2e2c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:31.276553 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17366058-17d8-4454-a3af-7657980f2e2c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:31.287571 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090b4fa-b8a6-41f8-9e02-70fe08b060b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:31.288382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090b4fa-b8a6-41f8-9e02-70fe08b060b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.288778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090b4fa-b8a6-41f8-9e02-70fe08b060b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.289223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090b4fa-b8a6-41f8-9e02-70fe08b060b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.290071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090b4fa-b8a6-41f8-9e02-70fe08b060b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:31.292448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090b4fa-b8a6-41f8-9e02-70fe08b060b2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:31.307375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1176/2326] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:31.311208 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090b4fa-b8a6-41f8-9e02-70fe08b060b2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:31.313008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f090b4fa-b8a6-41f8-9e02-70fe08b060b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:31.327618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090b4fa-b8a6-41f8-9e02-70fe08b060b2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:31.333202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:31.334176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.334537 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.334895 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] PATH_INFO: `/v3/users/559354ede14a42f78e03f5bf3f1b3af3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.336154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=559354ede14a42f78e03f5bf3f1b3af3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:31.338175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:31.377923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17989a9e-d77d-4841-b270-07a02f986928 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba61318896f43e5a68e80f38ae5f3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:31.378589 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17989a9e-d77d-4841-b270-07a02f986928 service placement] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.378882 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17989a9e-d77d-4841-b270-07a02f986928 service placement] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.379178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17989a9e-d77d-4841-b270-07a02f986928 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.391714 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17989a9e-d77d-4841-b270-07a02f986928 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:31.394211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17989a9e-d77d-4841-b270-07a02f986928 service placement] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:31.406368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559354ede14a42f78e03f5bf3f1b3af3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.407115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1151/2327] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:31.407935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17989a9e-d77d-4841-b270-07a02f986928 service placement] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:31.409489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-17989a9e-d77d-4841-b270-07a02f986928 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:31.422461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559354ede14a42f78e03f5bf3f1b3af3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.429905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17989a9e-d77d-4841-b270-07a02f986928 service placement] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:31.435721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:31.436796 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.437195 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.437565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] PATH_INFO: `/v3/projects/7e9d06b7bdac4815bd2b22c73288ad3e` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.438935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e9d06b7bdac4815bd2b22c73288ad3e)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:31.440963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:31.451336 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559354ede14a42f78e03f5bf3f1b3af3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.459740 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559354ede14a42f78e03f5bf3f1b3af3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.460670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559354ede14a42f78e03f5bf3f1b3af3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.470174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1177/2328] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:27:31 2022] DELETE /identity/v3/users/559354ede14a42f78e03f5bf3f1b3af3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:31.474077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:31.474077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:31.495644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:31.532690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e9d06b7bdac4815bd2b22c73288ad3e', 'request_id': 'req-f918e767-dcae-495e-94b9-2a9b76028bb8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.545386 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e9d06b7bdac4815bd2b22c73288ad3e', 'request_id': 'req-f918e767-dcae-495e-94b9-2a9b76028bb8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.563573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e9d06b7bdac4815bd2b22c73288ad3e', 'request_id': 'req-f918e767-dcae-495e-94b9-2a9b76028bb8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.586095 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] The token cache is being invalidate because project 7e9d06b7bdac4815bd2b22c73288ad3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:31.586482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.587367 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.589845 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1152/2329] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:31 2022] DELETE /identity/v3/projects/7e9d06b7bdac4815bd2b22c73288ad3e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:31.607494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c4c3c-5842-4509-a488-1ab169b7b1bb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:31.667440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:31.687384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52bf8c-b7ca-47c6-a9b3-5e8822fc6cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:31.688101 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52bf8c-b7ca-47c6-a9b3-5e8822fc6cac admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.688393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52bf8c-b7ca-47c6-a9b3-5e8822fc6cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.688676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52bf8c-b7ca-47c6-a9b3-5e8822fc6cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.689529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52bf8c-b7ca-47c6-a9b3-5e8822fc6cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:31.691515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52bf8c-b7ca-47c6-a9b3-5e8822fc6cac admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:31.704475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1178/2330] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:31.711909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:31.713252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:31.728659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918e767-dcae-495e-94b9-2a9b76028bb8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:31.735118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74146d2-ae52-4a4d-a0b7-5e183f8ee43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:31.736107 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74146d2-ae52-4a4d-a0b7-5e183f8ee43d admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.736400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74146d2-ae52-4a4d-a0b7-5e183f8ee43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.736682 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74146d2-ae52-4a4d-a0b7-5e183f8ee43d admin admin] PATH_INFO: `/v3/projects/e3415881308b4956bcaf39334c5f4d76/users/8b34dc9595cb45a993f2ad47a23d639b/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.764733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74146d2-ae52-4a4d-a0b7-5e183f8ee43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3415881308b4956bcaf39334c5f4d76, user_id=8b34dc9595cb45a993f2ad47a23d639b, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:31.767920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74146d2-ae52-4a4d-a0b7-5e183f8ee43d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:31.774200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52bf8c-b7ca-47c6-a9b3-5e8822fc6cac admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:31.777121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1e52bf8c-b7ca-47c6-a9b3-5e8822fc6cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:31.804525 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1153/2331] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:27:31 2022] PUT /identity/v3/projects/e3415881308b4956bcaf39334c5f4d76/users/8b34dc9595cb45a993f2ad47a23d639b/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:27:31.805419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52bf8c-b7ca-47c6-a9b3-5e8822fc6cac admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:31.810033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087345b-935a-41c2-ba59-eb45ba5b0ccd None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.810538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087345b-935a-41c2-ba59-eb45ba5b0ccd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.810892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087345b-935a-41c2-ba59-eb45ba5b0ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.837333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e087345b-935a-41c2-ba59-eb45ba5b0ccd None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:31.838774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e087345b-935a-41c2-ba59-eb45ba5b0ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:31.900036 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:31.900999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:31.901417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:31.901707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] PATH_INFO: `/v3/projects/11ec68dbde0344d692eafefcc01719d5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:31.902966 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ec68dbde0344d692eafefcc01719d5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:31.904098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1154/2332] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:27:31.905169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:31.914393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087345b-935a-41c2-ba59-eb45ba5b0ccd None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:31.915789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e087345b-935a-41c2-ba59-eb45ba5b0ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:31.955798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ec68dbde0344d692eafefcc01719d5', 'request_id': 'req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.964698 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ec68dbde0344d692eafefcc01719d5', 'request_id': 'req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.975495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ec68dbde0344d692eafefcc01719d5', 'request_id': 'req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.980396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087345b-935a-41c2-ba59-eb45ba5b0ccd None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:31.986379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] The token cache is being invalidate because project 11ec68dbde0344d692eafefcc01719d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:31.986679 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.987340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:31.988968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1179/2333] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:31 2022] DELETE /identity/v3/projects/11ec68dbde0344d692eafefcc01719d5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:31.993356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:31.994714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:32.028725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:32.034384 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551f723-979e-48dd-9393-3e7ab169313f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:32.035034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551f723-979e-48dd-9393-3e7ab169313f service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:32.036289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551f723-979e-48dd-9393-3e7ab169313f service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:32.036435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551f723-979e-48dd-9393-3e7ab169313f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:32.039673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1551f723-979e-48dd-9393-3e7ab169313f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:32.068897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0912ed-1c46-4d66-98d5-bb2a65bbce5d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:32.076866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed061b6-4b94-46ab-a50a-f8db35b27fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:32.078220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed061b6-4b94-46ab-a50a-f8db35b27fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:32.078640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed061b6-4b94-46ab-a50a-f8db35b27fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:32.079890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed061b6-4b94-46ab-a50a-f8db35b27fff admin admin] PATH_INFO: `/v3/users/b90836f4c8b6442bb548c341561b6327` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:32.081972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed061b6-4b94-46ab-a50a-f8db35b27fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90836f4c8b6442bb548c341561b6327)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:32.085407 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed061b6-4b94-46ab-a50a-f8db35b27fff admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:32.110222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:32.116533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551f723-979e-48dd-9393-3e7ab169313f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:32.118090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551f723-979e-48dd-9393-3e7ab169313f service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:32.130779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1155/2334] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:27:32.152664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4ed061b6-4b94-46ab-a50a-f8db35b27fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90836f4c8b6442bb548c341561b6327'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:32.166799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4ed061b6-4b94-46ab-a50a-f8db35b27fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90836f4c8b6442bb548c341561b6327'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:32.174989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4ed061b6-4b94-46ab-a50a-f8db35b27fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90836f4c8b6442bb548c341561b6327'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:32.184533 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4ed061b6-4b94-46ab-a50a-f8db35b27fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90836f4c8b6442bb548c341561b6327'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:32.185297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4ed061b6-4b94-46ab-a50a-f8db35b27fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90836f4c8b6442bb548c341561b6327'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:32.195053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1180/2335] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:27:31 2022] DELETE /identity/v3/users/b90836f4c8b6442bb548c341561b6327 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:27:32.472268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551f723-979e-48dd-9393-3e7ab169313f service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:32.483075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551f723-979e-48dd-9393-3e7ab169313f service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:32.624109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c03f87-b08b-4f38-9353-a5624100052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:32.625738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03f87-b08b-4f38-9353-a5624100052a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:32.626361 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03f87-b08b-4f38-9353-a5624100052a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:32.626735 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03f87-b08b-4f38-9353-a5624100052a admin admin] PATH_INFO: `/v3/projects/d19bfa0371874eb08626fdad3bc1ae7b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:32.628957 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c03f87-b08b-4f38-9353-a5624100052a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19bfa0371874eb08626fdad3bc1ae7b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:32.633573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c03f87-b08b-4f38-9353-a5624100052a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:32.739636 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-81c03f87-b08b-4f38-9353-a5624100052a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19bfa0371874eb08626fdad3bc1ae7b', 'request_id': 'req-81c03f87-b08b-4f38-9353-a5624100052a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:32.757637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-81c03f87-b08b-4f38-9353-a5624100052a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19bfa0371874eb08626fdad3bc1ae7b', 'request_id': 'req-81c03f87-b08b-4f38-9353-a5624100052a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:32.774449 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-81c03f87-b08b-4f38-9353-a5624100052a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19bfa0371874eb08626fdad3bc1ae7b', 'request_id': 'req-81c03f87-b08b-4f38-9353-a5624100052a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:32.792848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-81c03f87-b08b-4f38-9353-a5624100052a admin admin] The token cache is being invalidate because project d19bfa0371874eb08626fdad3bc1ae7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:32.793323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-81c03f87-b08b-4f38-9353-a5624100052a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:32.793995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-81c03f87-b08b-4f38-9353-a5624100052a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:32.799396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1156/2336] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:32 2022] DELETE /identity/v3/projects/d19bfa0371874eb08626fdad3bc1ae7b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:32.800940 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932165a-46b6-4467-95a4-19e884a3467f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:32.801295 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932165a-46b6-4467-95a4-19e884a3467f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:32.801590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932165a-46b6-4467-95a4-19e884a3467f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:32.826768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d932165a-46b6-4467-95a4-19e884a3467f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:32.828992 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d932165a-46b6-4467-95a4-19e884a3467f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:32.927102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1181/2337] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:27:32.935149 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11304b-77d4-4518-b87d-58e1c024ed77 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:32.935449 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11304b-77d4-4518-b87d-58e1c024ed77 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:32.935730 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11304b-77d4-4518-b87d-58e1c024ed77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:32.960508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3d11304b-77d4-4518-b87d-58e1c024ed77 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:32.962037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3d11304b-77d4-4518-b87d-58e1c024ed77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:32.970657 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1157/2338] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:32.975743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932165a-46b6-4467-95a4-19e884a3467f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:32.987492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932165a-46b6-4467-95a4-19e884a3467f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:32.997097 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4891a6-9815-4e2e-9cb0-4d65fdb3387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:32.998114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4891a6-9815-4e2e-9cb0-4d65fdb3387f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:32.998638 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4891a6-9815-4e2e-9cb0-4d65fdb3387f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:32.999283 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4891a6-9815-4e2e-9cb0-4d65fdb3387f admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:33.000331 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4891a6-9815-4e2e-9cb0-4d65fdb3387f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:27:33.001316 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4891a6-9815-4e2e-9cb0-4d65fdb3387f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:33.004330 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4891a6-9815-4e2e-9cb0-4d65fdb3387f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:33.021474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1182/2339] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:27:33.025682 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11304b-77d4-4518-b87d-58e1c024ed77 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:33.037577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11304b-77d4-4518-b87d-58e1c024ed77 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:33.049564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84a8ea-1eb5-45dd-954e-b1b6b575b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:33.050199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84a8ea-1eb5-45dd-954e-b1b6b575b6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:33.050637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84a8ea-1eb5-45dd-954e-b1b6b575b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:33.050955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84a8ea-1eb5-45dd-954e-b1b6b575b6d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:33.051692 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84a8ea-1eb5-45dd-954e-b1b6b575b6d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:33.053840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84a8ea-1eb5-45dd-954e-b1b6b575b6d5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:33.089476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed357b2-754f-4437-8fd6-792e858dc986 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:33.089746 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:33.089898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed357b2-754f-4437-8fd6-792e858dc986 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:33.090298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed357b2-754f-4437-8fd6-792e858dc986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:33.106772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1158/2340] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:27:33 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:27:33.107606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84a8ea-1eb5-45dd-954e-b1b6b575b6d5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:33.123272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6ed357b2-754f-4437-8fd6-792e858dc986 None None] MFA Rules not processed for user `8b34dc9595cb45a993f2ad47a23d639b`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:33.124639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6ed357b2-754f-4437-8fd6-792e858dc986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:33.201342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84a8ea-1eb5-45dd-954e-b1b6b575b6d5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:33.210035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1183/2341] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:27:33.210673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcce62-9371-41fa-903a-556a33e32ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:33.211541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcce62-9371-41fa-903a-556a33e32ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:33.211833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcce62-9371-41fa-903a-556a33e32ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:33.212113 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcce62-9371-41fa-903a-556a33e32ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:33.212825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcce62-9371-41fa-903a-556a33e32ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:33.214956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcce62-9371-41fa-903a-556a33e32ba3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:33.246437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1159/2342] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:27:33 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:27:33.251210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed357b2-754f-4437-8fd6-792e858dc986 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:33.265684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed357b2-754f-4437-8fd6-792e858dc986 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:33.277479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4fbf1-efcb-4b55-9af7-35ee7148665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:33.279260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4fbf1-efcb-4b55-9af7-35ee7148665f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:33.279260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4fbf1-efcb-4b55-9af7-35ee7148665f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:33.280048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4fbf1-efcb-4b55-9af7-35ee7148665f admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:33.281264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4fbf1-efcb-4b55-9af7-35ee7148665f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:33.283850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4fbf1-efcb-4b55-9af7-35ee7148665f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:33.288830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcce62-9371-41fa-903a-556a33e32ba3 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:33.290694 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bbdcce62-9371-41fa-903a-556a33e32ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:33.294059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:33.304341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1184/2343] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:33.309100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4fbf1-efcb-4b55-9af7-35ee7148665f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:33.322379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4fbf1-efcb-4b55-9af7-35ee7148665f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:33.328647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973ddd1-11e2-4c27-b862-19022fbe5f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:33.329435 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973ddd1-11e2-4c27-b862-19022fbe5f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:33.329725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973ddd1-11e2-4c27-b862-19022fbe5f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:33.330016 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973ddd1-11e2-4c27-b862-19022fbe5f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:33.330746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973ddd1-11e2-4c27-b862-19022fbe5f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:33.332376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973ddd1-11e2-4c27-b862-19022fbe5f1a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:33.345102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1185/2344] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:33.349684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973ddd1-11e2-4c27-b862-19022fbe5f1a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:33.359707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973ddd1-11e2-4c27-b862-19022fbe5f1a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:33.360354 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcce62-9371-41fa-903a-556a33e32ba3 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:33.364084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8b65a-3f90-4aad-9b02-cdac36ad6d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:33.364476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d363af1-a415-4d73-beff-15973ca83ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:33.364743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8b65a-3f90-4aad-9b02-cdac36ad6d2d service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:33.365022 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8b65a-3f90-4aad-9b02-cdac36ad6d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:33.365343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8b65a-3f90-4aad-9b02-cdac36ad6d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:33.366013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d363af1-a415-4d73-beff-15973ca83ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:33.366305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d363af1-a415-4d73-beff-15973ca83ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:33.366579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d363af1-a415-4d73-beff-15973ca83ebc admin admin] PATH_INFO: `/v3/projects/c81f059e6b2e43f38bae567e453a690e/users/153cb0c4ac5d46649a4779af81d3694d/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:33.376063 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8b65a-3f90-4aad-9b02-cdac36ad6d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:33.379242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8b65a-3f90-4aad-9b02-cdac36ad6d2d service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:33.385038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d363af1-a415-4d73-beff-15973ca83ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81f059e6b2e43f38bae567e453a690e, user_id=153cb0c4ac5d46649a4779af81d3694d, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:33.387883 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d363af1-a415-4d73-beff-15973ca83ebc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:33.396062 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1160/2345] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:27:33.409107 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1186/2346] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:27:33 2022] PUT /identity/v3/projects/c81f059e6b2e43f38bae567e453a690e/users/153cb0c4ac5d46649a4779af81d3694d/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:27:33.419551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271392-f63a-4f1d-a42b-fb570c60b315 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:33.419842 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271392-f63a-4f1d-a42b-fb570c60b315 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:33.420177 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271392-f63a-4f1d-a42b-fb570c60b315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:33.456712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-72271392-f63a-4f1d-a42b-fb570c60b315 None None] MFA Rules not processed for user `153cb0c4ac5d46649a4779af81d3694d`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:33.458791 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-72271392-f63a-4f1d-a42b-fb570c60b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:33.621513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1161/2347] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:33.638875 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d363af1-a415-4d73-beff-15973ca83ebc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:33.640633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0d363af1-a415-4d73-beff-15973ca83ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:33.745467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d363af1-a415-4d73-beff-15973ca83ebc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:33.749806 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4534dc-4f8e-4a1e-8f75-39215e330e4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:33.750580 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4534dc-4f8e-4a1e-8f75-39215e330e4a service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:33.750934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4534dc-4f8e-4a1e-8f75-39215e330e4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:33.751285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4534dc-4f8e-4a1e-8f75-39215e330e4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:33.762150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4534dc-4f8e-4a1e-8f75-39215e330e4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:33.763937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4534dc-4f8e-4a1e-8f75-39215e330e4a service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:33.777946 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1187/2348] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:34.914461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34278139-1d1f-4822-9727-ac59df8abd03 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:34.915017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34278139-1d1f-4822-9727-ac59df8abd03 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:34.915017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34278139-1d1f-4822-9727-ac59df8abd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:34.946784 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-34278139-1d1f-4822-9727-ac59df8abd03 None None] MFA Rules not processed for user `8b34dc9595cb45a993f2ad47a23d639b`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:34.948076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-34278139-1d1f-4822-9727-ac59df8abd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:34.971456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:35.021811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1162/2349] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:43.479208 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b5949-97e1-49aa-a493-e760ba8b8b84 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:43.479832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b5949-97e1-49aa-a493-e760ba8b8b84 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:43.479832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b5949-97e1-49aa-a493-e760ba8b8b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:43.498850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fd0b5949-97e1-49aa-a493-e760ba8b8b84 None None] MFA Rules not processed for user `a70a40c7593f44bbbcb63d7000ada9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:43.500113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fd0b5949-97e1-49aa-a493-e760ba8b8b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:43.566111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1188/2350] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:45.014300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=15 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:47.102444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34278139-1d1f-4822-9727-ac59df8abd03 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:47.182447 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34278139-1d1f-4822-9727-ac59df8abd03 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:47.187342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:47.188239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:47.188564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:47.188880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] PATH_INFO: `/v3/users/153cb0c4ac5d46649a4779af81d3694d` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:47.190190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=153cb0c4ac5d46649a4779af81d3694d)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:47.192357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:47.250722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153cb0c4ac5d46649a4779af81d3694d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:47.267477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153cb0c4ac5d46649a4779af81d3694d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:47.275518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153cb0c4ac5d46649a4779af81d3694d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:47.283637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153cb0c4ac5d46649a4779af81d3694d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:47.284318 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153cb0c4ac5d46649a4779af81d3694d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:47.291177 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1163/2351] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:27:47 2022] DELETE /identity/v3/users/153cb0c4ac5d46649a4779af81d3694d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:47.296030 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1034fd-be1a-4025-90d6-500ecd859b53 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:47.296508 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1034fd-be1a-4025-90d6-500ecd859b53 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:47.296609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1034fd-be1a-4025-90d6-500ecd859b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:47.314880 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8a1034fd-be1a-4025-90d6-500ecd859b53 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:47.316186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8a1034fd-be1a-4025-90d6-500ecd859b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:47.390911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1189/2352] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:47.399098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:47.400931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:47.493388 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a93ebe-c837-4e1d-a900-b490e2335950 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:47.500933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43f29e-370f-4dbe-b888-b58eb3222001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:47.502628 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43f29e-370f-4dbe-b888-b58eb3222001 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:47.503053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43f29e-370f-4dbe-b888-b58eb3222001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:47.503474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43f29e-370f-4dbe-b888-b58eb3222001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:47.514477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43f29e-370f-4dbe-b888-b58eb3222001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:47.516209 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43f29e-370f-4dbe-b888-b58eb3222001 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:47.529280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1164/2353] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:47.896017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1034fd-be1a-4025-90d6-500ecd859b53 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:47.898788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8a1034fd-be1a-4025-90d6-500ecd859b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:47.935934 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1034fd-be1a-4025-90d6-500ecd859b53 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:47.944703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:47.946517 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:47.946931 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:47.947334 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa admin admin] PATH_INFO: `/v3/projects/c81f059e6b2e43f38bae567e453a690e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:47.950050 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81f059e6b2e43f38bae567e453a690e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:47.953701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:47.967672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:48.049234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81f059e6b2e43f38bae567e453a690e', 'request_id': 'req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:48.057887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81f059e6b2e43f38bae567e453a690e', 'request_id': 'req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:48.069741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81f059e6b2e43f38bae567e453a690e', 'request_id': 'req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:48.086812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa admin admin] The token cache is being invalidate because project c81f059e6b2e43f38bae567e453a690e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:27:48.087207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:48.088039 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-560c4a64-a5b9-4280-9e99-d4ab6ac8ccfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:27:48.089717 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1190/2354] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:27:47 2022] DELETE /identity/v3/projects/c81f059e6b2e43f38bae567e453a690e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:48.094635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1541-ac69-4038-9e43-b7e0a4c3ab84 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:48.094934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1541-ac69-4038-9e43-b7e0a4c3ab84 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:48.096013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1541-ac69-4038-9e43-b7e0a4c3ab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:48.117866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-675e1541-ac69-4038-9e43-b7e0a4c3ab84 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:48.119129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-675e1541-ac69-4038-9e43-b7e0a4c3ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:48.138760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:48.203695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1165/2355] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:48.212285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6d1a3-7752-4d58-870d-1b5da3f1706c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:48.212707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6d1a3-7752-4d58-870d-1b5da3f1706c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:48.213106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6d1a3-7752-4d58-870d-1b5da3f1706c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:48.237152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-23d6d1a3-7752-4d58-870d-1b5da3f1706c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:48.239746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-23d6d1a3-7752-4d58-870d-1b5da3f1706c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:48.251715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1191/2356] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:48.256508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e1541-ac69-4038-9e43-b7e0a4c3ab84 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:48.272012 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e1541-ac69-4038-9e43-b7e0a4c3ab84 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:48.279300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df44662-34f4-437a-9eca-76321959913a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:48.281927 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df44662-34f4-437a-9eca-76321959913a admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:48.282373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df44662-34f4-437a-9eca-76321959913a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:48.282750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df44662-34f4-437a-9eca-76321959913a admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:48.284374 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df44662-34f4-437a-9eca-76321959913a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:27:48.284917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df44662-34f4-437a-9eca-76321959913a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:48.286930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df44662-34f4-437a-9eca-76321959913a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:48.305759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1166/2357] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:27:48.310138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6d1a3-7752-4d58-870d-1b5da3f1706c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:48.323560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6d1a3-7752-4d58-870d-1b5da3f1706c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:48.330529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a485f-8162-4258-9c20-30d6ee7aa3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:48.331218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a485f-8162-4258-9c20-30d6ee7aa3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:48.331509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a485f-8162-4258-9c20-30d6ee7aa3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:48.331794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a485f-8162-4258-9c20-30d6ee7aa3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:48.332549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a485f-8162-4258-9c20-30d6ee7aa3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:48.334703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a485f-8162-4258-9c20-30d6ee7aa3f2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:48.381226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1192/2358] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:27:48 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:27:48.382599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df44662-34f4-437a-9eca-76321959913a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:48.404137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df44662-34f4-437a-9eca-76321959913a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:48.498324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc90db-de64-450d-a0a1-533ee1cbddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:48.499038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc90db-de64-450d-a0a1-533ee1cbddf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:48.499364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc90db-de64-450d-a0a1-533ee1cbddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:48.499620 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc90db-de64-450d-a0a1-533ee1cbddf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:48.500347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc90db-de64-450d-a0a1-533ee1cbddf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:48.502359 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc90db-de64-450d-a0a1-533ee1cbddf6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:48.529202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1167/2359] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:27:48 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:27:48.533520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a485f-8162-4258-9c20-30d6ee7aa3f2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:48.544953 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a485f-8162-4258-9c20-30d6ee7aa3f2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:48.549809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e479b2-f43a-4842-b084-40c195532b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:48.550479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e479b2-f43a-4842-b084-40c195532b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:48.550763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e479b2-f43a-4842-b084-40c195532b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:48.551606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e479b2-f43a-4842-b084-40c195532b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:48.552377 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e479b2-f43a-4842-b084-40c195532b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:48.554051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e479b2-f43a-4842-b084-40c195532b62 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:48.571861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1193/2360] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:48.576088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc90db-de64-450d-a0a1-533ee1cbddf6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:48.586711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc90db-de64-450d-a0a1-533ee1cbddf6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:48.591712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325057-f64d-4431-8deb-7dd0c7382924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:48.592419 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325057-f64d-4431-8deb-7dd0c7382924 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:48.592711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325057-f64d-4431-8deb-7dd0c7382924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:48.592996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325057-f64d-4431-8deb-7dd0c7382924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:48.593798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14325057-f64d-4431-8deb-7dd0c7382924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:48.595877 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14325057-f64d-4431-8deb-7dd0c7382924 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:48.609091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1168/2361] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:27:48.612375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e479b2-f43a-4842-b084-40c195532b62 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:48.623302 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e479b2-f43a-4842-b084-40c195532b62 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:48.627996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241b230-7013-475a-b12b-01c064f44321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:48.628915 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241b230-7013-475a-b12b-01c064f44321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:48.629244 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241b230-7013-475a-b12b-01c064f44321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:48.629555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241b230-7013-475a-b12b-01c064f44321 admin admin] PATH_INFO: `/v3/projects/5ad58646b98a4a36a9fc5c5be8425602/users/9eeb44092fc546959bf8ccb3a29b3e19/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:48.644819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241b230-7013-475a-b12b-01c064f44321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad58646b98a4a36a9fc5c5be8425602, user_id=9eeb44092fc546959bf8ccb3a29b3e19, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:48.647554 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241b230-7013-475a-b12b-01c064f44321 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:48.662018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1194/2362] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:27:48 2022] PUT /identity/v3/projects/5ad58646b98a4a36a9fc5c5be8425602/users/9eeb44092fc546959bf8ccb3a29b3e19/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:27:48.673148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892dbc5-2b78-40cf-9e3a-b4a3fd259ce6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:48.673445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892dbc5-2b78-40cf-9e3a-b4a3fd259ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:48.673732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892dbc5-2b78-40cf-9e3a-b4a3fd259ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:48.702825 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c892dbc5-2b78-40cf-9e3a-b4a3fd259ce6 None None] MFA Rules not processed for user `9eeb44092fc546959bf8ccb3a29b3e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:48.704053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c892dbc5-2b78-40cf-9e3a-b4a3fd259ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:48.770935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1169/2363] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:27:48.783233 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241b230-7013-475a-b12b-01c064f44321 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:27:48.785005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0241b230-7013-475a-b12b-01c064f44321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:48.848710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241b230-7013-475a-b12b-01c064f44321 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:27:48.852855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf42fa-c391-48d5-ba8c-a0e8bd00a9d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a4ae82b1b4619b90f9ad0f3dea5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:27:48.853555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf42fa-c391-48d5-ba8c-a0e8bd00a9d5 service glance] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:48.853841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf42fa-c391-48d5-ba8c-a0e8bd00a9d5 service glance] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:48.854123 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf42fa-c391-48d5-ba8c-a0e8bd00a9d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:48.864755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf42fa-c391-48d5-ba8c-a0e8bd00a9d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:27:48.866313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf42fa-c391-48d5-ba8c-a0e8bd00a9d5 service glance] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:27:48.877860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1195/2364] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:27:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:27:56.488240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f586b58-5bc2-4585-9866-68b94ede51c3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:27:56.488797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f586b58-5bc2-4585-9866-68b94ede51c3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:27:56.488911 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f586b58-5bc2-4585-9866-68b94ede51c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:27:56.515481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3f586b58-5bc2-4585-9866-68b94ede51c3 None None] MFA Rules not processed for user `0383866c48dc4e6a99608d3079d15ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:27:56.517151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3f586b58-5bc2-4585-9866-68b94ede51c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:27:56.531217 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:56.586434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1170/2365] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:27:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:27:58.874219 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:06.578531 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=17 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:13.750274 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbfb03-a3bd-4320-8a77-c78191ebdad7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:13.751121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbfb03-a3bd-4320-8a77-c78191ebdad7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:13.751121 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbfb03-a3bd-4320-8a77-c78191ebdad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:13.772990 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7fdbfb03-a3bd-4320-8a77-c78191ebdad7 None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:13.774633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7fdbfb03-a3bd-4320-8a77-c78191ebdad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:13.875811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1196/2366] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:28:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:13.899966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f586b58-5bc2-4585-9866-68b94ede51c3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:13.902118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3f586b58-5bc2-4585-9866-68b94ede51c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:14.029497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f586b58-5bc2-4585-9866-68b94ede51c3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:14.038363 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e56fc0-d75f-4a16-895e-57fd77224018 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:14.039422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e56fc0-d75f-4a16-895e-57fd77224018 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:14.039881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e56fc0-d75f-4a16-895e-57fd77224018 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:14.040348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e56fc0-d75f-4a16-895e-57fd77224018 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:14.057371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e56fc0-d75f-4a16-895e-57fd77224018 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:14.059134 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e56fc0-d75f-4a16-895e-57fd77224018 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:14.069619 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1171/2367] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:28:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:28:20.104197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61c076-a7b8-455a-997e-d706fe2bb89c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:20.104791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61c076-a7b8-455a-997e-d706fe2bb89c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:20.104791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61c076-a7b8-455a-997e-d706fe2bb89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:20.143480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0b61c076-a7b8-455a-997e-d706fe2bb89c None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:20.146466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0b61c076-a7b8-455a-997e-d706fe2bb89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:20.160944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1197/2368] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:28:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:20.174477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e56fc0-d75f-4a16-895e-57fd77224018 service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:20.189178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e56fc0-d75f-4a16-895e-57fd77224018 service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:20.195570 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437cd83-6790-421d-abc3-0e6b42e4ffe8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:20.196250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437cd83-6790-421d-abc3-0e6b42e4ffe8 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:20.196537 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437cd83-6790-421d-abc3-0e6b42e4ffe8 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:20.196815 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437cd83-6790-421d-abc3-0e6b42e4ffe8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:20.214408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437cd83-6790-421d-abc3-0e6b42e4ffe8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:20.216582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437cd83-6790-421d-abc3-0e6b42e4ffe8 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:20.228974 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1172/2369] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:28:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:28:27.934201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39812d07-445c-4ec6-96fe-7217863ffb19 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:27.935474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39812d07-445c-4ec6-96fe-7217863ffb19 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:27.935887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39812d07-445c-4ec6-96fe-7217863ffb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:28.028116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-39812d07-445c-4ec6-96fe-7217863ffb19 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:28.030412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-39812d07-445c-4ec6-96fe-7217863ffb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:28.293204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1198/2370] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Jul 15 15:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:28.312801 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437cd83-6790-421d-abc3-0e6b42e4ffe8 service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:28.317340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8437cd83-6790-421d-abc3-0e6b42e4ffe8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:28.634559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437cd83-6790-421d-abc3-0e6b42e4ffe8 service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:28.671780 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795ee13-e44e-4582-b026-6300439634a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:28.672473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795ee13-e44e-4582-b026-6300439634a0 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:28.673727 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795ee13-e44e-4582-b026-6300439634a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:28.674066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795ee13-e44e-4582-b026-6300439634a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:28.718237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795ee13-e44e-4582-b026-6300439634a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:28.720068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795ee13-e44e-4582-b026-6300439634a0 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:28.775306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1173/2371] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:28:32.388516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39812d07-445c-4ec6-96fe-7217863ffb19 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:32.399820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39812d07-445c-4ec6-96fe-7217863ffb19 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:32.405828 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:32.406952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:32.407353 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:32.407756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] PATH_INFO: `/v3/users/9eeb44092fc546959bf8ccb3a29b3e19` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:32.409497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eeb44092fc546959bf8ccb3a29b3e19)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:32.413002 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:32.594837 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eeb44092fc546959bf8ccb3a29b3e19'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:32.619421 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eeb44092fc546959bf8ccb3a29b3e19'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:32.628335 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eeb44092fc546959bf8ccb3a29b3e19'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:32.651029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eeb44092fc546959bf8ccb3a29b3e19'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:32.651908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eeb44092fc546959bf8ccb3a29b3e19'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:32.674884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1199/2372] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:28:32 2022] DELETE /identity/v3/users/9eeb44092fc546959bf8ccb3a29b3e19 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:28:32.680770 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46238a69-a013-418d-a48d-7964d0cc8685 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:32.681737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46238a69-a013-418d-a48d-7964d0cc8685 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:32.681737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46238a69-a013-418d-a48d-7964d0cc8685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:32.715685 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-46238a69-a013-418d-a48d-7964d0cc8685 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:32.734172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-46238a69-a013-418d-a48d-7964d0cc8685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:32.909294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1174/2373] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:32.925639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:32.927429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:32.971534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:33.146292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ce3c8-1ec7-4af2-8a20-c343d90cc22a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:33.157019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ee709-f07a-4f61-b713-3b945fcd2c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:33.158704 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ee709-f07a-4f61-b713-3b945fcd2c63 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:33.159102 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ee709-f07a-4f61-b713-3b945fcd2c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:33.159506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ee709-f07a-4f61-b713-3b945fcd2c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:33.183046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ee709-f07a-4f61-b713-3b945fcd2c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:33.184552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ee709-f07a-4f61-b713-3b945fcd2c63 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:33.203896 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1200/2374] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:28:33.835838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46238a69-a013-418d-a48d-7964d0cc8685 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:33.838343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-46238a69-a013-418d-a48d-7964d0cc8685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:33.849719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:33.860952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46238a69-a013-418d-a48d-7964d0cc8685 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:33.872683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e56db-ffe0-463b-8ea3-c67154e18b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:33.872683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e56db-ffe0-463b-8ea3-c67154e18b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:33.872683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e56db-ffe0-463b-8ea3-c67154e18b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:33.872683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e56db-ffe0-463b-8ea3-c67154e18b7d admin admin] PATH_INFO: `/v3/projects/5ad58646b98a4a36a9fc5c5be8425602` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:33.885637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e56db-ffe0-463b-8ea3-c67154e18b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad58646b98a4a36a9fc5c5be8425602)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:33.889714 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e56db-ffe0-463b-8ea3-c67154e18b7d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:34.008709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-759e56db-ffe0-463b-8ea3-c67154e18b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad58646b98a4a36a9fc5c5be8425602', 'request_id': 'req-759e56db-ffe0-463b-8ea3-c67154e18b7d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:34.023561 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-759e56db-ffe0-463b-8ea3-c67154e18b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad58646b98a4a36a9fc5c5be8425602', 'request_id': 'req-759e56db-ffe0-463b-8ea3-c67154e18b7d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:34.039416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-759e56db-ffe0-463b-8ea3-c67154e18b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad58646b98a4a36a9fc5c5be8425602', 'request_id': 'req-759e56db-ffe0-463b-8ea3-c67154e18b7d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:34.078202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-759e56db-ffe0-463b-8ea3-c67154e18b7d admin admin] The token cache is being invalidate because project 5ad58646b98a4a36a9fc5c5be8425602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:28:34.078989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-759e56db-ffe0-463b-8ea3-c67154e18b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:34.080319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-759e56db-ffe0-463b-8ea3-c67154e18b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:34.086413 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1175/2375] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:28:33 2022] DELETE /identity/v3/projects/5ad58646b98a4a36a9fc5c5be8425602 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:28:34.097755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbb104-63f0-478f-aeca-1eec6e399abf None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:34.098562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbb104-63f0-478f-aeca-1eec6e399abf None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:34.098562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbb104-63f0-478f-aeca-1eec6e399abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:34.150174 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2fdbb104-63f0-478f-aeca-1eec6e399abf None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:34.152191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2fdbb104-63f0-478f-aeca-1eec6e399abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:34.337887 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d781a15-a125-44aa-bfde-d2146464a025 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:34.338207 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d781a15-a125-44aa-bfde-d2146464a025 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:34.339077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d781a15-a125-44aa-bfde-d2146464a025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:34.348439 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1201/2376] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:34.395625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2d781a15-a125-44aa-bfde-d2146464a025 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:34.397251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2d781a15-a125-44aa-bfde-d2146464a025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:34.418771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1176/2377] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:34.423779 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbb104-63f0-478f-aeca-1eec6e399abf None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:34.436887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbb104-63f0-478f-aeca-1eec6e399abf None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:34.445808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126d196-134f-47b8-a61c-96d8f9f6c3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:34.447170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126d196-134f-47b8-a61c-96d8f9f6c3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:34.447693 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126d196-134f-47b8-a61c-96d8f9f6c3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:34.448161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126d196-134f-47b8-a61c-96d8f9f6c3a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:34.449206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126d196-134f-47b8-a61c-96d8f9f6c3a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:28:34.450090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126d196-134f-47b8-a61c-96d8f9f6c3a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:34.452918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126d196-134f-47b8-a61c-96d8f9f6c3a7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:34.496863 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f9498-fb1b-479c-931d-8031b07519f0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:34.500951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f9498-fb1b-479c-931d-8031b07519f0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:34.501799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1202/2378] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:28:34.501935 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f9498-fb1b-479c-931d-8031b07519f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:34.504921 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126d196-134f-47b8-a61c-96d8f9f6c3a7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:34.526690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126d196-134f-47b8-a61c-96d8f9f6c3a7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:34.536950 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bd604-b782-4bc0-ab7d-fb83186dbbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:34.538511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bd604-b782-4bc0-ab7d-fb83186dbbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:34.539818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bd604-b782-4bc0-ab7d-fb83186dbbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:34.540445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bd604-b782-4bc0-ab7d-fb83186dbbd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:34.542675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bd604-b782-4bc0-ab7d-fb83186dbbd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:34.547516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bd604-b782-4bc0-ab7d-fb83186dbbd3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:34.573939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2c3f9498-fb1b-479c-931d-8031b07519f0 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:34.575420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2c3f9498-fb1b-479c-931d-8031b07519f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:34.622487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1177/2379] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Jul 15 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:34.658416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1203/2380] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:28:34 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:28:34.658795 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f9498-fb1b-479c-931d-8031b07519f0 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:34.680258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f9498-fb1b-479c-931d-8031b07519f0 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:34.772475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bd604-b782-4bc0-ab7d-fb83186dbbd3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:34.776075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-553bd604-b782-4bc0-ab7d-fb83186dbbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:34.831619 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae7c0c-4d15-455d-a624-a1016dc72e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:34.832310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7c0c-4d15-455d-a624-a1016dc72e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:34.832593 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7c0c-4d15-455d-a624-a1016dc72e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:34.832872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7c0c-4d15-455d-a624-a1016dc72e2b admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:34.834616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae7c0c-4d15-455d-a624-a1016dc72e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:34.836897 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae7c0c-4d15-455d-a624-a1016dc72e2b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:34.885326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1178/2381] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:28:34 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:28:34.891258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae7c0c-4d15-455d-a624-a1016dc72e2b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:34.918146 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae7c0c-4d15-455d-a624-a1016dc72e2b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:34.930811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae180a5-8db8-457e-9fab-697e3d0a2af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:34.931512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae180a5-8db8-457e-9fab-697e3d0a2af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:34.931799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae180a5-8db8-457e-9fab-697e3d0a2af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:34.932085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae180a5-8db8-457e-9fab-697e3d0a2af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:34.932828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae180a5-8db8-457e-9fab-697e3d0a2af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:34.943275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae180a5-8db8-457e-9fab-697e3d0a2af0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:34.969498 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1179/2382] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:28:34.976546 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae180a5-8db8-457e-9fab-697e3d0a2af0 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:35.006472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae180a5-8db8-457e-9fab-697e3d0a2af0 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:35.011841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bd604-b782-4bc0-ab7d-fb83186dbbd3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:35.020707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d707d-e941-4c23-a880-b497ef7753cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:35.021597 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4668c-efff-462a-ba6b-0c72229e2eb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:35.022868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4668c-efff-462a-ba6b-0c72229e2eb4 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:35.023531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4668c-efff-462a-ba6b-0c72229e2eb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:35.023975 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4668c-efff-462a-ba6b-0c72229e2eb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:35.024178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d707d-e941-4c23-a880-b497ef7753cb admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:35.024532 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d707d-e941-4c23-a880-b497ef7753cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:35.024895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d707d-e941-4c23-a880-b497ef7753cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:35.038042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d707d-e941-4c23-a880-b497ef7753cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:35.040085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d707d-e941-4c23-a880-b497ef7753cb admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:35.074447 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1180/2383] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:28:35.119297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4668c-efff-462a-ba6b-0c72229e2eb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:35.120614 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d707d-e941-4c23-a880-b497ef7753cb admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:35.124941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4668c-efff-462a-ba6b-0c72229e2eb4 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:35.139845 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d707d-e941-4c23-a880-b497ef7753cb admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:35.152341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5c800-791f-4867-a9d8-0758515cf6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:35.153511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5c800-791f-4867-a9d8-0758515cf6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:35.154004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5c800-791f-4867-a9d8-0758515cf6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:35.154516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5c800-791f-4867-a9d8-0758515cf6ed admin admin] PATH_INFO: `/v3/projects/c78a81c5c8e64d1282c5bcbe6f20e8ce/users/3ff8cac311ac4b62840f4109496e23a9/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:35.165601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1204/2384] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:28:35.190647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5c800-791f-4867-a9d8-0758515cf6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78a81c5c8e64d1282c5bcbe6f20e8ce, user_id=3ff8cac311ac4b62840f4109496e23a9, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:35.194203 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5c800-791f-4867-a9d8-0758515cf6ed admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:35.227823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1181/2385] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:28:35 2022] PUT /identity/v3/projects/c78a81c5c8e64d1282c5bcbe6f20e8ce/users/3ff8cac311ac4b62840f4109496e23a9/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:28:35.229310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6fdcd-70f5-4fc7-af7c-f16ea67e6a5c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:35.229634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6fdcd-70f5-4fc7-af7c-f16ea67e6a5c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:35.229915 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6fdcd-70f5-4fc7-af7c-f16ea67e6a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:35.239601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:35.308205 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cdc6fdcd-70f5-4fc7-af7c-f16ea67e6a5c None None] MFA Rules not processed for user `3ff8cac311ac4b62840f4109496e23a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:35.315540 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cdc6fdcd-70f5-4fc7-af7c-f16ea67e6a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:35.487213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1205/2386] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:28:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:35.502564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5c800-791f-4867-a9d8-0758515cf6ed admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:35.504558 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d5f5c800-791f-4867-a9d8-0758515cf6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:35.567442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:35.662416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5c800-791f-4867-a9d8-0758515cf6ed admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:35.679258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bc6db-0943-4bae-bf80-54a0515ba09f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:35.680186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bc6db-0943-4bae-bf80-54a0515ba09f service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:35.680380 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bc6db-0943-4bae-bf80-54a0515ba09f service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:35.680711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bc6db-0943-4bae-bf80-54a0515ba09f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:35.694102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bc6db-0943-4bae-bf80-54a0515ba09f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:35.695604 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bc6db-0943-4bae-bf80-54a0515ba09f service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:35.723576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1182/2387] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:28:39.157851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adaea1-60f4-48da-9857-19c9c04a8236 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:39.158475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adaea1-60f4-48da-9857-19c9c04a8236 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:39.158736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adaea1-60f4-48da-9857-19c9c04a8236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:39.228265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-95adaea1-60f4-48da-9857-19c9c04a8236 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:39.230196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-95adaea1-60f4-48da-9857-19c9c04a8236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:39.360744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1206/2388] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Jul 15 15:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:39.416648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bc6db-0943-4bae-bf80-54a0515ba09f service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:39.420406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fe7bc6db-0943-4bae-bf80-54a0515ba09f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:39.640726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bc6db-0943-4bae-bf80-54a0515ba09f service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:39.648610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341368d-6b6e-497e-bc0a-dcb73e27b3d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:39.649945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341368d-6b6e-497e-bc0a-dcb73e27b3d2 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:39.650474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341368d-6b6e-497e-bc0a-dcb73e27b3d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:39.651002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341368d-6b6e-497e-bc0a-dcb73e27b3d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:39.663277 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341368d-6b6e-497e-bc0a-dcb73e27b3d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:39.666931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341368d-6b6e-497e-bc0a-dcb73e27b3d2 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:39.680877 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1183/2389] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:28:39.963982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adaea1-60f4-48da-9857-19c9c04a8236 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:39.966010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-95adaea1-60f4-48da-9857-19c9c04a8236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:40.147788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adaea1-60f4-48da-9857-19c9c04a8236 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:40.155161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1397e4-5be3-4fe9-956f-c38d7555d460 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba61318896f43e5a68e80f38ae5f3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:40.155855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1397e4-5be3-4fe9-956f-c38d7555d460 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:40.156143 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1397e4-5be3-4fe9-956f-c38d7555d460 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:40.156423 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1397e4-5be3-4fe9-956f-c38d7555d460 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:40.159883 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7f1397e4-5be3-4fe9-956f-c38d7555d460 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:40.177460 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1397e4-5be3-4fe9-956f-c38d7555d460 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:40.179885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1397e4-5be3-4fe9-956f-c38d7555d460 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:40.201966 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1207/2390] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:28:44.000760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bb8c0-a4ec-4184-a97a-780a6703e23a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:44.001355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bb8c0-a4ec-4184-a97a-780a6703e23a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:44.001355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bb8c0-a4ec-4184-a97a-780a6703e23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:44.021609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4b3bb8c0-a4ec-4184-a97a-780a6703e23a None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:44.022962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4b3bb8c0-a4ec-4184-a97a-780a6703e23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:44.082602 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1184/2391] 10.222.0.64 () {58 vars in 967 bytes} [Fri Jul 15 15:28:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:44.095148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1397e4-5be3-4fe9-956f-c38d7555d460 service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:44.096805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7f1397e4-5be3-4fe9-956f-c38d7555d460 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:44.126226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:44.170623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1397e4-5be3-4fe9-956f-c38d7555d460 service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:44.177639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60644744-cbde-4671-92ee-99cfc292d703 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:44.178451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60644744-cbde-4671-92ee-99cfc292d703 service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:44.178915 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60644744-cbde-4671-92ee-99cfc292d703 service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:44.179223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60644744-cbde-4671-92ee-99cfc292d703 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:44.190348 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60644744-cbde-4671-92ee-99cfc292d703 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:44.192052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60644744-cbde-4671-92ee-99cfc292d703 service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:44.202631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1208/2392] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:28:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:28:44.332056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1e839-934b-41c8-9668-0724e4c1dc10 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:44.332578 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1e839-934b-41c8-9668-0724e4c1dc10 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:44.333084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1e839-934b-41c8-9668-0724e4c1dc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:44.360523 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-88f1e839-934b-41c8-9668-0724e4c1dc10 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:44.363286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-88f1e839-934b-41c8-9668-0724e4c1dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:44.375415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1185/2393] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Jul 15 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:44.408165 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60644744-cbde-4671-92ee-99cfc292d703 service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:44.421690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60644744-cbde-4671-92ee-99cfc292d703 service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:44.429418 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e6c12-9167-43d5-be5f-8d32c811d0ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:44.430672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e6c12-9167-43d5-be5f-8d32c811d0ac service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:44.431141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e6c12-9167-43d5-be5f-8d32c811d0ac service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:44.431756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e6c12-9167-43d5-be5f-8d32c811d0ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:44.449501 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e6c12-9167-43d5-be5f-8d32c811d0ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:44.451969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e6c12-9167-43d5-be5f-8d32c811d0ac service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:44.465639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1209/2394] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:28:46.372250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1e839-934b-41c8-9668-0724e4c1dc10 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:46.375557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-88f1e839-934b-41c8-9668-0724e4c1dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:46.410193 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1e839-934b-41c8-9668-0724e4c1dc10 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:46.417795 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c73b4-ac80-4ecf-ba10-1c6d98cc0079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:46.420387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c73b4-ac80-4ecf-ba10-1c6d98cc0079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:46.420769 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c73b4-ac80-4ecf-ba10-1c6d98cc0079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:46.421546 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c73b4-ac80-4ecf-ba10-1c6d98cc0079 admin admin] PATH_INFO: `/v3/users/a70a40c7593f44bbbcb63d7000ada9b9` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:46.423455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c73b4-ac80-4ecf-ba10-1c6d98cc0079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a70a40c7593f44bbbcb63d7000ada9b9)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:46.425363 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c73b4-ac80-4ecf-ba10-1c6d98cc0079 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:46.471402 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:46.482632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-908c73b4-ac80-4ecf-ba10-1c6d98cc0079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a70a40c7593f44bbbcb63d7000ada9b9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:46.495892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-908c73b4-ac80-4ecf-ba10-1c6d98cc0079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a70a40c7593f44bbbcb63d7000ada9b9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:46.503606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-908c73b4-ac80-4ecf-ba10-1c6d98cc0079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a70a40c7593f44bbbcb63d7000ada9b9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:46.511781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-908c73b4-ac80-4ecf-ba10-1c6d98cc0079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a70a40c7593f44bbbcb63d7000ada9b9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:46.512632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-908c73b4-ac80-4ecf-ba10-1c6d98cc0079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a70a40c7593f44bbbcb63d7000ada9b9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:46.519720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1186/2395] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:28:46 2022] DELETE /identity/v3/users/a70a40c7593f44bbbcb63d7000ada9b9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:28:46.718757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e6c12-9167-43d5-be5f-8d32c811d0ac service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:46.737838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e6c12-9167-43d5-be5f-8d32c811d0ac service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:46.842779 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9fa3e-8349-4565-aea2-78a985f76fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:46.843672 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9fa3e-8349-4565-aea2-78a985f76fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:46.844382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9fa3e-8349-4565-aea2-78a985f76fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:46.844709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9fa3e-8349-4565-aea2-78a985f76fef admin admin] PATH_INFO: `/v3/projects/e18f2c951a534d5da3ba5eb6cc2847ab` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:46.846118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9fa3e-8349-4565-aea2-78a985f76fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18f2c951a534d5da3ba5eb6cc2847ab)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:46.849284 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9fa3e-8349-4565-aea2-78a985f76fef admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:46.926488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-32e9fa3e-8349-4565-aea2-78a985f76fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18f2c951a534d5da3ba5eb6cc2847ab', 'request_id': 'req-32e9fa3e-8349-4565-aea2-78a985f76fef'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:46.933216 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-32e9fa3e-8349-4565-aea2-78a985f76fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18f2c951a534d5da3ba5eb6cc2847ab', 'request_id': 'req-32e9fa3e-8349-4565-aea2-78a985f76fef'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:46.943196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-32e9fa3e-8349-4565-aea2-78a985f76fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18f2c951a534d5da3ba5eb6cc2847ab', 'request_id': 'req-32e9fa3e-8349-4565-aea2-78a985f76fef'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:46.956209 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-32e9fa3e-8349-4565-aea2-78a985f76fef admin admin] The token cache is being invalidate because project e18f2c951a534d5da3ba5eb6cc2847ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:28:46.956507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-32e9fa3e-8349-4565-aea2-78a985f76fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:46.957230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-32e9fa3e-8349-4565-aea2-78a985f76fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:28:46.958811 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1210/2396] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:28:46 2022] DELETE /identity/v3/projects/e18f2c951a534d5da3ba5eb6cc2847ab => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:28:46.964826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef2e67-0c97-4b11-a8b3-8cf59655b05b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:46.965228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef2e67-0c97-4b11-a8b3-8cf59655b05b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:46.965510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef2e67-0c97-4b11-a8b3-8cf59655b05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:46.985747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-dbef2e67-0c97-4b11-a8b3-8cf59655b05b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:46.987090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-dbef2e67-0c97-4b11-a8b3-8cf59655b05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:47.069125 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1187/2397] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:47.074826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755cf2b-64b4-48e1-84cf-398530ac6c85 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:47.075181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755cf2b-64b4-48e1-84cf-398530ac6c85 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:47.075522 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755cf2b-64b4-48e1-84cf-398530ac6c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:47.098836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0755cf2b-64b4-48e1-84cf-398530ac6c85 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:47.100339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0755cf2b-64b4-48e1-84cf-398530ac6c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:47.109905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1211/2398] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:28:47.114901 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef2e67-0c97-4b11-a8b3-8cf59655b05b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:47.125389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef2e67-0c97-4b11-a8b3-8cf59655b05b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:47.131052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef349c-16e8-4a45-a724-b3752e46efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:47.131736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef349c-16e8-4a45-a724-b3752e46efaa admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:47.132053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef349c-16e8-4a45-a724-b3752e46efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:47.132410 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef349c-16e8-4a45-a724-b3752e46efaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:47.133189 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef349c-16e8-4a45-a724-b3752e46efaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:28:47.133505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef349c-16e8-4a45-a724-b3752e46efaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:47.135138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef349c-16e8-4a45-a724-b3752e46efaa admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:47.152478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1188/2399] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:28:47.157353 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755cf2b-64b4-48e1-84cf-398530ac6c85 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:47.171181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755cf2b-64b4-48e1-84cf-398530ac6c85 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:47.177529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5cb32-961e-4d80-91b1-a82c13a56c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:47.178250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5cb32-961e-4d80-91b1-a82c13a56c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:47.178531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5cb32-961e-4d80-91b1-a82c13a56c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:47.178832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5cb32-961e-4d80-91b1-a82c13a56c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:47.179544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5cb32-961e-4d80-91b1-a82c13a56c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:47.181755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5cb32-961e-4d80-91b1-a82c13a56c2e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:47.210228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1212/2400] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:28:47 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:28:47.214949 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef349c-16e8-4a45-a724-b3752e46efaa admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:47.227919 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef349c-16e8-4a45-a724-b3752e46efaa admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:47.317338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0925975-3e45-416f-bcca-3c8fd82b99af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:47.319497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0925975-3e45-416f-bcca-3c8fd82b99af admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:47.320090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0925975-3e45-416f-bcca-3c8fd82b99af admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:47.320705 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0925975-3e45-416f-bcca-3c8fd82b99af admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:47.322108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0925975-3e45-416f-bcca-3c8fd82b99af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:47.325726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0925975-3e45-416f-bcca-3c8fd82b99af admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:47.370076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1189/2401] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:28:47 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:28:47.371793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5cb32-961e-4d80-91b1-a82c13a56c2e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:47.391038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:47.398309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5cb32-961e-4d80-91b1-a82c13a56c2e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:47.408583 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deced352-895c-4ab8-bde5-b7df59d92a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:47.410020 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced352-895c-4ab8-bde5-b7df59d92a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:47.411096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced352-895c-4ab8-bde5-b7df59d92a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:47.412874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced352-895c-4ab8-bde5-b7df59d92a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:47.414306 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deced352-895c-4ab8-bde5-b7df59d92a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:47.418742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deced352-895c-4ab8-bde5-b7df59d92a4d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:47.441160 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1213/2402] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:28:47.445092 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0925975-3e45-416f-bcca-3c8fd82b99af admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:47.463003 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0925975-3e45-416f-bcca-3c8fd82b99af admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:47.469151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95233044-e7b2-4a67-9a8f-9554bf764695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:47.470097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95233044-e7b2-4a67-9a8f-9554bf764695 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:47.470656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95233044-e7b2-4a67-9a8f-9554bf764695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:47.471160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95233044-e7b2-4a67-9a8f-9554bf764695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:47.472555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95233044-e7b2-4a67-9a8f-9554bf764695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:47.474954 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95233044-e7b2-4a67-9a8f-9554bf764695 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:47.488419 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1190/2403] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:28:47.495354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deced352-895c-4ab8-bde5-b7df59d92a4d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:47.515023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deced352-895c-4ab8-bde5-b7df59d92a4d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:47.523772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9732374-794e-436f-87d0-dc0b842dc00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:47.525400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9732374-794e-436f-87d0-dc0b842dc00e admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:47.525898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9732374-794e-436f-87d0-dc0b842dc00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:47.526403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9732374-794e-436f-87d0-dc0b842dc00e admin admin] PATH_INFO: `/v3/projects/57fcc98f64a94801918f5c7d757dfdce/users/54c2a1853b3840dc882c0428dd142d61/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:47.552874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9732374-794e-436f-87d0-dc0b842dc00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57fcc98f64a94801918f5c7d757dfdce, user_id=54c2a1853b3840dc882c0428dd142d61, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:47.555797 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9732374-794e-436f-87d0-dc0b842dc00e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:47.588784 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1214/2404] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:28:47 2022] PUT /identity/v3/projects/57fcc98f64a94801918f5c7d757dfdce/users/54c2a1853b3840dc882c0428dd142d61/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:28:47.594345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33361f-0587-44f6-8b10-3e251ee95884 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:47.594873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33361f-0587-44f6-8b10-3e251ee95884 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:47.595547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33361f-0587-44f6-8b10-3e251ee95884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:47.618120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1c33361f-0587-44f6-8b10-3e251ee95884 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:47.619383 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1c33361f-0587-44f6-8b10-3e251ee95884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:47.636123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:47.696162 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1191/2405] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:47.708730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9732374-794e-436f-87d0-dc0b842dc00e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:47.713007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b9732374-794e-436f-87d0-dc0b842dc00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:47.781472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9732374-794e-436f-87d0-dc0b842dc00e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:47.786235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a493a-96d0-4313-8d03-f85971b346ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:47.786909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a493a-96d0-4313-8d03-f85971b346ec service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:47.787197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a493a-96d0-4313-8d03-f85971b346ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:47.787476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a493a-96d0-4313-8d03-f85971b346ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:47.798165 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a493a-96d0-4313-8d03-f85971b346ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:47.800328 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a493a-96d0-4313-8d03-f85971b346ec service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:47.812424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1215/2406] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:28:48.430858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f94df-2da2-4231-a9cd-df1c9bd3bba0 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:48.431340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f94df-2da2-4231-a9cd-df1c9bd3bba0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:48.431786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f94df-2da2-4231-a9cd-df1c9bd3bba0 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:48.434472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1192/2407] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:28:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:28:48.458800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2819f9f-4028-4181-91f1-b0978e7ee8ef None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:48.459336 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2819f9f-4028-4181-91f1-b0978e7ee8ef None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:48.459859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2819f9f-4028-4181-91f1-b0978e7ee8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:48.491185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b2819f9f-4028-4181-91f1-b0978e7ee8ef None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:48.492522 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b2819f9f-4028-4181-91f1-b0978e7ee8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:48.599565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1216/2408] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:28:48.623792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f94df-2da2-4231-a9cd-df1c9bd3bba0 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:48.629324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f21f94df-2da2-4231-a9cd-df1c9bd3bba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:48.756503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f94df-2da2-4231-a9cd-df1c9bd3bba0 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:48.779626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4045da-f081-4b94-9724-432a759496e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a4ae82b1b4619b90f9ad0f3dea5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:48.782336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4045da-f081-4b94-9724-432a759496e5 service glance] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:48.784392 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4045da-f081-4b94-9724-432a759496e5 service glance] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:48.785839 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4045da-f081-4b94-9724-432a759496e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:48.807888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4045da-f081-4b94-9724-432a759496e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:48.810981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4045da-f081-4b94-9724-432a759496e5 service glance] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:48.834943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1193/2409] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:28:48.935613 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee9d87-eed9-4117-8f1f-329b481c1ddd None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:48.938901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee9d87-eed9-4117-8f1f-329b481c1ddd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:48.942621 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee9d87-eed9-4117-8f1f-329b481c1ddd None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:48.944344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1217/2410] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:28:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:28:48.953847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a48081-cefa-4b5c-b90b-256f10138f95 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:48.954143 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a48081-cefa-4b5c-b90b-256f10138f95 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:48.954610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a48081-cefa-4b5c-b90b-256f10138f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:48.984021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a8a48081-cefa-4b5c-b90b-256f10138f95 None None] MFA Rules not processed for user `88518fe83a7c4fbdb3088bb2daf04239`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:48.985828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a8a48081-cefa-4b5c-b90b-256f10138f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:48.999725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1194/2411] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:49.007250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee9d87-eed9-4117-8f1f-329b481c1ddd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:49.009272 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-84ee9d87-eed9-4117-8f1f-329b481c1ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:49.025953 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee9d87-eed9-4117-8f1f-329b481c1ddd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:49.030093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046393b-6742-4118-9edc-97299079b11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:49.031047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046393b-6742-4118-9edc-97299079b11c service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:49.031355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046393b-6742-4118-9edc-97299079b11c service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:49.031624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046393b-6742-4118-9edc-97299079b11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:49.041871 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046393b-6742-4118-9edc-97299079b11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:49.043441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046393b-6742-4118-9edc-97299079b11c service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:49.053614 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1218/2412] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:28:49.188113 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42d2b-12a4-4aca-887e-905dd13de7e4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:49.188397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42d2b-12a4-4aca-887e-905dd13de7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:49.188776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42d2b-12a4-4aca-887e-905dd13de7e4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:49.192986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1195/2413] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:28:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:28:49.202587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd54d44-5507-4c4d-9b46-96b886632496 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:49.202881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd54d44-5507-4c4d-9b46-96b886632496 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:49.203164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd54d44-5507-4c4d-9b46-96b886632496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:49.229479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4fd54d44-5507-4c4d-9b46-96b886632496 None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:49.230870 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4fd54d44-5507-4c4d-9b46-96b886632496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:49.248054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1219/2414] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:49.255777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee42d2b-12a4-4aca-887e-905dd13de7e4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:49.269439 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee42d2b-12a4-4aca-887e-905dd13de7e4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:49.273612 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10350f-bce6-4df0-b269-84942f1d74b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:49.274377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10350f-bce6-4df0-b269-84942f1d74b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:49.274740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10350f-bce6-4df0-b269-84942f1d74b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:49.275098 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10350f-bce6-4df0-b269-84942f1d74b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:49.288587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10350f-bce6-4df0-b269-84942f1d74b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:49.290035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10350f-bce6-4df0-b269-84942f1d74b6 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:49.306791 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1196/2415] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:28:49.727813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482b4bf-aefc-46ef-ba61-bfaa23d41c67 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:49.728633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482b4bf-aefc-46ef-ba61-bfaa23d41c67 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:49.729724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482b4bf-aefc-46ef-ba61-bfaa23d41c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:49.787601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7482b4bf-aefc-46ef-ba61-bfaa23d41c67 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:49.794293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7482b4bf-aefc-46ef-ba61-bfaa23d41c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:49.843815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1220/2416] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Jul 15 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:49.867651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10350f-bce6-4df0-b269-84942f1d74b6 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:49.870629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2a10350f-bce6-4df0-b269-84942f1d74b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:49.914050 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10350f-bce6-4df0-b269-84942f1d74b6 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:49.936856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a2705-ea62-4c8e-b1d7-452a70fe92ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:49.938053 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a2705-ea62-4c8e-b1d7-452a70fe92ce service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:49.946717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a2705-ea62-4c8e-b1d7-452a70fe92ce service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:49.947442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a2705-ea62-4c8e-b1d7-452a70fe92ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:49.967239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a2705-ea62-4c8e-b1d7-452a70fe92ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:49.968904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a2705-ea62-4c8e-b1d7-452a70fe92ce service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:49.984984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1197/2417] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:28:54.062129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5abf7-d315-4306-ab5b-daacf71575e9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:54.062770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5abf7-d315-4306-ab5b-daacf71575e9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:54.062770 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5abf7-d315-4306-ab5b-daacf71575e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:54.103357 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-30d5abf7-d315-4306-ab5b-daacf71575e9 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:54.104218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-30d5abf7-d315-4306-ab5b-daacf71575e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:54.116632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1221/2418] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Jul 15 15:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:54.140636 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a2705-ea62-4c8e-b1d7-452a70fe92ce service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:54.154660 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a2705-ea62-4c8e-b1d7-452a70fe92ce service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:54.165525 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea0b10-2b74-4949-a4f7-2a5cbcc52c80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:54.179381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea0b10-2b74-4949-a4f7-2a5cbcc52c80 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:54.180026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea0b10-2b74-4949-a4f7-2a5cbcc52c80 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:54.180519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea0b10-2b74-4949-a4f7-2a5cbcc52c80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:54.212057 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea0b10-2b74-4949-a4f7-2a5cbcc52c80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:54.213969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea0b10-2b74-4949-a4f7-2a5cbcc52c80 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:54.250737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1198/2419] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:28:54.320033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc50b8-901e-4479-a9da-23250905a13a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:54.323654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc50b8-901e-4479-a9da-23250905a13a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:54.323947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc50b8-901e-4479-a9da-23250905a13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:54.363579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-02fc50b8-901e-4479-a9da-23250905a13a None None] MFA Rules not processed for user `54c2a1853b3840dc882c0428dd142d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:54.365958 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-02fc50b8-901e-4479-a9da-23250905a13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:54.388241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:54.499445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1222/2420] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:28:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:54.504030 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea0b10-2b74-4949-a4f7-2a5cbcc52c80 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:54.516231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea0b10-2b74-4949-a4f7-2a5cbcc52c80 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:54.526374 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dea7b-0223-43b8-9704-d79fe07336af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:54.527229 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dea7b-0223-43b8-9704-d79fe07336af admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:54.527752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dea7b-0223-43b8-9704-d79fe07336af admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:54.528276 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dea7b-0223-43b8-9704-d79fe07336af admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:54.530639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dea7b-0223-43b8-9704-d79fe07336af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:54.535193 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dea7b-0223-43b8-9704-d79fe07336af admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:54.590116 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1199/2421] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:28:54 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:28:54.601131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc50b8-901e-4479-a9da-23250905a13a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:54.614395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc50b8-901e-4479-a9da-23250905a13a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:54.721188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94595e15-88be-4411-8e40-378917b34330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:54.722509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94595e15-88be-4411-8e40-378917b34330 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:54.723665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94595e15-88be-4411-8e40-378917b34330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:54.723665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94595e15-88be-4411-8e40-378917b34330 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:54.724663 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94595e15-88be-4411-8e40-378917b34330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:54.728719 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94595e15-88be-4411-8e40-378917b34330 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:54.761150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1223/2422] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:28:54 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:28:54.763720 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dea7b-0223-43b8-9704-d79fe07336af admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:54.777803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dea7b-0223-43b8-9704-d79fe07336af admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:54.782849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d92e66-60d4-40be-a3ee-8fa84169105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:54.784146 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d92e66-60d4-40be-a3ee-8fa84169105c admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:54.784433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d92e66-60d4-40be-a3ee-8fa84169105c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:54.784715 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d92e66-60d4-40be-a3ee-8fa84169105c admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:54.785656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d92e66-60d4-40be-a3ee-8fa84169105c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:54.787185 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d92e66-60d4-40be-a3ee-8fa84169105c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:54.798577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1200/2423] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:28:54.803270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94595e15-88be-4411-8e40-378917b34330 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:54.818496 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94595e15-88be-4411-8e40-378917b34330 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:54.824046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b99da-528b-4f9e-98ab-dca3b666f9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:54.825096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b99da-528b-4f9e-98ab-dca3b666f9e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:54.825869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b99da-528b-4f9e-98ab-dca3b666f9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:54.826322 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b99da-528b-4f9e-98ab-dca3b666f9e6 admin admin] PATH_INFO: `/v3/projects/67998dd629ac4599a85fcfaa2ec41be0/users/76a24c281c1f46ab8b97fdae81f77a48/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:54.854335 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b99da-528b-4f9e-98ab-dca3b666f9e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67998dd629ac4599a85fcfaa2ec41be0, user_id=76a24c281c1f46ab8b97fdae81f77a48, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:54.857008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b99da-528b-4f9e-98ab-dca3b666f9e6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:54.879852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1224/2424] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:28:54 2022] PUT /identity/v3/projects/67998dd629ac4599a85fcfaa2ec41be0/users/76a24c281c1f46ab8b97fdae81f77a48/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:28:54.885413 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d92e66-60d4-40be-a3ee-8fa84169105c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:54.896869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d92e66-60d4-40be-a3ee-8fa84169105c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:54.960019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:54.981106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16f6dd-d8d2-471b-9553-79c11bf0626f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:54.981782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16f6dd-d8d2-471b-9553-79c11bf0626f admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:54.982070 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16f6dd-d8d2-471b-9553-79c11bf0626f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:54.982355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16f6dd-d8d2-471b-9553-79c11bf0626f admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:54.983115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16f6dd-d8d2-471b-9553-79c11bf0626f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:54.985489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16f6dd-d8d2-471b-9553-79c11bf0626f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:55.003287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1201/2425] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:28:55.004694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b99da-528b-4f9e-98ab-dca3b666f9e6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:55.019805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b99da-528b-4f9e-98ab-dca3b666f9e6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:55.025476 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce18db-3d24-4d2c-9052-fd2f9ba60a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:55.026440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce18db-3d24-4d2c-9052-fd2f9ba60a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:55.026730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce18db-3d24-4d2c-9052-fd2f9ba60a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:55.027008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce18db-3d24-4d2c-9052-fd2f9ba60a74 admin admin] PATH_INFO: `/v3/projects/67998dd629ac4599a85fcfaa2ec41be0/users/76a24c281c1f46ab8b97fdae81f77a48/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:55.029195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce18db-3d24-4d2c-9052-fd2f9ba60a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67998dd629ac4599a85fcfaa2ec41be0, user_id=76a24c281c1f46ab8b97fdae81f77a48, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:55.032312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce18db-3d24-4d2c-9052-fd2f9ba60a74 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:55.050876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1225/2426] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:28:55 2022] PUT /identity/v3/projects/67998dd629ac4599a85fcfaa2ec41be0/users/76a24c281c1f46ab8b97fdae81f77a48/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:28:56.672532 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898fc13-7197-44ca-98e2-40f22e304cc2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:56.673710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898fc13-7197-44ca-98e2-40f22e304cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:56.674294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898fc13-7197-44ca-98e2-40f22e304cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:56.704948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c898fc13-7197-44ca-98e2-40f22e304cc2 None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:28:56.707078 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c898fc13-7197-44ca-98e2-40f22e304cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:56.780805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1202/2427] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:28:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:28:56.800768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce18db-3d24-4d2c-9052-fd2f9ba60a74 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:28:56.803706 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5dce18db-3d24-4d2c-9052-fd2f9ba60a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:28:56.943402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce18db-3d24-4d2c-9052-fd2f9ba60a74 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:28:56.954133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6158ba3-d9e3-4e9b-9534-e0b5db2d8389 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:28:56.955642 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6158ba3-d9e3-4e9b-9534-e0b5db2d8389 service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:28:56.956022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6158ba3-d9e3-4e9b-9534-e0b5db2d8389 service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:28:56.956490 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6158ba3-d9e3-4e9b-9534-e0b5db2d8389 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:28:56.969565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6158ba3-d9e3-4e9b-9534-e0b5db2d8389 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:28:56.974819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6158ba3-d9e3-4e9b-9534-e0b5db2d8389 service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:28:56.984029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:57.006548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1226/2428] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:28:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:29:04.346266 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1018e-3643-4757-9c1e-6a7408d59637 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:04.349710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1018e-3643-4757-9c1e-6a7408d59637 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:04.349710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1018e-3643-4757-9c1e-6a7408d59637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:04.479705 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-83f1018e-3643-4757-9c1e-6a7408d59637 None None] MFA Rules not processed for user `76a24c281c1f46ab8b97fdae81f77a48`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:04.482624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-83f1018e-3643-4757-9c1e-6a7408d59637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:04.714691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1203/2429] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:29:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:29:04.735474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6158ba3-d9e3-4e9b-9534-e0b5db2d8389 service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:04.737503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c6158ba3-d9e3-4e9b-9534-e0b5db2d8389 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:04.915624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6158ba3-d9e3-4e9b-9534-e0b5db2d8389 service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:04.922780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda2490-f9e1-44a4-8ba2-f87677924aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:04.924849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda2490-f9e1-44a4-8ba2-f87677924aaa service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:04.925177 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda2490-f9e1-44a4-8ba2-f87677924aaa service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:04.925466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda2490-f9e1-44a4-8ba2-f87677924aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:05.031872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda2490-f9e1-44a4-8ba2-f87677924aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:05.047907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda2490-f9e1-44a4-8ba2-f87677924aaa service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:05.068009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1227/2430] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:29:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:29:06.911726 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4be9e-9c22-41eb-aa64-96575a72cd2f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:06.912799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4be9e-9c22-41eb-aa64-96575a72cd2f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:06.913303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4be9e-9c22-41eb-aa64-96575a72cd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:06.942432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-afe4be9e-9c22-41eb-aa64-96575a72cd2f None None] MFA Rules not processed for user `54c2a1853b3840dc882c0428dd142d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:06.944023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-afe4be9e-9c22-41eb-aa64-96575a72cd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:06.952677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1204/2431] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:29:14.615169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda2490-f9e1-44a4-8ba2-f87677924aaa service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:14.616649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2fda2490-f9e1-44a4-8ba2-f87677924aaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:14.698367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda2490-f9e1-44a4-8ba2-f87677924aaa service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:14.703093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:14.703997 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:14.704310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:14.704586 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] PATH_INFO: `/v3/users/3ff8cac311ac4b62840f4109496e23a9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:14.705980 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff8cac311ac4b62840f4109496e23a9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:14.708138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:14.764725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:14.777676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff8cac311ac4b62840f4109496e23a9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:29:14.794966 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff8cac311ac4b62840f4109496e23a9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:29:14.809678 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff8cac311ac4b62840f4109496e23a9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:29:14.820497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff8cac311ac4b62840f4109496e23a9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:29:14.821492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff8cac311ac4b62840f4109496e23a9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:29:14.832132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1228/2432] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:29:14 2022] DELETE /identity/v3/users/3ff8cac311ac4b62840f4109496e23a9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:29:14.833655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1e88a-836b-4e99-bfbe-147f178bab78 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:14.834194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1e88a-836b-4e99-bfbe-147f178bab78 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:14.834302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1e88a-836b-4e99-bfbe-147f178bab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:14.854890 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-42a1e88a-836b-4e99-bfbe-147f178bab78 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:14.856651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-42a1e88a-836b-4e99-bfbe-147f178bab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:14.942328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1205/2433] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:29:14.948952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:14.950409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:15.024753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73657285-78b9-42ce-9f28-d300f23f49d5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:15.028520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f604cd-f1b8-4281-b8eb-56032f20a5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:15.029243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f604cd-f1b8-4281-b8eb-56032f20a5bf service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:15.029529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f604cd-f1b8-4281-b8eb-56032f20a5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:15.029810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f604cd-f1b8-4281-b8eb-56032f20a5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:15.040645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f604cd-f1b8-4281-b8eb-56032f20a5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:15.042156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f604cd-f1b8-4281-b8eb-56032f20a5bf service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:15.055029 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1229/2434] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:29:15.384774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1e88a-836b-4e99-bfbe-147f178bab78 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:15.386291 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-42a1e88a-836b-4e99-bfbe-147f178bab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:15.403914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:15.410225 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1e88a-836b-4e99-bfbe-147f178bab78 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:15.420127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:15.421297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:15.421682 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:15.421983 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] PATH_INFO: `/v3/projects/c78a81c5c8e64d1282c5bcbe6f20e8ce` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:15.424810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78a81c5c8e64d1282c5bcbe6f20e8ce)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:15.427738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:15.486587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78a81c5c8e64d1282c5bcbe6f20e8ce', 'request_id': 'req-e6f5456c-ce17-4cae-8255-5fe1a4511116'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:29:15.494454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78a81c5c8e64d1282c5bcbe6f20e8ce', 'request_id': 'req-e6f5456c-ce17-4cae-8255-5fe1a4511116'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:29:15.502710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78a81c5c8e64d1282c5bcbe6f20e8ce', 'request_id': 'req-e6f5456c-ce17-4cae-8255-5fe1a4511116'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:29:15.513501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] The token cache is being invalidate because project c78a81c5c8e64d1282c5bcbe6f20e8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:29:15.513788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:29:15.514459 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:29:15.516037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1206/2435] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:29:15 2022] DELETE /identity/v3/projects/c78a81c5c8e64d1282c5bcbe6f20e8ce => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:29:23.246060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35eee7c-f572-43dd-876d-8534e9ae7f32 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:23.246060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35eee7c-f572-43dd-876d-8534e9ae7f32 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:23.246503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35eee7c-f572-43dd-876d-8534e9ae7f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:23.266172 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f35eee7c-f572-43dd-876d-8534e9ae7f32 None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:23.268060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f35eee7c-f572-43dd-876d-8534e9ae7f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:23.333715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1230/2436] 10.222.0.64 () {58 vars in 967 bytes} [Fri Jul 15 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:29:23.347445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:23.349198 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:23.431629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5456c-ce17-4cae-8255-5fe1a4511116 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:23.436945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afff8e-3ca3-4f0d-a70b-ad66af4874b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:23.437659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afff8e-3ca3-4f0d-a70b-ad66af4874b6 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:23.437955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afff8e-3ca3-4f0d-a70b-ad66af4874b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:23.438243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afff8e-3ca3-4f0d-a70b-ad66af4874b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:23.448437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afff8e-3ca3-4f0d-a70b-ad66af4874b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:23.453202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afff8e-3ca3-4f0d-a70b-ad66af4874b6 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:23.462645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1207/2437] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:29:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:29:29.619011 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c22e50-20aa-4e94-b6d7-b2280a5fb801 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:29.620014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c22e50-20aa-4e94-b6d7-b2280a5fb801 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:29.620303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c22e50-20aa-4e94-b6d7-b2280a5fb801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:29.640788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-32c22e50-20aa-4e94-b6d7-b2280a5fb801 None None] MFA Rules not processed for user `8b34dc9595cb45a993f2ad47a23d639b`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:29.642387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-32c22e50-20aa-4e94-b6d7-b2280a5fb801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:29.711974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1231/2438] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:29:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:29:32.001535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93475d10-6fb3-4494-b1e2-a1a07797d0ae None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:32.001535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93475d10-6fb3-4494-b1e2-a1a07797d0ae None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:32.002515 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93475d10-6fb3-4494-b1e2-a1a07797d0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:32.019977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-93475d10-6fb3-4494-b1e2-a1a07797d0ae None None] MFA Rules not processed for user `c0023517ec494a01a7bc4bae3fdfb562`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:32.021206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-93475d10-6fb3-4494-b1e2-a1a07797d0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:32.076108 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1208/2439] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:29:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:29:38.692738 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c22e50-20aa-4e94-b6d7-b2280a5fb801 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:38.694948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-32c22e50-20aa-4e94-b6d7-b2280a5fb801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:38.740335 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:38.826404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c22e50-20aa-4e94-b6d7-b2280a5fb801 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:38.844040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef36004-ce32-48ce-960f-c2d41dc27fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:38.846580 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef36004-ce32-48ce-960f-c2d41dc27fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:38.847136 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef36004-ce32-48ce-960f-c2d41dc27fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:38.848223 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef36004-ce32-48ce-960f-c2d41dc27fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:38.854021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cef36004-ce32-48ce-960f-c2d41dc27fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:38.974014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef36004-ce32-48ce-960f-c2d41dc27fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:38.975597 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef36004-ce32-48ce-960f-c2d41dc27fa1 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:38.990103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1232/2440] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:29:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:29:42.069005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:48.982960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=46 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:52.289478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ddbba-d698-4fa8-9976-909f2c01695b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:52.290364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ddbba-d698-4fa8-9976-909f2c01695b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:52.290364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ddbba-d698-4fa8-9976-909f2c01695b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:52.330358 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-311ddbba-d698-4fa8-9976-909f2c01695b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:52.332248 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-311ddbba-d698-4fa8-9976-909f2c01695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:52.460763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1209/2441] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Jul 15 15:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:29:52.484120 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef36004-ce32-48ce-960f-c2d41dc27fa1 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:52.486193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cef36004-ce32-48ce-960f-c2d41dc27fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:52.582904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef36004-ce32-48ce-960f-c2d41dc27fa1 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:52.589725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aabba7-a60c-4781-89de-ef6f1e05d784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:52.590402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aabba7-a60c-4781-89de-ef6f1e05d784 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:52.590870 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aabba7-a60c-4781-89de-ef6f1e05d784 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:52.591167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aabba7-a60c-4781-89de-ef6f1e05d784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:52.604078 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aabba7-a60c-4781-89de-ef6f1e05d784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:52.605790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aabba7-a60c-4781-89de-ef6f1e05d784 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:52.616351 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1233/2442] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:29:53.522640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7731ac-b078-48dd-b4ea-d578130dd87a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:53.523241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7731ac-b078-48dd-b4ea-d578130dd87a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:53.523241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7731ac-b078-48dd-b4ea-d578130dd87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:53.541168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9b7731ac-b078-48dd-b4ea-d578130dd87a None None] MFA Rules not processed for user `0383866c48dc4e6a99608d3079d15ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:53.542374 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9b7731ac-b078-48dd-b4ea-d578130dd87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:53.597247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1210/2443] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:29:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:29:55.605056 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac34a0c-3a6b-4678-a755-49c095be6eb1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:55.605572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac34a0c-3a6b-4678-a755-49c095be6eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:55.605657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac34a0c-3a6b-4678-a755-49c095be6eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:55.623790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4ac34a0c-3a6b-4678-a755-49c095be6eb1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:55.625936 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4ac34a0c-3a6b-4678-a755-49c095be6eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:55.634742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1234/2444] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Jul 15 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:29:55.650267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7731ac-b078-48dd-b4ea-d578130dd87a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:55.663429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7731ac-b078-48dd-b4ea-d578130dd87a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:55.669870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af41e2-ec00-43e0-8904-0dc7f1f5795d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:55.670708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af41e2-ec00-43e0-8904-0dc7f1f5795d service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:55.670998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af41e2-ec00-43e0-8904-0dc7f1f5795d service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:55.671281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af41e2-ec00-43e0-8904-0dc7f1f5795d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:55.681568 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af41e2-ec00-43e0-8904-0dc7f1f5795d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:55.683308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af41e2-ec00-43e0-8904-0dc7f1f5795d service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:55.695788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1211/2445] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:29:58.665921 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ffedd-69b7-4348-8b95-665521476b07 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:58.666442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ffedd-69b7-4348-8b95-665521476b07 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:58.666559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ffedd-69b7-4348-8b95-665521476b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:58.685222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-939ffedd-69b7-4348-8b95-665521476b07 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:58.686424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-939ffedd-69b7-4348-8b95-665521476b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:58.695083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1235/2446] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Jul 15 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:29:58.714094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af41e2-ec00-43e0-8904-0dc7f1f5795d service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:58.725497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af41e2-ec00-43e0-8904-0dc7f1f5795d service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:58.731032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f68a93-2689-4489-9d14-087c1278301b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:58.731722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f68a93-2689-4489-9d14-087c1278301b service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:58.732004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f68a93-2689-4489-9d14-087c1278301b service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:58.732286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f68a93-2689-4489-9d14-087c1278301b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:58.741287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f68a93-2689-4489-9d14-087c1278301b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:58.742879 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f68a93-2689-4489-9d14-087c1278301b service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:58.753145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1212/2447] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:30:02.854938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361eeb86-14e1-431e-afec-08251270d9c1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:02.855514 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361eeb86-14e1-431e-afec-08251270d9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:02.855514 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361eeb86-14e1-431e-afec-08251270d9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:02.874166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-361eeb86-14e1-431e-afec-08251270d9c1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:02.875949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-361eeb86-14e1-431e-afec-08251270d9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:02.884493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1236/2448] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Jul 15 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:30:02.902160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f68a93-2689-4489-9d14-087c1278301b service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:02.904212 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-64f68a93-2689-4489-9d14-087c1278301b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:02.920832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f68a93-2689-4489-9d14-087c1278301b service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:02.926499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6fe6b-59ae-4825-9caa-8e645fae295e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:02.927158 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6fe6b-59ae-4825-9caa-8e645fae295e service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:02.927447 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6fe6b-59ae-4825-9caa-8e645fae295e service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:02.927725 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6fe6b-59ae-4825-9caa-8e645fae295e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:02.936991 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6fe6b-59ae-4825-9caa-8e645fae295e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:02.939164 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6fe6b-59ae-4825-9caa-8e645fae295e service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:02.949212 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1213/2449] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:30:06.026219 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01fc9-1b0e-452a-afd1-305196b15790 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.027734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01fc9-1b0e-452a-afd1-305196b15790 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.027734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01fc9-1b0e-452a-afd1-305196b15790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.045684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-73f01fc9-1b0e-452a-afd1-305196b15790 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:06.046951 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-73f01fc9-1b0e-452a-afd1-305196b15790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:06.054991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1237/2450] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Jul 15 15:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:30:06.081535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6fe6b-59ae-4825-9caa-8e645fae295e service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:06.093248 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6fe6b-59ae-4825-9caa-8e645fae295e service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:06.099194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4479e-c0b8-4dc0-9145-c847e011392a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:06.099841 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4479e-c0b8-4dc0-9145-c847e011392a service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.100138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4479e-c0b8-4dc0-9145-c847e011392a service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.100419 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4479e-c0b8-4dc0-9145-c847e011392a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.108972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4479e-c0b8-4dc0-9145-c847e011392a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:06.110595 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4479e-c0b8-4dc0-9145-c847e011392a service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:06.120485 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1214/2451] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:30:16.039973 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=46 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:16.116218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=76 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:28.630723 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8b4fa-7272-4254-8a87-18de679a7108 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:28.631550 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8b4fa-7272-4254-8a87-18de679a7108 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:28.631550 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8b4fa-7272-4254-8a87-18de679a7108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:28.650831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6bb8b4fa-7272-4254-8a87-18de679a7108 None None] MFA Rules not processed for user `0c4b2c84be7d4670a7232ae93db14740`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:28.652041 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6bb8b4fa-7272-4254-8a87-18de679a7108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:28.734276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1238/2452] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:30:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:30:38.726817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=25 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:40.428044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4479e-c0b8-4dc0-9145-c847e011392a service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:40.429399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7ea4479e-c0b8-4dc0-9145-c847e011392a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:40.447675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4479e-c0b8-4dc0-9145-c847e011392a service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:40.454348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa533c-7db3-4206-b496-4bf9d99c6a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:40.455268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa533c-7db3-4206-b496-4bf9d99c6a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:40.455568 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa533c-7db3-4206-b496-4bf9d99c6a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:40.456702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa533c-7db3-4206-b496-4bf9d99c6a47 admin admin] PATH_INFO: `/v3/users/8b34dc9595cb45a993f2ad47a23d639b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:40.458370 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa533c-7db3-4206-b496-4bf9d99c6a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b34dc9595cb45a993f2ad47a23d639b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:40.460938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa533c-7db3-4206-b496-4bf9d99c6a47 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:40.542427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8efa533c-7db3-4206-b496-4bf9d99c6a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b34dc9595cb45a993f2ad47a23d639b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:40.561831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8efa533c-7db3-4206-b496-4bf9d99c6a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b34dc9595cb45a993f2ad47a23d639b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:40.574875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8efa533c-7db3-4206-b496-4bf9d99c6a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b34dc9595cb45a993f2ad47a23d639b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:40.590555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8efa533c-7db3-4206-b496-4bf9d99c6a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b34dc9595cb45a993f2ad47a23d639b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:40.592779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8efa533c-7db3-4206-b496-4bf9d99c6a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b34dc9595cb45a993f2ad47a23d639b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:40.612856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1215/2453] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:30:40 2022] DELETE /identity/v3/users/8b34dc9595cb45a993f2ad47a23d639b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:30:40.925706 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8b4fa-7272-4254-8a87-18de679a7108 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:40.942611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8b4fa-7272-4254-8a87-18de679a7108 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:41.057396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10153b2-d3e5-420a-92bf-800a817de2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:41.058599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10153b2-d3e5-420a-92bf-800a817de2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.059054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10153b2-d3e5-420a-92bf-800a817de2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.059641 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10153b2-d3e5-420a-92bf-800a817de2a9 admin admin] PATH_INFO: `/v3/projects/e3415881308b4956bcaf39334c5f4d76` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.064154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10153b2-d3e5-420a-92bf-800a817de2a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3415881308b4956bcaf39334c5f4d76)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:41.066734 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10153b2-d3e5-420a-92bf-800a817de2a9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:41.176004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b10153b2-d3e5-420a-92bf-800a817de2a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3415881308b4956bcaf39334c5f4d76', 'request_id': 'req-b10153b2-d3e5-420a-92bf-800a817de2a9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:41.187176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b10153b2-d3e5-420a-92bf-800a817de2a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3415881308b4956bcaf39334c5f4d76', 'request_id': 'req-b10153b2-d3e5-420a-92bf-800a817de2a9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:41.208674 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b10153b2-d3e5-420a-92bf-800a817de2a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3415881308b4956bcaf39334c5f4d76', 'request_id': 'req-b10153b2-d3e5-420a-92bf-800a817de2a9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:41.229268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b10153b2-d3e5-420a-92bf-800a817de2a9 admin admin] The token cache is being invalidate because project e3415881308b4956bcaf39334c5f4d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:30:41.229749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b10153b2-d3e5-420a-92bf-800a817de2a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:41.230848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b10153b2-d3e5-420a-92bf-800a817de2a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:41.233148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1239/2454] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:30:40 2022] DELETE /identity/v3/projects/e3415881308b4956bcaf39334c5f4d76 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:41.239387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536ada6-d96f-4ad8-b762-ff7528641ae2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.239669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536ada6-d96f-4ad8-b762-ff7528641ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.239968 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536ada6-d96f-4ad8-b762-ff7528641ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.267855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f536ada6-d96f-4ad8-b762-ff7528641ae2 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:41.269586 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f536ada6-d96f-4ad8-b762-ff7528641ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:41.387348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1216/2455] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:30:41.397324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c655400-93af-404a-8a45-15ee6d5e3419 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.397786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c655400-93af-404a-8a45-15ee6d5e3419 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.398267 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c655400-93af-404a-8a45-15ee6d5e3419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.424589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7c655400-93af-404a-8a45-15ee6d5e3419 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:41.426343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7c655400-93af-404a-8a45-15ee6d5e3419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:41.440791 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1240/2456] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:30:41.446748 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536ada6-d96f-4ad8-b762-ff7528641ae2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:41.462387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536ada6-d96f-4ad8-b762-ff7528641ae2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:41.470055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164af376-837a-4c7e-964d-d46c7d5c1abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:41.470924 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164af376-837a-4c7e-964d-d46c7d5c1abb admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.471217 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164af376-837a-4c7e-964d-d46c7d5c1abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.471505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164af376-837a-4c7e-964d-d46c7d5c1abb admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.472265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164af376-837a-4c7e-964d-d46c7d5c1abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:41.474345 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164af376-837a-4c7e-964d-d46c7d5c1abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:41.477325 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164af376-837a-4c7e-964d-d46c7d5c1abb admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:41.502006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1217/2457] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:41.508440 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c655400-93af-404a-8a45-15ee6d5e3419 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:41.526051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c655400-93af-404a-8a45-15ee6d5e3419 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:41.537090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b678067-d0ae-45c3-b31b-736b335b78a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:41.537802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b678067-d0ae-45c3-b31b-736b335b78a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.538091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b678067-d0ae-45c3-b31b-736b335b78a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.538372 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b678067-d0ae-45c3-b31b-736b335b78a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.539100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b678067-d0ae-45c3-b31b-736b335b78a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:41.542445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b678067-d0ae-45c3-b31b-736b335b78a8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:41.587665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1241/2458] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:30:41 2022] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:30:41.592157 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164af376-837a-4c7e-964d-d46c7d5c1abb admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:41.609524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164af376-837a-4c7e-964d-d46c7d5c1abb admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:41.696641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a5878-f323-4b82-af0b-f5e2c462396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:41.697495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a5878-f323-4b82-af0b-f5e2c462396b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.697999 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a5878-f323-4b82-af0b-f5e2c462396b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.698593 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a5878-f323-4b82-af0b-f5e2c462396b admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.699499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a5878-f323-4b82-af0b-f5e2c462396b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:41.702061 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a5878-f323-4b82-af0b-f5e2c462396b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:41.710174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:41.738505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1218/2459] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:30:41 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:30:41.746714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b678067-d0ae-45c3-b31b-736b335b78a8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:41.762947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b678067-d0ae-45c3-b31b-736b335b78a8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:41.768889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5bbb2-f386-401c-89a5-ac478a7605dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:41.769724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5bbb2-f386-401c-89a5-ac478a7605dc admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.770106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5bbb2-f386-401c-89a5-ac478a7605dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.771492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5bbb2-f386-401c-89a5-ac478a7605dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.771492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5bbb2-f386-401c-89a5-ac478a7605dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:41.772782 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5bbb2-f386-401c-89a5-ac478a7605dc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:41.788280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1242/2460] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:30:41.794640 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a5878-f323-4b82-af0b-f5e2c462396b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:41.812424 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a5878-f323-4b82-af0b-f5e2c462396b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:41.818950 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c7901-0bb3-4c32-91e0-e30f040fc56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:41.819811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c7901-0bb3-4c32-91e0-e30f040fc56d admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.819925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c7901-0bb3-4c32-91e0-e30f040fc56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.820202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c7901-0bb3-4c32-91e0-e30f040fc56d admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.820961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c7901-0bb3-4c32-91e0-e30f040fc56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:41.822721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c7901-0bb3-4c32-91e0-e30f040fc56d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:41.834848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1219/2461] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:30:41.840219 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5bbb2-f386-401c-89a5-ac478a7605dc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:41.853905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5bbb2-f386-401c-89a5-ac478a7605dc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:41.861438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f9cf6-95d8-4616-97e9-716e5c8e0d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:41.862856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f9cf6-95d8-4616-97e9-716e5c8e0d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.863148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f9cf6-95d8-4616-97e9-716e5c8e0d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.863444 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f9cf6-95d8-4616-97e9-716e5c8e0d05 admin admin] PATH_INFO: `/v3/projects/ced4cf271167433ca749febd1be89f71/users/577770df28314ed4883ce6655c891da7/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.885176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f9cf6-95d8-4616-97e9-716e5c8e0d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced4cf271167433ca749febd1be89f71, user_id=577770df28314ed4883ce6655c891da7, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:41.890666 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f9cf6-95d8-4616-97e9-716e5c8e0d05 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:41.913725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1243/2462] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:30:41 2022] PUT /identity/v3/projects/ced4cf271167433ca749febd1be89f71/users/577770df28314ed4883ce6655c891da7/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:41.925483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b149cc-4a50-4bc4-8793-b3db531f1e93 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.925773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b149cc-4a50-4bc4-8793-b3db531f1e93 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.926045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b149cc-4a50-4bc4-8793-b3db531f1e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.974089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-15b149cc-4a50-4bc4-8793-b3db531f1e93 None None] MFA Rules not processed for user `577770df28314ed4883ce6655c891da7`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:41.976993 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-15b149cc-4a50-4bc4-8793-b3db531f1e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:42.071194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1220/2463] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:30:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:30:42.087456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f9cf6-95d8-4616-97e9-716e5c8e0d05 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:42.090175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ec4f9cf6-95d8-4616-97e9-716e5c8e0d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:42.129253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:42.174403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f9cf6-95d8-4616-97e9-716e5c8e0d05 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:42.179656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a8755-4d48-451c-84c5-88844ea3d76d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:42.180596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a8755-4d48-451c-84c5-88844ea3d76d service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:42.180897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a8755-4d48-451c-84c5-88844ea3d76d service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:42.181325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a8755-4d48-451c-84c5-88844ea3d76d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:42.200699 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a8755-4d48-451c-84c5-88844ea3d76d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:42.202308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a8755-4d48-451c-84c5-88844ea3d76d service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:42.212675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1244/2464] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:30:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:30:46.308123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b149cc-4a50-4bc4-8793-b3db531f1e93 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:46.339861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b149cc-4a50-4bc4-8793-b3db531f1e93 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:46.346838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dda388-b5ea-456d-9ea2-e83077a1701e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:46.348749 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dda388-b5ea-456d-9ea2-e83077a1701e service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:46.349303 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dda388-b5ea-456d-9ea2-e83077a1701e service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:46.349731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dda388-b5ea-456d-9ea2-e83077a1701e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:46.354842 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-86dda388-b5ea-456d-9ea2-e83077a1701e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:46.483506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dda388-b5ea-456d-9ea2-e83077a1701e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:46.487142 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dda388-b5ea-456d-9ea2-e83077a1701e service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:46.504451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1221/2465] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:30:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:30:49.114609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a8755-4d48-451c-84c5-88844ea3d76d service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:49.123731 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a8755-4d48-451c-84c5-88844ea3d76d service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:49.128998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0aa288-d732-49bc-922c-a9b011cea62e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:49.130207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aa288-d732-49bc-922c-a9b011cea62e service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:49.130715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aa288-d732-49bc-922c-a9b011cea62e service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:49.131161 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aa288-d732-49bc-922c-a9b011cea62e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:49.133639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cb0aa288-d732-49bc-922c-a9b011cea62e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:49.152785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0aa288-d732-49bc-922c-a9b011cea62e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:49.154214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0aa288-d732-49bc-922c-a9b011cea62e service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:49.168152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1245/2466] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:30:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:30:52.762466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dda388-b5ea-456d-9ea2-e83077a1701e service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:52.837351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:52.856409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dda388-b5ea-456d-9ea2-e83077a1701e service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:52.862672 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:52.863834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:52.864294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:52.864624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] PATH_INFO: `/v3/users/577770df28314ed4883ce6655c891da7` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:52.866109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=577770df28314ed4883ce6655c891da7)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:52.868314 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:52.928241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577770df28314ed4883ce6655c891da7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:52.949186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577770df28314ed4883ce6655c891da7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:52.961009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577770df28314ed4883ce6655c891da7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:52.970766 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577770df28314ed4883ce6655c891da7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:52.971698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577770df28314ed4883ce6655c891da7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:52.982495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1222/2467] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:30:52 2022] DELETE /identity/v3/users/577770df28314ed4883ce6655c891da7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:52.988861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3642c23-aa16-49d2-83c7-dba44b6ca64c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:52.989677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3642c23-aa16-49d2-83c7-dba44b6ca64c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:52.989677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3642c23-aa16-49d2-83c7-dba44b6ca64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:53.010747 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f3642c23-aa16-49d2-83c7-dba44b6ca64c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:53.012982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f3642c23-aa16-49d2-83c7-dba44b6ca64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:53.090145 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1246/2468] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:30:53.106227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:53.108686 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:53.191501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e695e-0c2a-4a94-b680-0a18b6a31f33 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:53.195727 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e38dfa-c3f2-44b2-8052-eaf939ee7af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:53.196406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e38dfa-c3f2-44b2-8052-eaf939ee7af2 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:53.196688 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e38dfa-c3f2-44b2-8052-eaf939ee7af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:53.196974 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e38dfa-c3f2-44b2-8052-eaf939ee7af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:53.208187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e38dfa-c3f2-44b2-8052-eaf939ee7af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:53.209805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e38dfa-c3f2-44b2-8052-eaf939ee7af2 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:53.220972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1223/2469] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:30:53.539854 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3642c23-aa16-49d2-83c7-dba44b6ca64c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:53.542087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f3642c23-aa16-49d2-83c7-dba44b6ca64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:53.555874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3642c23-aa16-49d2-83c7-dba44b6ca64c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:53.560834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:53.561741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:53.562026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:53.562300 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5 admin admin] PATH_INFO: `/v3/projects/ced4cf271167433ca749febd1be89f71` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:53.563590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced4cf271167433ca749febd1be89f71)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:53.565944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:53.625280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced4cf271167433ca749febd1be89f71', 'request_id': 'req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:53.632315 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced4cf271167433ca749febd1be89f71', 'request_id': 'req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:53.642054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced4cf271167433ca749febd1be89f71', 'request_id': 'req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:53.657757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5 admin admin] The token cache is being invalidate because project ced4cf271167433ca749febd1be89f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:30:53.658182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:53.659458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e8f38d33-f22d-48f7-aa7c-3eebd583a3f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:30:53.661263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1247/2470] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:30:53 2022] DELETE /identity/v3/projects/ced4cf271167433ca749febd1be89f71 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:31:03.216036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:03.651937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:04.761438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e38dfa-c3f2-44b2-8052-eaf939ee7af2 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:04.763242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-37e38dfa-c3f2-44b2-8052-eaf939ee7af2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:04.865208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e38dfa-c3f2-44b2-8052-eaf939ee7af2 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:04.954331 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3eb721-ef1e-42b8-b775-4267a977fced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:04.955228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eb721-ef1e-42b8-b775-4267a977fced service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.955710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eb721-ef1e-42b8-b775-4267a977fced service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.956070 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eb721-ef1e-42b8-b775-4267a977fced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.959198 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bd3eb721-ef1e-42b8-b775-4267a977fced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:05.050707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3eb721-ef1e-42b8-b775-4267a977fced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:05.052526 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3eb721-ef1e-42b8-b775-4267a977fced service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:05.065755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1224/2471] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:31:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:31:10.167067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742a1cb-f02a-48e7-8c51-3ceec0396acf None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:10.167776 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742a1cb-f02a-48e7-8c51-3ceec0396acf None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:10.167956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742a1cb-f02a-48e7-8c51-3ceec0396acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:10.199482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6742a1cb-f02a-48e7-8c51-3ceec0396acf None None] MFA Rules not processed for user `c0023517ec494a01a7bc4bae3fdfb562`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:10.200807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6742a1cb-f02a-48e7-8c51-3ceec0396acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:10.304637 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1248/2472] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:31:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:31:15.059324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=84 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:17.472761 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3eb721-ef1e-42b8-b775-4267a977fced service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:17.485018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bd3eb721-ef1e-42b8-b775-4267a977fced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:17.615090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3eb721-ef1e-42b8-b775-4267a977fced service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:17.620607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543b8a3-ed60-4bee-9b30-9952fa125a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:17.621598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b8a3-ed60-4bee-9b30-9952fa125a05 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:17.622883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b8a3-ed60-4bee-9b30-9952fa125a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:17.623470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b8a3-ed60-4bee-9b30-9952fa125a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:17.626698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c543b8a3-ed60-4bee-9b30-9952fa125a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:17.640594 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543b8a3-ed60-4bee-9b30-9952fa125a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:17.642856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543b8a3-ed60-4bee-9b30-9952fa125a05 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:17.668541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1225/2473] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:31:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:31:20.292965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=25 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:21.019260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa6a2-ed38-473b-b4f3-0353d255550a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.019555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa6a2-ed38-473b-b4f3-0353d255550a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.019837 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa6a2-ed38-473b-b4f3-0353d255550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.040717 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-81faa6a2-ed38-473b-b4f3-0353d255550a None None] MFA Rules not processed for user `0383866c48dc4e6a99608d3079d15ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:21.042154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-81faa6a2-ed38-473b-b4f3-0353d255550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:21.049908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1249/2474] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:31:21.363505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543b8a3-ed60-4bee-9b30-9952fa125a05 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.364913 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c543b8a3-ed60-4bee-9b30-9952fa125a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:21.375314 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543b8a3-ed60-4bee-9b30-9952fa125a05 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.379019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe07c19-f33d-48cd-9849-e1de92dc0779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.379671 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe07c19-f33d-48cd-9849-e1de92dc0779 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.379958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe07c19-f33d-48cd-9849-e1de92dc0779 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.380238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe07c19-f33d-48cd-9849-e1de92dc0779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.382007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-efe07c19-f33d-48cd-9849-e1de92dc0779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:21.392576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe07c19-f33d-48cd-9849-e1de92dc0779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.394048 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe07c19-f33d-48cd-9849-e1de92dc0779 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.402224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1226/2475] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:31:21.723131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faa6a2-ed38-473b-b4f3-0353d255550a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.724861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-81faa6a2-ed38-473b-b4f3-0353d255550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:21.797891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faa6a2-ed38-473b-b4f3-0353d255550a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.802939 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e16fe3-0d06-48c0-8e89-d6b156f39f31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba61318896f43e5a68e80f38ae5f3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.803591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e16fe3-0d06-48c0-8e89-d6b156f39f31 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.803872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e16fe3-0d06-48c0-8e89-d6b156f39f31 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.804147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e16fe3-0d06-48c0-8e89-d6b156f39f31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.805918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a0e16fe3-0d06-48c0-8e89-d6b156f39f31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:21.818168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e16fe3-0d06-48c0-8e89-d6b156f39f31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.819829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e16fe3-0d06-48c0-8e89-d6b156f39f31 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.830154 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1250/2476] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:31:24.668616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe07c19-f33d-48cd-9849-e1de92dc0779 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:24.670834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-efe07c19-f33d-48cd-9849-e1de92dc0779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:24.687013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe07c19-f33d-48cd-9849-e1de92dc0779 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:24.692782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118e861-a646-4fbf-b148-46189406995e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:24.693472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118e861-a646-4fbf-b148-46189406995e service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:24.693760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118e861-a646-4fbf-b148-46189406995e service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:24.694039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118e861-a646-4fbf-b148-46189406995e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:24.695861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3118e861-a646-4fbf-b148-46189406995e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:24.762220 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118e861-a646-4fbf-b148-46189406995e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:24.763867 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118e861-a646-4fbf-b148-46189406995e service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:24.773789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1227/2477] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:31:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:31:31.825798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=35 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:32.427793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e16fe3-0d06-48c0-8e89-d6b156f39f31 service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:32.429349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a0e16fe3-0d06-48c0-8e89-d6b156f39f31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:32.445092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e16fe3-0d06-48c0-8e89-d6b156f39f31 service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:32.450754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6b210-5ab0-448a-a4bf-a00cc53d650c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:32.451495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6b210-5ab0-448a-a4bf-a00cc53d650c service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:32.451849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6b210-5ab0-448a-a4bf-a00cc53d650c service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:32.452198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6b210-5ab0-448a-a4bf-a00cc53d650c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:32.454248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2ad6b210-5ab0-448a-a4bf-a00cc53d650c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:32.467831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6b210-5ab0-448a-a4bf-a00cc53d650c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:32.469478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6b210-5ab0-448a-a4bf-a00cc53d650c service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:32.480749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1251/2478] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:31:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:31:34.769521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=60 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:42.475930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:44.816938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118e861-a646-4fbf-b148-46189406995e service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:44.829533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118e861-a646-4fbf-b148-46189406995e service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:44.835427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6091f-8fdc-4660-8174-c9f935153124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:44.836054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6091f-8fdc-4660-8174-c9f935153124 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:44.836339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6091f-8fdc-4660-8174-c9f935153124 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:44.836618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6091f-8fdc-4660-8174-c9f935153124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:44.838458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5ec6091f-8fdc-4660-8174-c9f935153124 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:44.852422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6091f-8fdc-4660-8174-c9f935153124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:44.854054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6091f-8fdc-4660-8174-c9f935153124 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:44.866005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1228/2479] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:31:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:31:45.338326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5ba95-601f-476d-a698-64e4b2f15e5d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:45.338870 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5ba95-601f-476d-a698-64e4b2f15e5d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:45.338972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5ba95-601f-476d-a698-64e4b2f15e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:45.357343 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-37f5ba95-601f-476d-a698-64e4b2f15e5d None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:45.358635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-37f5ba95-601f-476d-a698-64e4b2f15e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:45.415566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1252/2480] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:31:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:31:45.469148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6091f-8fdc-4660-8174-c9f935153124 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:45.470811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5ec6091f-8fdc-4660-8174-c9f935153124 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:45.543616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6091f-8fdc-4660-8174-c9f935153124 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:45.548768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d78e0c-40e7-4989-8702-15538d785b13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:45.549459 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d78e0c-40e7-4989-8702-15538d785b13 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:45.549747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d78e0c-40e7-4989-8702-15538d785b13 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:45.550028 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d78e0c-40e7-4989-8702-15538d785b13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:45.558416 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d78e0c-40e7-4989-8702-15538d785b13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:45.560614 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d78e0c-40e7-4989-8702-15538d785b13 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:45.569741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1229/2481] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:31:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 15:31:55.407740 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=25 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:55.566245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=38 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:04.124881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af101a6-dcd1-43c8-b5de-a72ad3567253 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:04.125866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af101a6-dcd1-43c8-b5de-a72ad3567253 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:04.126485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af101a6-dcd1-43c8-b5de-a72ad3567253 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:04.128489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1253/2482] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:32:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:32:04.137697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3682c67-e6e4-44fe-97c9-2532c38603f2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:04.138739 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3682c67-e6e4-44fe-97c9-2532c38603f2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:04.139172 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3682c67-e6e4-44fe-97c9-2532c38603f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:04.161698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d3682c67-e6e4-44fe-97c9-2532c38603f2 None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:04.163197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d3682c67-e6e4-44fe-97c9-2532c38603f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:04.181219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1230/2483] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:04.212057 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af101a6-dcd1-43c8-b5de-a72ad3567253 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:04.214952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2af101a6-dcd1-43c8-b5de-a72ad3567253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:04.308928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af101a6-dcd1-43c8-b5de-a72ad3567253 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:04.314656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca23369-f80d-4b05-bded-52195e8d350b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a4ae82b1b4619b90f9ad0f3dea5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:04.315548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca23369-f80d-4b05-bded-52195e8d350b service glance] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:04.316173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca23369-f80d-4b05-bded-52195e8d350b service glance] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:04.317009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca23369-f80d-4b05-bded-52195e8d350b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:04.346417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca23369-f80d-4b05-bded-52195e8d350b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:04.349610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca23369-f80d-4b05-bded-52195e8d350b service glance] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:04.368916 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1254/2484] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:04.456570 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec863e-26e8-4a7f-ab6b-ad16a670a8bf None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:04.456873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec863e-26e8-4a7f-ab6b-ad16a670a8bf None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:04.457165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec863e-26e8-4a7f-ab6b-ad16a670a8bf None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:04.459243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1231/2485] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:32:04.464968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797a08b-12fc-473a-8a3f-74be4d963395 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:04.465462 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797a08b-12fc-473a-8a3f-74be4d963395 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:04.465866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797a08b-12fc-473a-8a3f-74be4d963395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:04.499763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3797a08b-12fc-473a-8a3f-74be4d963395 None None] MFA Rules not processed for user `88518fe83a7c4fbdb3088bb2daf04239`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:04.502287 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3797a08b-12fc-473a-8a3f-74be4d963395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:04.510632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1255/2486] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:04.523646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec863e-26e8-4a7f-ab6b-ad16a670a8bf None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:04.535983 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec863e-26e8-4a7f-ab6b-ad16a670a8bf None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:04.542023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29845cc-93ef-40a0-940e-c878f2becf65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:04.542702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29845cc-93ef-40a0-940e-c878f2becf65 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:04.542992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29845cc-93ef-40a0-940e-c878f2becf65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:04.543271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29845cc-93ef-40a0-940e-c878f2becf65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:04.553366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29845cc-93ef-40a0-940e-c878f2becf65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:04.554972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29845cc-93ef-40a0-940e-c878f2becf65 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:04.566229 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1232/2487] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:04.691129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86490009-b633-4b4e-94e5-23992dd5fac5 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:04.691802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86490009-b633-4b4e-94e5-23992dd5fac5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:04.692402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86490009-b633-4b4e-94e5-23992dd5fac5 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:04.695276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1256/2488] 10.222.0.64 () {54 vars in 921 bytes} [Fri Jul 15 15:32:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:32:04.705797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21edd02-5ac3-45ca-b11c-8cd63879fde7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:04.706096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21edd02-5ac3-45ca-b11c-8cd63879fde7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:04.706385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21edd02-5ac3-45ca-b11c-8cd63879fde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:04.726659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a21edd02-5ac3-45ca-b11c-8cd63879fde7 None None] MFA Rules not processed for user `b022a37031b940c3bd67861373926e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:04.728021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a21edd02-5ac3-45ca-b11c-8cd63879fde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:04.739101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1233/2489] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Jul 15 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:04.750796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86490009-b633-4b4e-94e5-23992dd5fac5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:04.764169 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86490009-b633-4b4e-94e5-23992dd5fac5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:04.768989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76f5ef-bba9-4c8b-896c-913be4ec341e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:04.769708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76f5ef-bba9-4c8b-896c-913be4ec341e service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:04.769995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76f5ef-bba9-4c8b-896c-913be4ec341e service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:04.770274 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76f5ef-bba9-4c8b-896c-913be4ec341e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:04.786941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76f5ef-bba9-4c8b-896c-913be4ec341e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:04.789247 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76f5ef-bba9-4c8b-896c-913be4ec341e service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:04.801685 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1257/2490] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:05.753081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21edd02-5ac3-45ca-b11c-8cd63879fde7 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:05.754550 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a21edd02-5ac3-45ca-b11c-8cd63879fde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:05.830572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21edd02-5ac3-45ca-b11c-8cd63879fde7 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:05.843860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16f0ca-888e-4245-a17a-0142378f2f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:05.844548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16f0ca-888e-4245-a17a-0142378f2f55 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:05.844833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16f0ca-888e-4245-a17a-0142378f2f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:05.845311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16f0ca-888e-4245-a17a-0142378f2f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:05.847650 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-aa16f0ca-888e-4245-a17a-0142378f2f55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:05.861731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16f0ca-888e-4245-a17a-0142378f2f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:05.863230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16f0ca-888e-4245-a17a-0142378f2f55 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:05.885230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1234/2491] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:06.711334 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2be9-c309-4bca-89a8-21132310b265 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:06.712129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2be9-c309-4bca-89a8-21132310b265 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:06.712306 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2be9-c309-4bca-89a8-21132310b265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:06.742187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3f9a2be9-c309-4bca-89a8-21132310b265 None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:06.743568 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3f9a2be9-c309-4bca-89a8-21132310b265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:06.751464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1258/2492] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:32:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:06.765124 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16f0ca-888e-4245-a17a-0142378f2f55 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:06.786215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16f0ca-888e-4245-a17a-0142378f2f55 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:06.791762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c3a7-1046-4f3d-8ee1-8e41d0a72276 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:06.793087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c3a7-1046-4f3d-8ee1-8e41d0a72276 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:06.793386 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c3a7-1046-4f3d-8ee1-8e41d0a72276 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:06.793665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c3a7-1046-4f3d-8ee1-8e41d0a72276 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:06.802609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96c3a7-1046-4f3d-8ee1-8e41d0a72276 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:06.804214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96c3a7-1046-4f3d-8ee1-8e41d0a72276 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:06.813378 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1235/2493] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:32:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:32:16.734299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=38 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:16.809520 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=44 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:27.166001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7dfcb-44ed-47d5-84d0-d43a5428bee7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:27.167472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7dfcb-44ed-47d5-84d0-d43a5428bee7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:27.168022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7dfcb-44ed-47d5-84d0-d43a5428bee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:27.186219 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-bde7dfcb-44ed-47d5-84d0-d43a5428bee7 None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:27.187446 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bde7dfcb-44ed-47d5-84d0-d43a5428bee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:27.195063 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1259/2494] 10.222.0.64 () {58 vars in 967 bytes} [Fri Jul 15 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:27.207842 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c3a7-1046-4f3d-8ee1-8e41d0a72276 service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:27.219815 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c3a7-1046-4f3d-8ee1-8e41d0a72276 service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:27.225132 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f6810-1d41-42f3-8735-976b2b96f75c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:27.225791 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f6810-1d41-42f3-8735-976b2b96f75c service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:27.226080 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f6810-1d41-42f3-8735-976b2b96f75c service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:27.226364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f6810-1d41-42f3-8735-976b2b96f75c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:27.235483 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f6810-1d41-42f3-8735-976b2b96f75c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:27.237109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f6810-1d41-42f3-8735-976b2b96f75c service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:27.246005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1236/2495] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:32:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:32:31.576076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7dfcb-44ed-47d5-84d0-d43a5428bee7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:31.585909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7dfcb-44ed-47d5-84d0-d43a5428bee7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:31.589606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f49f6c-5c79-42f1-ac72-18f5415155a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:31.590265 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f49f6c-5c79-42f1-ac72-18f5415155a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:31.590756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f49f6c-5c79-42f1-ac72-18f5415155a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:31.591042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f49f6c-5c79-42f1-ac72-18f5415155a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:31.593611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-00f49f6c-5c79-42f1-ac72-18f5415155a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:31.682570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f49f6c-5c79-42f1-ac72-18f5415155a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:31.684210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f49f6c-5c79-42f1-ac72-18f5415155a8 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:31.699578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1260/2496] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:35.874628 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f6810-1d41-42f3-8735-976b2b96f75c service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:35.876158 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9d2f6810-1d41-42f3-8735-976b2b96f75c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:35.895554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f6810-1d41-42f3-8735-976b2b96f75c service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:35.904514 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1812a1-0b2b-405a-b30d-c12d188cf05d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba61318896f43e5a68e80f38ae5f3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:35.905274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1812a1-0b2b-405a-b30d-c12d188cf05d service placement] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:35.905708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1812a1-0b2b-405a-b30d-c12d188cf05d service placement] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:35.906274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1812a1-0b2b-405a-b30d-c12d188cf05d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:35.908779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-eb1812a1-0b2b-405a-b30d-c12d188cf05d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:35.925195 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1812a1-0b2b-405a-b30d-c12d188cf05d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:35.926818 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1812a1-0b2b-405a-b30d-c12d188cf05d service placement] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:35.941641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1237/2497] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:35.968970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f49f6c-5c79-42f1-ac72-18f5415155a8 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:35.970494 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-00f49f6c-5c79-42f1-ac72-18f5415155a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:35.986040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f49f6c-5c79-42f1-ac72-18f5415155a8 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:35.990841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb1454-998b-4d58-86c3-532f8618f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:35.991722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb1454-998b-4d58-86c3-532f8618f02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:35.992001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb1454-998b-4d58-86c3-532f8618f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:35.992275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb1454-998b-4d58-86c3-532f8618f02c admin admin] PATH_INFO: `/v3/users/c0023517ec494a01a7bc4bae3fdfb562` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:35.993499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb1454-998b-4d58-86c3-532f8618f02c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0023517ec494a01a7bc4bae3fdfb562)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:35.995961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb1454-998b-4d58-86c3-532f8618f02c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:36.044023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-37fb1454-998b-4d58-86c3-532f8618f02c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0023517ec494a01a7bc4bae3fdfb562'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:36.055915 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-37fb1454-998b-4d58-86c3-532f8618f02c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0023517ec494a01a7bc4bae3fdfb562'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:36.063407 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-37fb1454-998b-4d58-86c3-532f8618f02c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0023517ec494a01a7bc4bae3fdfb562'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:36.071662 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-37fb1454-998b-4d58-86c3-532f8618f02c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0023517ec494a01a7bc4bae3fdfb562'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:36.072294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-37fb1454-998b-4d58-86c3-532f8618f02c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0023517ec494a01a7bc4bae3fdfb562'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:36.079019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1261/2498] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:32:35 2022] DELETE /identity/v3/users/c0023517ec494a01a7bc4bae3fdfb562 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:36.253497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1812a1-0b2b-405a-b30d-c12d188cf05d service placement] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:36.264974 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1812a1-0b2b-405a-b30d-c12d188cf05d service placement] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:36.333793 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:36.334699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:36.334990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:36.335272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca admin admin] PATH_INFO: `/v3/projects/1735c3f344a24ae6821ab233c3537cd1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:36.336474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1735c3f344a24ae6821ab233c3537cd1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:36.339160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:36.394178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1735c3f344a24ae6821ab233c3537cd1', 'request_id': 'req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:36.402784 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1735c3f344a24ae6821ab233c3537cd1', 'request_id': 'req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:36.409476 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1735c3f344a24ae6821ab233c3537cd1', 'request_id': 'req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:36.420942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca admin admin] The token cache is being invalidate because project 1735c3f344a24ae6821ab233c3537cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:32:36.421274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:36.422027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bf03ada4-5ecc-475f-980d-cd1c602aa7ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:36.423601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1238/2499] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:32:36 2022] DELETE /identity/v3/projects/1735c3f344a24ae6821ab233c3537cd1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:36.428803 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa811708-9e85-478d-aaad-2f68274133f6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:36.429127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa811708-9e85-478d-aaad-2f68274133f6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:36.429416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa811708-9e85-478d-aaad-2f68274133f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:36.447157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-aa811708-9e85-478d-aaad-2f68274133f6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:36.448903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-aa811708-9e85-478d-aaad-2f68274133f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:36.502374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:36.518083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1262/2500] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:32:36.526484 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60e355-ce81-4050-b537-63962f802ba0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:36.526778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60e355-ce81-4050-b537-63962f802ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:36.527200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60e355-ce81-4050-b537-63962f802ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:36.546079 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-bc60e355-ce81-4050-b537-63962f802ba0 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:36.547639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bc60e355-ce81-4050-b537-63962f802ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:36.557595 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1239/2501] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:36.561802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa811708-9e85-478d-aaad-2f68274133f6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:36.571946 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa811708-9e85-478d-aaad-2f68274133f6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:36.577497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6592c-00c1-4634-b79c-c23150fc2473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:36.578158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6592c-00c1-4634-b79c-c23150fc2473 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:36.578445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6592c-00c1-4634-b79c-c23150fc2473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:36.578763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6592c-00c1-4634-b79c-c23150fc2473 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:36.579656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6592c-00c1-4634-b79c-c23150fc2473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:32:36.579969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6592c-00c1-4634-b79c-c23150fc2473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:36.581670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6592c-00c1-4634-b79c-c23150fc2473 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:36.596977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1263/2502] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:32:36.601029 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60e355-ce81-4050-b537-63962f802ba0 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:36.611681 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60e355-ce81-4050-b537-63962f802ba0 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:36.616650 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ca21f-3007-42b0-b8ce-9cbc9c7dba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:36.617475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ca21f-3007-42b0-b8ce-9cbc9c7dba45 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:36.617771 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ca21f-3007-42b0-b8ce-9cbc9c7dba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:36.618058 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ca21f-3007-42b0-b8ce-9cbc9c7dba45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:36.618772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ca21f-3007-42b0-b8ce-9cbc9c7dba45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:36.621282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ca21f-3007-42b0-b8ce-9cbc9c7dba45 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:36.649255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1240/2503] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:32:36 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:36.655575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6592c-00c1-4634-b79c-c23150fc2473 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:36.666268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6592c-00c1-4634-b79c-c23150fc2473 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:36.723588 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c407257-b86d-461d-817d-130234cd3d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:36.724259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c407257-b86d-461d-817d-130234cd3d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:36.724548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c407257-b86d-461d-817d-130234cd3d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:36.724829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c407257-b86d-461d-817d-130234cd3d4b admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:36.725558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c407257-b86d-461d-817d-130234cd3d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:36.727507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c407257-b86d-461d-817d-130234cd3d4b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:36.748409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1264/2504] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:32:36 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:36.752626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ca21f-3007-42b0-b8ce-9cbc9c7dba45 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:36.764057 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ca21f-3007-42b0-b8ce-9cbc9c7dba45 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:36.768902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c91db-e94b-4cfa-b104-d64680e171b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:36.769604 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c91db-e94b-4cfa-b104-d64680e171b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:36.769890 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c91db-e94b-4cfa-b104-d64680e171b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:36.770169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c91db-e94b-4cfa-b104-d64680e171b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:36.770894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c91db-e94b-4cfa-b104-d64680e171b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:36.772493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c91db-e94b-4cfa-b104-d64680e171b6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:36.782980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1241/2505] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:36.786960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c407257-b86d-461d-817d-130234cd3d4b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:36.797479 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c407257-b86d-461d-817d-130234cd3d4b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:36.802428 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8754b-3ca7-455b-9fcc-52409a4d7f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:36.803089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8754b-3ca7-455b-9fcc-52409a4d7f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:36.803371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8754b-3ca7-455b-9fcc-52409a4d7f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:36.803631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8754b-3ca7-455b-9fcc-52409a4d7f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:36.804361 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8754b-3ca7-455b-9fcc-52409a4d7f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:36.806054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8754b-3ca7-455b-9fcc-52409a4d7f2b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:36.818813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1265/2506] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:32:36.823263 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c91db-e94b-4cfa-b104-d64680e171b6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:36.833600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c91db-e94b-4cfa-b104-d64680e171b6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:36.838996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f22e7-f2f8-4c46-a3df-15ca54fd89bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:36.839907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f22e7-f2f8-4c46-a3df-15ca54fd89bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:36.840195 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f22e7-f2f8-4c46-a3df-15ca54fd89bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:36.840474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f22e7-f2f8-4c46-a3df-15ca54fd89bf admin admin] PATH_INFO: `/v3/projects/d1e6108403f44e91b1b570037abae511/users/2d9b9cce55b7477caea672af0dba0c8f/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:36.860827 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f22e7-f2f8-4c46-a3df-15ca54fd89bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e6108403f44e91b1b570037abae511, user_id=2d9b9cce55b7477caea672af0dba0c8f, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:36.863082 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f22e7-f2f8-4c46-a3df-15ca54fd89bf admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:36.873907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:36.879364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1242/2507] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:32:36 2022] PUT /identity/v3/projects/d1e6108403f44e91b1b570037abae511/users/2d9b9cce55b7477caea672af0dba0c8f/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:36.884183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84549b-2a67-4ab3-841a-e3b51a7ab201 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:36.884480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84549b-2a67-4ab3-841a-e3b51a7ab201 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:36.884763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84549b-2a67-4ab3-841a-e3b51a7ab201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:36.907826 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fb84549b-2a67-4ab3-841a-e3b51a7ab201 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:36.909042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fb84549b-2a67-4ab3-841a-e3b51a7ab201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:36.975005 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1266/2508] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:36.989803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f22e7-f2f8-4c46-a3df-15ca54fd89bf admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:36.991783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-683f22e7-f2f8-4c46-a3df-15ca54fd89bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:37.068811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f22e7-f2f8-4c46-a3df-15ca54fd89bf admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:37.072893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677423e-00d6-4928-9cff-18e9ed10d19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:37.073797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677423e-00d6-4928-9cff-18e9ed10d19b service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:37.074097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677423e-00d6-4928-9cff-18e9ed10d19b service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:37.074385 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677423e-00d6-4928-9cff-18e9ed10d19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:37.098738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677423e-00d6-4928-9cff-18e9ed10d19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:37.100306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677423e-00d6-4928-9cff-18e9ed10d19b service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:37.116348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1243/2509] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:38.238732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84549b-2a67-4ab3-841a-e3b51a7ab201 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:38.251028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84549b-2a67-4ab3-841a-e3b51a7ab201 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:38.255786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192ce5-d79e-46d8-9ba9-6d9b176feba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:38.256857 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192ce5-d79e-46d8-9ba9-6d9b176feba1 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:38.257441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192ce5-d79e-46d8-9ba9-6d9b176feba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:38.257930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192ce5-d79e-46d8-9ba9-6d9b176feba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:38.260243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b4192ce5-d79e-46d8-9ba9-6d9b176feba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:38.275200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4192ce5-d79e-46d8-9ba9-6d9b176feba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:38.278203 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4192ce5-d79e-46d8-9ba9-6d9b176feba1 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:38.299743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1267/2510] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:44.033557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e285c55-a587-4be9-9e11-f6f5ec33415d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:44.034031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e285c55-a587-4be9-9e11-f6f5ec33415d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:44.034152 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e285c55-a587-4be9-9e11-f6f5ec33415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:44.074515 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5e285c55-a587-4be9-9e11-f6f5ec33415d None None] MFA Rules not processed for user `2d9b9cce55b7477caea672af0dba0c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:44.076077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5e285c55-a587-4be9-9e11-f6f5ec33415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:44.155418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1244/2511] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:44.172796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192ce5-d79e-46d8-9ba9-6d9b176feba1 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:44.174981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b4192ce5-d79e-46d8-9ba9-6d9b176feba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:44.250131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:44.280196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192ce5-d79e-46d8-9ba9-6d9b176feba1 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:44.285928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af45e20-27ad-44bb-9e18-306fb5cf7d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:44.286705 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af45e20-27ad-44bb-9e18-306fb5cf7d4f service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:44.287049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af45e20-27ad-44bb-9e18-306fb5cf7d4f service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:44.287417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af45e20-27ad-44bb-9e18-306fb5cf7d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:44.299086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af45e20-27ad-44bb-9e18-306fb5cf7d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:44.301026 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af45e20-27ad-44bb-9e18-306fb5cf7d4f service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:44.312117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1268/2512] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:44.677357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e285c55-a587-4be9-9e11-f6f5ec33415d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:44.679076 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5e285c55-a587-4be9-9e11-f6f5ec33415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:44.694577 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e285c55-a587-4be9-9e11-f6f5ec33415d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:44.710151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb1235-a0f4-4cfc-9d91-6549869e4c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:44.711629 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb1235-a0f4-4cfc-9d91-6549869e4c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:44.713928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb1235-a0f4-4cfc-9d91-6549869e4c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:44.714245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb1235-a0f4-4cfc-9d91-6549869e4c2a admin admin] PATH_INFO: `/v3/users/0383866c48dc4e6a99608d3079d15ba3` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:44.715652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb1235-a0f4-4cfc-9d91-6549869e4c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0383866c48dc4e6a99608d3079d15ba3)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:44.718249 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb1235-a0f4-4cfc-9d91-6549869e4c2a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:44.794043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-06fb1235-a0f4-4cfc-9d91-6549869e4c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0383866c48dc4e6a99608d3079d15ba3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:44.815962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-06fb1235-a0f4-4cfc-9d91-6549869e4c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0383866c48dc4e6a99608d3079d15ba3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:44.827604 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-06fb1235-a0f4-4cfc-9d91-6549869e4c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0383866c48dc4e6a99608d3079d15ba3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:44.840213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-06fb1235-a0f4-4cfc-9d91-6549869e4c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0383866c48dc4e6a99608d3079d15ba3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:44.841643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-06fb1235-a0f4-4cfc-9d91-6549869e4c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0383866c48dc4e6a99608d3079d15ba3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:44.852255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1245/2513] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:32:44 2022] DELETE /identity/v3/users/0383866c48dc4e6a99608d3079d15ba3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:45.102018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af45e20-27ad-44bb-9e18-306fb5cf7d4f service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:45.114116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af45e20-27ad-44bb-9e18-306fb5cf7d4f service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:45.183062 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:45.184105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:45.184398 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:45.184841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68 admin admin] PATH_INFO: `/v3/projects/460ace684cf746f49212e98dcdb556ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:45.186459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460ace684cf746f49212e98dcdb556ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:45.189591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:45.260597 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460ace684cf746f49212e98dcdb556ce', 'request_id': 'req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:45.267475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460ace684cf746f49212e98dcdb556ce', 'request_id': 'req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:45.278640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460ace684cf746f49212e98dcdb556ce', 'request_id': 'req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:45.293366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68 admin admin] The token cache is being invalidate because project 460ace684cf746f49212e98dcdb556ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:32:45.293945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:45.294586 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-95aa0f6c-dfc7-453b-9ae2-e043a9becf68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:45.296362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1269/2514] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:32:45 2022] DELETE /identity/v3/projects/460ace684cf746f49212e98dcdb556ce => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:45.301647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8e39-d39a-4087-825a-bc2d1358c240 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:45.302110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8e39-d39a-4087-825a-bc2d1358c240 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:45.302233 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8e39-d39a-4087-825a-bc2d1358c240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:45.310398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:45.324805 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b8da8e39-d39a-4087-825a-bc2d1358c240 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:45.326755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b8da8e39-d39a-4087-825a-bc2d1358c240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:45.398891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1246/2515] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:32:45.407293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe40401-92e3-4f63-a9f3-16045c66a5b6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:45.407794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe40401-92e3-4f63-a9f3-16045c66a5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:45.408288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe40401-92e3-4f63-a9f3-16045c66a5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:45.429715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-efe40401-92e3-4f63-a9f3-16045c66a5b6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:45.431044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-efe40401-92e3-4f63-a9f3-16045c66a5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:45.461096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1270/2516] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:45.465262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8e39-d39a-4087-825a-bc2d1358c240 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:45.478941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8e39-d39a-4087-825a-bc2d1358c240 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:45.487042 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796350-2c65-46b0-901c-af484ca08a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:45.488386 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796350-2c65-46b0-901c-af484ca08a18 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:45.488677 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796350-2c65-46b0-901c-af484ca08a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:45.488955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796350-2c65-46b0-901c-af484ca08a18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:45.489741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796350-2c65-46b0-901c-af484ca08a18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:32:45.490119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796350-2c65-46b0-901c-af484ca08a18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:45.492643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796350-2c65-46b0-901c-af484ca08a18 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:45.513161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1247/2517] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:32:45.515021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe40401-92e3-4f63-a9f3-16045c66a5b6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:45.526482 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe40401-92e3-4f63-a9f3-16045c66a5b6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:45.535760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d1de8-a7b0-46f2-9dbf-00e25dd16678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:45.537372 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d1de8-a7b0-46f2-9dbf-00e25dd16678 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:45.537722 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d1de8-a7b0-46f2-9dbf-00e25dd16678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:45.538199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d1de8-a7b0-46f2-9dbf-00e25dd16678 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:45.539125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d1de8-a7b0-46f2-9dbf-00e25dd16678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:45.541610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d1de8-a7b0-46f2-9dbf-00e25dd16678 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:45.579455 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1271/2518] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:32:45 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:45.580974 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796350-2c65-46b0-901c-af484ca08a18 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:45.597024 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796350-2c65-46b0-901c-af484ca08a18 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:45.677931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a7c27-744d-48d6-a8d9-f599e7f6962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:45.678794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a7c27-744d-48d6-a8d9-f599e7f6962f admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:45.679138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a7c27-744d-48d6-a8d9-f599e7f6962f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:45.679453 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a7c27-744d-48d6-a8d9-f599e7f6962f admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:45.680182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a7c27-744d-48d6-a8d9-f599e7f6962f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:45.683309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a7c27-744d-48d6-a8d9-f599e7f6962f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:45.712145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1248/2519] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:32:45 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:45.716686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d1de8-a7b0-46f2-9dbf-00e25dd16678 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:45.728114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d1de8-a7b0-46f2-9dbf-00e25dd16678 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:45.739742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae56bb-8688-4a12-882c-b279172b8933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:45.741196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae56bb-8688-4a12-882c-b279172b8933 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:45.741788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae56bb-8688-4a12-882c-b279172b8933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:45.742890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae56bb-8688-4a12-882c-b279172b8933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:45.745758 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae56bb-8688-4a12-882c-b279172b8933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:45.748356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae56bb-8688-4a12-882c-b279172b8933 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:45.767294 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1272/2520] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:45.771376 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a7c27-744d-48d6-a8d9-f599e7f6962f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:45.783865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a7c27-744d-48d6-a8d9-f599e7f6962f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:45.789549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57868f26-cdcc-433c-bf7c-e10439a78a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:45.790455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57868f26-cdcc-433c-bf7c-e10439a78a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:45.791103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57868f26-cdcc-433c-bf7c-e10439a78a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:45.792405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57868f26-cdcc-433c-bf7c-e10439a78a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:45.793411 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57868f26-cdcc-433c-bf7c-e10439a78a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:45.795830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57868f26-cdcc-433c-bf7c-e10439a78a9b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:45.819009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1249/2521] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:45.819877 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae56bb-8688-4a12-882c-b279172b8933 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:45.832754 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae56bb-8688-4a12-882c-b279172b8933 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:45.840794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88170c7-5798-4c47-96c4-08958a47b0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:45.841747 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88170c7-5798-4c47-96c4-08958a47b0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:45.842035 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88170c7-5798-4c47-96c4-08958a47b0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:45.842472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88170c7-5798-4c47-96c4-08958a47b0f0 admin admin] PATH_INFO: `/v3/projects/fcbe9022303f40bb8c655771a7d09a22/users/6958aa14a5e443458a2f634bfe153043/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:45.864909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88170c7-5798-4c47-96c4-08958a47b0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbe9022303f40bb8c655771a7d09a22, user_id=6958aa14a5e443458a2f634bfe153043, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:45.868117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88170c7-5798-4c47-96c4-08958a47b0f0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:45.888047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1273/2522] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:32:45 2022] PUT /identity/v3/projects/fcbe9022303f40bb8c655771a7d09a22/users/6958aa14a5e443458a2f634bfe153043/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:45.899871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba639ef-55f1-44de-bd2b-c67e070f4b51 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:45.900756 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba639ef-55f1-44de-bd2b-c67e070f4b51 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:45.901171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba639ef-55f1-44de-bd2b-c67e070f4b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:45.944748 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-eba639ef-55f1-44de-bd2b-c67e070f4b51 None None] MFA Rules not processed for user `6958aa14a5e443458a2f634bfe153043`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:45.946181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-eba639ef-55f1-44de-bd2b-c67e070f4b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:46.024943 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:46.030455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1250/2523] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:46.034768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88170c7-5798-4c47-96c4-08958a47b0f0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:46.041613 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:46.066687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad039e-f617-449e-9a9f-2d79067d85aa None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:46.066977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad039e-f617-449e-9a9f-2d79067d85aa None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:46.067261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad039e-f617-449e-9a9f-2d79067d85aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:46.087377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a7ad039e-f617-449e-9a9f-2d79067d85aa None None] MFA Rules not processed for user `2d9b9cce55b7477caea672af0dba0c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:46.089334 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a7ad039e-f617-449e-9a9f-2d79067d85aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:46.120643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88170c7-5798-4c47-96c4-08958a47b0f0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:46.126248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d33c6-607f-4c14-9038-1a0613eb73d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:46.126598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d33c6-607f-4c14-9038-1a0613eb73d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:46.126885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d33c6-607f-4c14-9038-1a0613eb73d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:46.127168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d33c6-607f-4c14-9038-1a0613eb73d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:46.128067 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d33c6-607f-4c14-9038-1a0613eb73d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:46.130044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d33c6-607f-4c14-9038-1a0613eb73d7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:46.157873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1251/2524] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:32:46.163124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1274/2525] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:32:46 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:46.166732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad039e-f617-449e-9a9f-2d79067d85aa None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:46.180848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad039e-f617-449e-9a9f-2d79067d85aa None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:46.272618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2ec33-300c-4885-8eb8-8aa227b7cab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:46.273371 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2ec33-300c-4885-8eb8-8aa227b7cab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:46.273660 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2ec33-300c-4885-8eb8-8aa227b7cab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:46.273942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2ec33-300c-4885-8eb8-8aa227b7cab8 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:46.274671 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2ec33-300c-4885-8eb8-8aa227b7cab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:46.277193 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2ec33-300c-4885-8eb8-8aa227b7cab8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:46.329367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d33c6-607f-4c14-9038-1a0613eb73d7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:46.335556 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1252/2526] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:32:46 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:46.345428 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d33c6-607f-4c14-9038-1a0613eb73d7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:46.361589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f7072-2ef8-4ecb-b97b-a04fb4e7b204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:46.362538 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f7072-2ef8-4ecb-b97b-a04fb4e7b204 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:46.363031 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f7072-2ef8-4ecb-b97b-a04fb4e7b204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:46.363860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f7072-2ef8-4ecb-b97b-a04fb4e7b204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:46.365018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f7072-2ef8-4ecb-b97b-a04fb4e7b204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:46.374912 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f7072-2ef8-4ecb-b97b-a04fb4e7b204 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:46.387326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1275/2527] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:46.392829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2ec33-300c-4885-8eb8-8aa227b7cab8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:46.412676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2ec33-300c-4885-8eb8-8aa227b7cab8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:46.419243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230c192-cfcc-446d-8f2a-a0bcf1e32290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:46.420382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230c192-cfcc-446d-8f2a-a0bcf1e32290 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:46.420754 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230c192-cfcc-446d-8f2a-a0bcf1e32290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:46.421117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230c192-cfcc-446d-8f2a-a0bcf1e32290 admin admin] PATH_INFO: `/v3/projects/b915c36fff6d4d18859fd70a9e41fcf9/users/f0b80b4f49ca4a1ebdf31088928d458e/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:46.444330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230c192-cfcc-446d-8f2a-a0bcf1e32290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b915c36fff6d4d18859fd70a9e41fcf9, user_id=f0b80b4f49ca4a1ebdf31088928d458e, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:46.447790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230c192-cfcc-446d-8f2a-a0bcf1e32290 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:46.466709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1253/2528] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:32:46 2022] PUT /identity/v3/projects/b915c36fff6d4d18859fd70a9e41fcf9/users/f0b80b4f49ca4a1ebdf31088928d458e/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:46.470848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f7072-2ef8-4ecb-b97b-a04fb4e7b204 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:46.482385 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f7072-2ef8-4ecb-b97b-a04fb4e7b204 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:46.573021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bf866-6894-4071-a580-a1e3e1df0e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:46.573737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf866-6894-4071-a580-a1e3e1df0e6e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:46.574018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf866-6894-4071-a580-a1e3e1df0e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:46.574296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf866-6894-4071-a580-a1e3e1df0e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:46.575045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf866-6894-4071-a580-a1e3e1df0e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:46.576851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf866-6894-4071-a580-a1e3e1df0e6e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:46.587889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1276/2529] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:46.592120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230c192-cfcc-446d-8f2a-a0bcf1e32290 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:46.604402 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230c192-cfcc-446d-8f2a-a0bcf1e32290 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:46.609980 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca445e4-22ca-4299-a5da-eda6ec1b8b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:46.610895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca445e4-22ca-4299-a5da-eda6ec1b8b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:46.611179 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca445e4-22ca-4299-a5da-eda6ec1b8b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:46.611497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca445e4-22ca-4299-a5da-eda6ec1b8b5d admin admin] PATH_INFO: `/v3/projects/b915c36fff6d4d18859fd70a9e41fcf9/users/f0b80b4f49ca4a1ebdf31088928d458e/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:46.613623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca445e4-22ca-4299-a5da-eda6ec1b8b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b915c36fff6d4d18859fd70a9e41fcf9, user_id=f0b80b4f49ca4a1ebdf31088928d458e, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:46.616724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca445e4-22ca-4299-a5da-eda6ec1b8b5d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:46.635169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1254/2530] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:32:46 2022] PUT /identity/v3/projects/b915c36fff6d4d18859fd70a9e41fcf9/users/f0b80b4f49ca4a1ebdf31088928d458e/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:46.645876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e0122-17de-467c-a971-9ec8870458a4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:46.646474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e0122-17de-467c-a971-9ec8870458a4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:46.646775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e0122-17de-467c-a971-9ec8870458a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:46.682544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fb3e0122-17de-467c-a971-9ec8870458a4 None None] MFA Rules not processed for user `f0b80b4f49ca4a1ebdf31088928d458e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:46.683694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fb3e0122-17de-467c-a971-9ec8870458a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:46.776256 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:46.785238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1277/2531] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:46.797421 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca445e4-22ca-4299-a5da-eda6ec1b8b5d admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:46.799673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-dca445e4-22ca-4299-a5da-eda6ec1b8b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:46.904724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca445e4-22ca-4299-a5da-eda6ec1b8b5d admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:46.911553 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe859f1b-a76d-4699-afb1-a863ac01ae94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:46.912679 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe859f1b-a76d-4699-afb1-a863ac01ae94 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:46.913101 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe859f1b-a76d-4699-afb1-a863ac01ae94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:46.913493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe859f1b-a76d-4699-afb1-a863ac01ae94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:46.929623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe859f1b-a76d-4699-afb1-a863ac01ae94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:46.932761 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe859f1b-a76d-4699-afb1-a863ac01ae94 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:46.940712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:46.951289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1255/2532] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:47.434118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e0122-17de-467c-a971-9ec8870458a4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:47.510857 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e0122-17de-467c-a971-9ec8870458a4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:47.516143 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:47.517033 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:47.517359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:47.517642 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] PATH_INFO: `/v3/users/6958aa14a5e443458a2f634bfe153043` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:47.518862 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6958aa14a5e443458a2f634bfe153043)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:47.520855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:47.583825 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6958aa14a5e443458a2f634bfe153043'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:47.606391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6958aa14a5e443458a2f634bfe153043'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:47.614532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6958aa14a5e443458a2f634bfe153043'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:47.625907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6958aa14a5e443458a2f634bfe153043'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:47.626656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6958aa14a5e443458a2f634bfe153043'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:47.633941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1278/2533] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:32:47 2022] DELETE /identity/v3/users/6958aa14a5e443458a2f634bfe153043 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:47.638873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015964b-de6b-4ef0-8f5b-91e9372ae478 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:47.639471 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015964b-de6b-4ef0-8f5b-91e9372ae478 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:47.639471 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015964b-de6b-4ef0-8f5b-91e9372ae478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:47.660798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8015964b-de6b-4ef0-8f5b-91e9372ae478 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:47.662090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8015964b-de6b-4ef0-8f5b-91e9372ae478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:47.731597 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1256/2534] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:47.741402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:47.742819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:47.801937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723838c-3640-4897-82f2-1b36b41a445d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:47.805554 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5ce92-8e2c-48b3-b084-bd53569d4677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:47.806197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5ce92-8e2c-48b3-b084-bd53569d4677 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:47.807107 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5ce92-8e2c-48b3-b084-bd53569d4677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:47.807622 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5ce92-8e2c-48b3-b084-bd53569d4677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:47.817163 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5ce92-8e2c-48b3-b084-bd53569d4677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:47.818594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5ce92-8e2c-48b3-b084-bd53569d4677 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:47.830337 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1279/2535] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:48.113766 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015964b-de6b-4ef0-8f5b-91e9372ae478 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:48.115280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8015964b-de6b-4ef0-8f5b-91e9372ae478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:48.141764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015964b-de6b-4ef0-8f5b-91e9372ae478 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:48.164086 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:48.166584 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:48.167231 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:48.167676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] PATH_INFO: `/v3/projects/fcbe9022303f40bb8c655771a7d09a22` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:48.169186 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbe9022303f40bb8c655771a7d09a22)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:48.171448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:48.236083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbe9022303f40bb8c655771a7d09a22', 'request_id': 'req-aaa6811e-efa3-440f-b301-11352044cf48'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:48.244529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbe9022303f40bb8c655771a7d09a22', 'request_id': 'req-aaa6811e-efa3-440f-b301-11352044cf48'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:48.253422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbe9022303f40bb8c655771a7d09a22', 'request_id': 'req-aaa6811e-efa3-440f-b301-11352044cf48'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:48.267078 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] The token cache is being invalidate because project fcbe9022303f40bb8c655771a7d09a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:32:48.267403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:48.268154 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:48.269948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1257/2536] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:32:48 2022] DELETE /identity/v3/projects/fcbe9022303f40bb8c655771a7d09a22 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:48.274191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5ce92-8e2c-48b3-b084-bd53569d4677 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:48.288622 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5ce92-8e2c-48b3-b084-bd53569d4677 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:48.310521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:48.353465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008aa1cf-b56f-4a49-8ab4-af355d00faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:48.354346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa1cf-b56f-4a49-8ab4-af355d00faa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:48.354636 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa1cf-b56f-4a49-8ab4-af355d00faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:48.354911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa1cf-b56f-4a49-8ab4-af355d00faa6 admin admin] PATH_INFO: `/v3/users/f0b80b4f49ca4a1ebdf31088928d458e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:48.356128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008aa1cf-b56f-4a49-8ab4-af355d00faa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b80b4f49ca4a1ebdf31088928d458e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:48.358198 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008aa1cf-b56f-4a49-8ab4-af355d00faa6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:48.406374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-008aa1cf-b56f-4a49-8ab4-af355d00faa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b80b4f49ca4a1ebdf31088928d458e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:48.418127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-008aa1cf-b56f-4a49-8ab4-af355d00faa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b80b4f49ca4a1ebdf31088928d458e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:48.424876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-008aa1cf-b56f-4a49-8ab4-af355d00faa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b80b4f49ca4a1ebdf31088928d458e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:48.433736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-008aa1cf-b56f-4a49-8ab4-af355d00faa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b80b4f49ca4a1ebdf31088928d458e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:48.434412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-008aa1cf-b56f-4a49-8ab4-af355d00faa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b80b4f49ca4a1ebdf31088928d458e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:48.440649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1280/2537] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:32:48 2022] DELETE /identity/v3/users/f0b80b4f49ca4a1ebdf31088928d458e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:48.867351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:48.869505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:48.882544 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6811e-efa3-440f-b301-11352044cf48 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:48.954989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730704db-3af6-4aa1-97ff-22cea9cf6262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:48.955885 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730704db-3af6-4aa1-97ff-22cea9cf6262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:48.956171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730704db-3af6-4aa1-97ff-22cea9cf6262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:48.956442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730704db-3af6-4aa1-97ff-22cea9cf6262 admin admin] PATH_INFO: `/v3/projects/b915c36fff6d4d18859fd70a9e41fcf9` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:48.957659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730704db-3af6-4aa1-97ff-22cea9cf6262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b915c36fff6d4d18859fd70a9e41fcf9)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:48.959581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730704db-3af6-4aa1-97ff-22cea9cf6262 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:48.991722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:49.015195 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-730704db-3af6-4aa1-97ff-22cea9cf6262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b915c36fff6d4d18859fd70a9e41fcf9', 'request_id': 'req-730704db-3af6-4aa1-97ff-22cea9cf6262'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:49.023859 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-730704db-3af6-4aa1-97ff-22cea9cf6262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b915c36fff6d4d18859fd70a9e41fcf9', 'request_id': 'req-730704db-3af6-4aa1-97ff-22cea9cf6262'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:49.035870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-730704db-3af6-4aa1-97ff-22cea9cf6262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b915c36fff6d4d18859fd70a9e41fcf9', 'request_id': 'req-730704db-3af6-4aa1-97ff-22cea9cf6262'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:49.051583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-730704db-3af6-4aa1-97ff-22cea9cf6262 admin admin] The token cache is being invalidate because project b915c36fff6d4d18859fd70a9e41fcf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:32:49.052100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-730704db-3af6-4aa1-97ff-22cea9cf6262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:49.052934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-730704db-3af6-4aa1-97ff-22cea9cf6262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:49.054925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1258/2538] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:32:48 2022] DELETE /identity/v3/projects/b915c36fff6d4d18859fd70a9e41fcf9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:49.061157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe91135-304d-42b3-b349-ce60a87c5ff4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:49.062952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe91135-304d-42b3-b349-ce60a87c5ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:49.062952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe91135-304d-42b3-b349-ce60a87c5ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:49.080881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4fe91135-304d-42b3-b349-ce60a87c5ff4 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:49.082157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4fe91135-304d-42b3-b349-ce60a87c5ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:49.153373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1281/2539] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:49.157820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e436a-4936-46f9-96f8-ec19ed5f5958 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:49.158140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e436a-4936-46f9-96f8-ec19ed5f5958 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:49.158890 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e436a-4936-46f9-96f8-ec19ed5f5958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:49.180571 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d13e436a-4936-46f9-96f8-ec19ed5f5958 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:49.182664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d13e436a-4936-46f9-96f8-ec19ed5f5958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:49.193431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1259/2540] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:49.196302 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe91135-304d-42b3-b349-ce60a87c5ff4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:49.207974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe91135-304d-42b3-b349-ce60a87c5ff4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:49.214382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91792bb-9c69-47e7-833a-04ae92135634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:49.215142 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91792bb-9c69-47e7-833a-04ae92135634 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:49.215493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91792bb-9c69-47e7-833a-04ae92135634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:49.215839 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91792bb-9c69-47e7-833a-04ae92135634 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:49.216645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91792bb-9c69-47e7-833a-04ae92135634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:32:49.217175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91792bb-9c69-47e7-833a-04ae92135634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:49.218796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91792bb-9c69-47e7-833a-04ae92135634 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:49.233627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1282/2541] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:32:49.238079 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e436a-4936-46f9-96f8-ec19ed5f5958 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:49.248492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e436a-4936-46f9-96f8-ec19ed5f5958 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:49.253622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2af7b-dbc1-4836-b340-6330ad49d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:49.254304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2af7b-dbc1-4836-b340-6330ad49d3dc admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:49.254584 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2af7b-dbc1-4836-b340-6330ad49d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:49.254862 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2af7b-dbc1-4836-b340-6330ad49d3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:49.255572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2af7b-dbc1-4836-b340-6330ad49d3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:49.257556 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2af7b-dbc1-4836-b340-6330ad49d3dc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:49.287084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1260/2542] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:32:49 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:49.291399 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91792bb-9c69-47e7-833a-04ae92135634 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:49.307699 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91792bb-9c69-47e7-833a-04ae92135634 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:49.343702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:49.385765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ac9f7-66e4-4b3e-bfce-76f1fe3d1c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:49.386774 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ac9f7-66e4-4b3e-bfce-76f1fe3d1c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:49.387536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ac9f7-66e4-4b3e-bfce-76f1fe3d1c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:49.388011 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ac9f7-66e4-4b3e-bfce-76f1fe3d1c29 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:49.389093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ac9f7-66e4-4b3e-bfce-76f1fe3d1c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:49.391889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ac9f7-66e4-4b3e-bfce-76f1fe3d1c29 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:49.420673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1283/2543] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:32:49 2022] POST /identity/v3/users => generated 282 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:32:49.424510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2af7b-dbc1-4836-b340-6330ad49d3dc admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:49.435301 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2af7b-dbc1-4836-b340-6330ad49d3dc admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:49.440312 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ef69-7fb1-49c0-91c0-d482f9377487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:49.440977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ef69-7fb1-49c0-91c0-d482f9377487 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:49.441316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ef69-7fb1-49c0-91c0-d482f9377487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:49.441597 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ef69-7fb1-49c0-91c0-d482f9377487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:49.442356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471ef69-7fb1-49c0-91c0-d482f9377487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:49.443972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471ef69-7fb1-49c0-91c0-d482f9377487 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:49.455326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1261/2544] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:49.459356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ac9f7-66e4-4b3e-bfce-76f1fe3d1c29 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:49.470592 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ac9f7-66e4-4b3e-bfce-76f1fe3d1c29 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:49.475525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da57ed9-4ed4-43a7-98da-a6971a96c1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:49.476191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da57ed9-4ed4-43a7-98da-a6971a96c1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:49.476475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da57ed9-4ed4-43a7-98da-a6971a96c1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:49.476769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da57ed9-4ed4-43a7-98da-a6971a96c1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:49.477507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da57ed9-4ed4-43a7-98da-a6971a96c1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:49.479712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da57ed9-4ed4-43a7-98da-a6971a96c1e1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:49.490094 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1284/2545] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:49.494667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ef69-7fb1-49c0-91c0-d482f9377487 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:49.505824 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ef69-7fb1-49c0-91c0-d482f9377487 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:49.510505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2293b0d-1e3d-4c7b-8cc4-9813f5e8f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:49.511686 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2293b0d-1e3d-4c7b-8cc4-9813f5e8f1de admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:49.511835 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2293b0d-1e3d-4c7b-8cc4-9813f5e8f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:49.512079 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2293b0d-1e3d-4c7b-8cc4-9813f5e8f1de admin admin] PATH_INFO: `/v3/projects/0ba504f2523a4114861b6a08731b3b3a/users/2cfa85405f594ba1bc7311e20965cf35/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:49.528992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2293b0d-1e3d-4c7b-8cc4-9813f5e8f1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba504f2523a4114861b6a08731b3b3a, user_id=2cfa85405f594ba1bc7311e20965cf35, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:49.532508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2293b0d-1e3d-4c7b-8cc4-9813f5e8f1de admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:49.550494 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1262/2546] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:32:49 2022] PUT /identity/v3/projects/0ba504f2523a4114861b6a08731b3b3a/users/2cfa85405f594ba1bc7311e20965cf35/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:49.562096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9345678-ccb3-44a2-a796-0091cb463d39 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:49.562628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9345678-ccb3-44a2-a796-0091cb463d39 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:49.562914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9345678-ccb3-44a2-a796-0091cb463d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:49.592080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c9345678-ccb3-44a2-a796-0091cb463d39 None None] MFA Rules not processed for user `2cfa85405f594ba1bc7311e20965cf35`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:49.593511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c9345678-ccb3-44a2-a796-0091cb463d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:49.681286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1285/2547] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:49.684420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2293b0d-1e3d-4c7b-8cc4-9813f5e8f1de admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:49.756523 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2293b0d-1e3d-4c7b-8cc4-9813f5e8f1de admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:49.762258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928200c-9d63-4235-8a7e-e372b830e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:49.762648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928200c-9d63-4235-8a7e-e372b830e30d admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:49.762936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928200c-9d63-4235-8a7e-e372b830e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:49.763328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928200c-9d63-4235-8a7e-e372b830e30d admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:49.763921 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928200c-9d63-4235-8a7e-e372b830e30d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:49.766322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928200c-9d63-4235-8a7e-e372b830e30d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:49.808786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1263/2548] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:32:49 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:49.813040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9345678-ccb3-44a2-a796-0091cb463d39 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:49.826401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9345678-ccb3-44a2-a796-0091cb463d39 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:49.905993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d99470-1f18-45a5-9ea5-cd909df8468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:49.906904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d99470-1f18-45a5-9ea5-cd909df8468d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:49.907382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d99470-1f18-45a5-9ea5-cd909df8468d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:49.907760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d99470-1f18-45a5-9ea5-cd909df8468d admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:49.908609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d99470-1f18-45a5-9ea5-cd909df8468d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:49.910933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d99470-1f18-45a5-9ea5-cd909df8468d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:49.946691 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1286/2549] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:32:49 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:32:49.948764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928200c-9d63-4235-8a7e-e372b830e30d admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:49.961861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928200c-9d63-4235-8a7e-e372b830e30d admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:49.968836 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5091459-7f3d-49d1-bfd0-4fdcc5452f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:49.970004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5091459-7f3d-49d1-bfd0-4fdcc5452f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:49.970295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5091459-7f3d-49d1-bfd0-4fdcc5452f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:49.970580 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5091459-7f3d-49d1-bfd0-4fdcc5452f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:49.971319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5091459-7f3d-49d1-bfd0-4fdcc5452f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:49.972956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5091459-7f3d-49d1-bfd0-4fdcc5452f9a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:49.988768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1264/2550] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:49.990048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d99470-1f18-45a5-9ea5-cd909df8468d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:50.001542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d99470-1f18-45a5-9ea5-cd909df8468d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:50.006943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e8fe7-0ec0-4e8f-9f4f-d97851194ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:50.007860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e8fe7-0ec0-4e8f-9f4f-d97851194ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:50.008149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e8fe7-0ec0-4e8f-9f4f-d97851194ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:50.008429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e8fe7-0ec0-4e8f-9f4f-d97851194ca4 admin admin] PATH_INFO: `/v3/projects/c20f853330c84a97a159c10301ce9df9/users/c04733d2b87d480783357a92f5968713/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:50.027150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e8fe7-0ec0-4e8f-9f4f-d97851194ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20f853330c84a97a159c10301ce9df9, user_id=c04733d2b87d480783357a92f5968713, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:50.030252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e8fe7-0ec0-4e8f-9f4f-d97851194ca4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:50.045235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1287/2551] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:32:49 2022] PUT /identity/v3/projects/c20f853330c84a97a159c10301ce9df9/users/c04733d2b87d480783357a92f5968713/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:50.049302 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5091459-7f3d-49d1-bfd0-4fdcc5452f9a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:50.060427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5091459-7f3d-49d1-bfd0-4fdcc5452f9a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:50.082708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:50.122733 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f487ee-cf14-41bf-9577-29a6b3546782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:50.123598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f487ee-cf14-41bf-9577-29a6b3546782 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:50.123985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f487ee-cf14-41bf-9577-29a6b3546782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:50.124366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f487ee-cf14-41bf-9577-29a6b3546782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:50.125393 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f487ee-cf14-41bf-9577-29a6b3546782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:50.127227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f487ee-cf14-41bf-9577-29a6b3546782 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:50.139364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1265/2552] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:50.143766 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e8fe7-0ec0-4e8f-9f4f-d97851194ca4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:50.149631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:50.156080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e8fe7-0ec0-4e8f-9f4f-d97851194ca4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:50.161153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd45024-6a28-4246-b3ba-f06685576acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:50.162177 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45024-6a28-4246-b3ba-f06685576acc admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:50.162469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45024-6a28-4246-b3ba-f06685576acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:50.162750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45024-6a28-4246-b3ba-f06685576acc admin admin] PATH_INFO: `/v3/projects/c20f853330c84a97a159c10301ce9df9/users/c04733d2b87d480783357a92f5968713/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:50.164756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd45024-6a28-4246-b3ba-f06685576acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20f853330c84a97a159c10301ce9df9, user_id=c04733d2b87d480783357a92f5968713, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:50.167510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd45024-6a28-4246-b3ba-f06685576acc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:50.179275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1288/2553] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:32:50 2022] PUT /identity/v3/projects/c20f853330c84a97a159c10301ce9df9/users/c04733d2b87d480783357a92f5968713/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:32:50.190268 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fe78a-7fe1-488e-a40f-c649ffdeff90 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:50.190558 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fe78a-7fe1-488e-a40f-c649ffdeff90 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:50.190838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fe78a-7fe1-488e-a40f-c649ffdeff90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:50.218445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e64fe78a-7fe1-488e-a40f-c649ffdeff90 None None] MFA Rules not processed for user `c04733d2b87d480783357a92f5968713`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:50.219721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e64fe78a-7fe1-488e-a40f-c649ffdeff90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:50.299168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1266/2554] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:50.310801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd45024-6a28-4246-b3ba-f06685576acc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:50.312521 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bbd45024-6a28-4246-b3ba-f06685576acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:50.371115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd45024-6a28-4246-b3ba-f06685576acc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:50.374873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d187b72-f3f0-415c-9fc0-8f2a6e217c15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:50.375527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d187b72-f3f0-415c-9fc0-8f2a6e217c15 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:50.375813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d187b72-f3f0-415c-9fc0-8f2a6e217c15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:50.376092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d187b72-f3f0-415c-9fc0-8f2a6e217c15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:50.385842 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d187b72-f3f0-415c-9fc0-8f2a6e217c15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:50.387286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d187b72-f3f0-415c-9fc0-8f2a6e217c15 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:50.396871 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1289/2555] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:50.472449 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fe78a-7fe1-488e-a40f-c649ffdeff90 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:50.482673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fe78a-7fe1-488e-a40f-c649ffdeff90 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:50.486444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15910b6e-46d5-46bd-83b9-8b185a63d0a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:50.487077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15910b6e-46d5-46bd-83b9-8b185a63d0a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:50.487366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15910b6e-46d5-46bd-83b9-8b185a63d0a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:50.487647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15910b6e-46d5-46bd-83b9-8b185a63d0a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:50.548896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15910b6e-46d5-46bd-83b9-8b185a63d0a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:50.550414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15910b6e-46d5-46bd-83b9-8b185a63d0a5 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:50.560772 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1267/2556] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:32:53.298308 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d187b72-f3f0-415c-9fc0-8f2a6e217c15 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:53.360141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d187b72-f3f0-415c-9fc0-8f2a6e217c15 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:53.364690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:53.365591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:53.366123 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:53.366243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] PATH_INFO: `/v3/users/2cfa85405f594ba1bc7311e20965cf35` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:53.367356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cfa85405f594ba1bc7311e20965cf35)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:53.369362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:53.416095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cfa85405f594ba1bc7311e20965cf35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:53.428183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cfa85405f594ba1bc7311e20965cf35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:53.435207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cfa85405f594ba1bc7311e20965cf35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:53.442020 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cfa85405f594ba1bc7311e20965cf35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:53.442652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cfa85405f594ba1bc7311e20965cf35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:53.449591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1290/2557] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:32:53 2022] DELETE /identity/v3/users/2cfa85405f594ba1bc7311e20965cf35 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:53.454534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7c60-f70f-483c-871b-86909538fba5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:53.455039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7c60-f70f-483c-871b-86909538fba5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:53.455245 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7c60-f70f-483c-871b-86909538fba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:53.473451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c6fe7c60-f70f-483c-871b-86909538fba5 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:53.474682 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c6fe7c60-f70f-483c-871b-86909538fba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:53.519618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:53.539248 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1268/2558] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:53.548960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:53.550404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:53.563942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:53.618284 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b25dc-d56a-457d-bd1e-e41d46aaf975 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:53.621936 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e9d73-4fdc-4075-b3e7-39cd9ec1cc22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:53.622591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e9d73-4fdc-4075-b3e7-39cd9ec1cc22 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:53.622968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e9d73-4fdc-4075-b3e7-39cd9ec1cc22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:53.623248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e9d73-4fdc-4075-b3e7-39cd9ec1cc22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:53.632655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e9d73-4fdc-4075-b3e7-39cd9ec1cc22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:53.634219 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e9d73-4fdc-4075-b3e7-39cd9ec1cc22 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:53.644702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1291/2559] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:53.918311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe7c60-f70f-483c-871b-86909538fba5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:53.919535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c6fe7c60-f70f-483c-871b-86909538fba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:53.932084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe7c60-f70f-483c-871b-86909538fba5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:53.937481 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:53.938382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:53.938646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:53.938981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] PATH_INFO: `/v3/projects/0ba504f2523a4114861b6a08731b3b3a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:53.940178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba504f2523a4114861b6a08731b3b3a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:53.942217 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:53.994582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba504f2523a4114861b6a08731b3b3a', 'request_id': 'req-38802017-b924-4163-bc9d-3b084b5961b3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.003812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba504f2523a4114861b6a08731b3b3a', 'request_id': 'req-38802017-b924-4163-bc9d-3b084b5961b3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.011401 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba504f2523a4114861b6a08731b3b3a', 'request_id': 'req-38802017-b924-4163-bc9d-3b084b5961b3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.027817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] The token cache is being invalidate because project 0ba504f2523a4114861b6a08731b3b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:32:54.028242 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.028804 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.031110 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1269/2560] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:32:53 2022] DELETE /identity/v3/projects/0ba504f2523a4114861b6a08731b3b3a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:54.037307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e9d73-4fdc-4075-b3e7-39cd9ec1cc22 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:54.049215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e9d73-4fdc-4075-b3e7-39cd9ec1cc22 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:54.109593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46965cba-b3e5-4025-bc40-844c06a64dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:54.110460 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46965cba-b3e5-4025-bc40-844c06a64dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:54.110742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46965cba-b3e5-4025-bc40-844c06a64dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:54.111084 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46965cba-b3e5-4025-bc40-844c06a64dd1 admin admin] PATH_INFO: `/v3/users/c04733d2b87d480783357a92f5968713` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:54.112266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46965cba-b3e5-4025-bc40-844c06a64dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04733d2b87d480783357a92f5968713)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:54.114239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46965cba-b3e5-4025-bc40-844c06a64dd1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:54.159446 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-46965cba-b3e5-4025-bc40-844c06a64dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04733d2b87d480783357a92f5968713'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.171376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-46965cba-b3e5-4025-bc40-844c06a64dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04733d2b87d480783357a92f5968713'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.178159 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-46965cba-b3e5-4025-bc40-844c06a64dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04733d2b87d480783357a92f5968713'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.186981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-46965cba-b3e5-4025-bc40-844c06a64dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04733d2b87d480783357a92f5968713'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.187723 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-46965cba-b3e5-4025-bc40-844c06a64dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04733d2b87d480783357a92f5968713'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.193939 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1292/2561] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:32:54 2022] DELETE /identity/v3/users/c04733d2b87d480783357a92f5968713 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:54.488527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:54.490034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:54.506952 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38802017-b924-4163-bc9d-3b084b5961b3 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:54.567062 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5b2ea-9ed0-4322-8387-e89627077985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:54.567938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5b2ea-9ed0-4322-8387-e89627077985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:54.568227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5b2ea-9ed0-4322-8387-e89627077985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:54.568507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5b2ea-9ed0-4322-8387-e89627077985 admin admin] PATH_INFO: `/v3/projects/c20f853330c84a97a159c10301ce9df9` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:54.569876 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5b2ea-9ed0-4322-8387-e89627077985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20f853330c84a97a159c10301ce9df9)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:54.571812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5b2ea-9ed0-4322-8387-e89627077985 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:54.625807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-91d5b2ea-9ed0-4322-8387-e89627077985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20f853330c84a97a159c10301ce9df9', 'request_id': 'req-91d5b2ea-9ed0-4322-8387-e89627077985'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.633881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-91d5b2ea-9ed0-4322-8387-e89627077985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20f853330c84a97a159c10301ce9df9', 'request_id': 'req-91d5b2ea-9ed0-4322-8387-e89627077985'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.641148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-91d5b2ea-9ed0-4322-8387-e89627077985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20f853330c84a97a159c10301ce9df9', 'request_id': 'req-91d5b2ea-9ed0-4322-8387-e89627077985'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.647589 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:54.652510 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-91d5b2ea-9ed0-4322-8387-e89627077985 admin admin] The token cache is being invalidate because project c20f853330c84a97a159c10301ce9df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:32:54.652851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-91d5b2ea-9ed0-4322-8387-e89627077985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.653884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-91d5b2ea-9ed0-4322-8387-e89627077985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:54.655448 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1270/2562] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:32:54 2022] DELETE /identity/v3/projects/c20f853330c84a97a159c10301ce9df9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:54.661615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0898a45-0315-426a-a414-5d1c0b377246 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:54.662251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0898a45-0315-426a-a414-5d1c0b377246 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:54.662251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0898a45-0315-426a-a414-5d1c0b377246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:54.679795 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c0898a45-0315-426a-a414-5d1c0b377246 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:54.680997 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c0898a45-0315-426a-a414-5d1c0b377246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:54.710956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:54.741613 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1293/2563] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:54.749982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d816a-ff08-483a-80cb-46652630bf8e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:54.750300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d816a-ff08-483a-80cb-46652630bf8e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:54.750582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d816a-ff08-483a-80cb-46652630bf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:54.769924 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4d1d816a-ff08-483a-80cb-46652630bf8e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:54.771140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4d1d816a-ff08-483a-80cb-46652630bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:54.779205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1271/2564] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:54.783416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0898a45-0315-426a-a414-5d1c0b377246 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:54.793315 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0898a45-0315-426a-a414-5d1c0b377246 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:54.798037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfef9f-a050-43fd-9404-193a3c1b73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:54.798686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfef9f-a050-43fd-9404-193a3c1b73e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:54.798969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfef9f-a050-43fd-9404-193a3c1b73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:54.799245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfef9f-a050-43fd-9404-193a3c1b73e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:54.800028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfef9f-a050-43fd-9404-193a3c1b73e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:32:54.800350 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfef9f-a050-43fd-9404-193a3c1b73e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:54.802022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfef9f-a050-43fd-9404-193a3c1b73e7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:54.814555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1294/2565] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:32:54.818819 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d816a-ff08-483a-80cb-46652630bf8e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:54.828860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d816a-ff08-483a-80cb-46652630bf8e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:54.833580 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cdb09-1ea9-43e4-8879-4e1ba8b810f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:54.834238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cdb09-1ea9-43e4-8879-4e1ba8b810f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:54.834527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cdb09-1ea9-43e4-8879-4e1ba8b810f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:54.834808 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cdb09-1ea9-43e4-8879-4e1ba8b810f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:54.835508 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cdb09-1ea9-43e4-8879-4e1ba8b810f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:54.837462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cdb09-1ea9-43e4-8879-4e1ba8b810f8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:54.862845 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1272/2566] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:32:54 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:54.867000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfef9f-a050-43fd-9404-193a3c1b73e7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:54.877935 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfef9f-a050-43fd-9404-193a3c1b73e7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:54.934836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95d0d6-232d-4cb7-a089-23bfc396d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:54.935430 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95d0d6-232d-4cb7-a089-23bfc396d88c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:54.935720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95d0d6-232d-4cb7-a089-23bfc396d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:54.935996 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95d0d6-232d-4cb7-a089-23bfc396d88c admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:54.936707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95d0d6-232d-4cb7-a089-23bfc396d88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:54.938712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95d0d6-232d-4cb7-a089-23bfc396d88c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:54.958805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1295/2567] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:32:54 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:32:54.963197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cdb09-1ea9-43e4-8879-4e1ba8b810f8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:54.973714 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cdb09-1ea9-43e4-8879-4e1ba8b810f8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:54.978304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da8f64-0476-4321-8b78-144267ceedf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:54.978966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da8f64-0476-4321-8b78-144267ceedf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:54.979759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da8f64-0476-4321-8b78-144267ceedf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:54.980044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da8f64-0476-4321-8b78-144267ceedf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:54.980776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da8f64-0476-4321-8b78-144267ceedf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:54.982547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da8f64-0476-4321-8b78-144267ceedf6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:54.993639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1273/2568] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:54.997587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95d0d6-232d-4cb7-a089-23bfc396d88c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:55.008464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95d0d6-232d-4cb7-a089-23bfc396d88c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:55.013496 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c27257-cd94-4232-955c-6d78c93f9df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:55.014206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27257-cd94-4232-955c-6d78c93f9df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:55.014522 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27257-cd94-4232-955c-6d78c93f9df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:55.014807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27257-cd94-4232-955c-6d78c93f9df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:55.015858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c27257-cd94-4232-955c-6d78c93f9df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:55.017527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c27257-cd94-4232-955c-6d78c93f9df6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:55.030907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1296/2569] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:55.035593 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da8f64-0476-4321-8b78-144267ceedf6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:55.050274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da8f64-0476-4321-8b78-144267ceedf6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:55.055680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6efeb8-6468-4025-b63e-47b2443c3920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:55.056583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6efeb8-6468-4025-b63e-47b2443c3920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:55.056866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6efeb8-6468-4025-b63e-47b2443c3920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:55.057252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6efeb8-6468-4025-b63e-47b2443c3920 admin admin] PATH_INFO: `/v3/projects/082fb31a01874b8daf492ba1b5823440/users/e64d4c216b5b4be19c3ec8c40d72c73b/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:55.073574 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6efeb8-6468-4025-b63e-47b2443c3920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=082fb31a01874b8daf492ba1b5823440, user_id=e64d4c216b5b4be19c3ec8c40d72c73b, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:55.076305 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6efeb8-6468-4025-b63e-47b2443c3920 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:55.089972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1274/2570] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:32:55 2022] PUT /identity/v3/projects/082fb31a01874b8daf492ba1b5823440/users/e64d4c216b5b4be19c3ec8c40d72c73b/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:32:55.101364 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547855-0614-4201-bb23-79913e3bfbb6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:55.101654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547855-0614-4201-bb23-79913e3bfbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:55.101960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547855-0614-4201-bb23-79913e3bfbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:55.134075 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4a547855-0614-4201-bb23-79913e3bfbb6 None None] MFA Rules not processed for user `e64d4c216b5b4be19c3ec8c40d72c73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:55.135352 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4a547855-0614-4201-bb23-79913e3bfbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:55.240945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1297/2571] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:55.245732 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6efeb8-6468-4025-b63e-47b2443c3920 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:55.316462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6efeb8-6468-4025-b63e-47b2443c3920 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:55.321382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbc70f-9561-4df6-b6c4-f1bb3baaa063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:55.322044 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbc70f-9561-4df6-b6c4-f1bb3baaa063 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:55.322332 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbc70f-9561-4df6-b6c4-f1bb3baaa063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:55.322611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbc70f-9561-4df6-b6c4-f1bb3baaa063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:55.323343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbc70f-9561-4df6-b6c4-f1bb3baaa063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:55.325288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbc70f-9561-4df6-b6c4-f1bb3baaa063 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:55.351858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1275/2572] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:32:55 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:32:55.356415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a547855-0614-4201-bb23-79913e3bfbb6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:55.367764 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a547855-0614-4201-bb23-79913e3bfbb6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:55.394757 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:55.427654 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe28ce-1f47-4e5a-8a09-64d58af4aff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:55.428327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe28ce-1f47-4e5a-8a09-64d58af4aff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:55.428610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe28ce-1f47-4e5a-8a09-64d58af4aff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:55.428888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe28ce-1f47-4e5a-8a09-64d58af4aff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:55.429730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe28ce-1f47-4e5a-8a09-64d58af4aff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:55.431913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe28ce-1f47-4e5a-8a09-64d58af4aff7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:55.452534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1298/2573] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:32:55 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:55.456419 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbc70f-9561-4df6-b6c4-f1bb3baaa063 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:55.467247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbc70f-9561-4df6-b6c4-f1bb3baaa063 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:55.471903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d0376-804d-418e-9af0-9c7411179676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:55.472560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d0376-804d-418e-9af0-9c7411179676 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:55.472849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d0376-804d-418e-9af0-9c7411179676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:55.473160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d0376-804d-418e-9af0-9c7411179676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:55.473892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d0376-804d-418e-9af0-9c7411179676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:55.475502 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d0376-804d-418e-9af0-9c7411179676 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:55.486748 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1276/2574] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:32:55.490917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe28ce-1f47-4e5a-8a09-64d58af4aff7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:55.500978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe28ce-1f47-4e5a-8a09-64d58af4aff7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:55.505586 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfce24d-368e-404d-ac59-8d2da63eb7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:55.506459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfce24d-368e-404d-ac59-8d2da63eb7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:55.506742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfce24d-368e-404d-ac59-8d2da63eb7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:55.507019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfce24d-368e-404d-ac59-8d2da63eb7ec admin admin] PATH_INFO: `/v3/projects/d8ca06c10b08481b87e8d4cf11c89a51/users/96c8cae24ff848eba0d50530b2b02606/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:55.522194 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfce24d-368e-404d-ac59-8d2da63eb7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ca06c10b08481b87e8d4cf11c89a51, user_id=96c8cae24ff848eba0d50530b2b02606, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:55.524884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfce24d-368e-404d-ac59-8d2da63eb7ec admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:55.538941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1299/2575] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:32:55 2022] PUT /identity/v3/projects/d8ca06c10b08481b87e8d4cf11c89a51/users/96c8cae24ff848eba0d50530b2b02606/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:55.544211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d0376-804d-418e-9af0-9c7411179676 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:55.555521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d0376-804d-418e-9af0-9c7411179676 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:55.612600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b2d1c-d7f3-423c-8d26-6f9f5b1e7546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:55.613310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b2d1c-d7f3-423c-8d26-6f9f5b1e7546 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:55.613600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b2d1c-d7f3-423c-8d26-6f9f5b1e7546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:55.613883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b2d1c-d7f3-423c-8d26-6f9f5b1e7546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:55.614615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b2d1c-d7f3-423c-8d26-6f9f5b1e7546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:55.616238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b2d1c-d7f3-423c-8d26-6f9f5b1e7546 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:55.626946 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1277/2576] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:55.631110 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfce24d-368e-404d-ac59-8d2da63eb7ec admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:55.642563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfce24d-368e-404d-ac59-8d2da63eb7ec admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:55.647210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056e98a-e4c4-4921-902d-81872be2b2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:55.648153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056e98a-e4c4-4921-902d-81872be2b2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:55.648436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056e98a-e4c4-4921-902d-81872be2b2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:55.648709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056e98a-e4c4-4921-902d-81872be2b2aa admin admin] PATH_INFO: `/v3/projects/d8ca06c10b08481b87e8d4cf11c89a51/users/96c8cae24ff848eba0d50530b2b02606/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:55.650998 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056e98a-e4c4-4921-902d-81872be2b2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ca06c10b08481b87e8d4cf11c89a51, user_id=96c8cae24ff848eba0d50530b2b02606, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:55.653677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056e98a-e4c4-4921-902d-81872be2b2aa admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:55.664122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1300/2577] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:32:55 2022] PUT /identity/v3/projects/d8ca06c10b08481b87e8d4cf11c89a51/users/96c8cae24ff848eba0d50530b2b02606/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:55.674301 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387092b2-ea1e-44ed-98a9-66058bc57244 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:55.674597 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387092b2-ea1e-44ed-98a9-66058bc57244 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:55.674879 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387092b2-ea1e-44ed-98a9-66058bc57244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:55.681668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:55.705823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-387092b2-ea1e-44ed-98a9-66058bc57244 None None] MFA Rules not processed for user `96c8cae24ff848eba0d50530b2b02606`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:55.707118 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-387092b2-ea1e-44ed-98a9-66058bc57244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:55.778611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1278/2578] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:55.789977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056e98a-e4c4-4921-902d-81872be2b2aa admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:55.792216 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7056e98a-e4c4-4921-902d-81872be2b2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:55.849904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056e98a-e4c4-4921-902d-81872be2b2aa admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:55.853863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a4173-65c9-4ccb-86b6-a83e7ce2d247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:55.855096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4173-65c9-4ccb-86b6-a83e7ce2d247 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:55.855394 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4173-65c9-4ccb-86b6-a83e7ce2d247 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:55.855675 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4173-65c9-4ccb-86b6-a83e7ce2d247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:55.865186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a4173-65c9-4ccb-86b6-a83e7ce2d247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:55.866640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a4173-65c9-4ccb-86b6-a83e7ce2d247 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:55.876969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1301/2579] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:55.951721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387092b2-ea1e-44ed-98a9-66058bc57244 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:56.017784 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387092b2-ea1e-44ed-98a9-66058bc57244 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:56.022235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:56.023103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:56.023405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:56.023666 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] PATH_INFO: `/v3/users/e64d4c216b5b4be19c3ec8c40d72c73b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:56.024863 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64d4c216b5b4be19c3ec8c40d72c73b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:56.026838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:56.090348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64d4c216b5b4be19c3ec8c40d72c73b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.101913 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64d4c216b5b4be19c3ec8c40d72c73b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.109349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64d4c216b5b4be19c3ec8c40d72c73b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.116890 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64d4c216b5b4be19c3ec8c40d72c73b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.117557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64d4c216b5b4be19c3ec8c40d72c73b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.123432 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1279/2580] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:32:55 2022] DELETE /identity/v3/users/e64d4c216b5b4be19c3ec8c40d72c73b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:56.128010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa522ec7-150c-42f0-82ea-f3977c8b78ed None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:56.128305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa522ec7-150c-42f0-82ea-f3977c8b78ed None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:56.128587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa522ec7-150c-42f0-82ea-f3977c8b78ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:56.146389 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fa522ec7-150c-42f0-82ea-f3977c8b78ed None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:56.147605 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fa522ec7-150c-42f0-82ea-f3977c8b78ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:56.206094 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1302/2581] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:56.216338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:56.217794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:56.228816 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:56.278715 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f32aa-c5d1-45c2-8902-ab79e6366460 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:56.282404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e019ec-659b-44f4-bae7-7e3c86a189f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:56.283060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e019ec-659b-44f4-bae7-7e3c86a189f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:56.283959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e019ec-659b-44f4-bae7-7e3c86a189f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:56.284466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e019ec-659b-44f4-bae7-7e3c86a189f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:56.295261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e019ec-659b-44f4-bae7-7e3c86a189f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:56.296896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e019ec-659b-44f4-bae7-7e3c86a189f9 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:56.307310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1280/2582] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:56.659258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa522ec7-150c-42f0-82ea-f3977c8b78ed None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:56.660872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fa522ec7-150c-42f0-82ea-f3977c8b78ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:56.674197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa522ec7-150c-42f0-82ea-f3977c8b78ed None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:56.679138 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:56.680094 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:56.680478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:56.680821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] PATH_INFO: `/v3/projects/082fb31a01874b8daf492ba1b5823440` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:56.682326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] RBAC: Authorizing `identity:delete_project(project_id=082fb31a01874b8daf492ba1b5823440)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:56.684832 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:56.707422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:56.735523 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082fb31a01874b8daf492ba1b5823440', 'request_id': 'req-776ade8b-0c8f-4df7-8ec1-27271e06047b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.742930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082fb31a01874b8daf492ba1b5823440', 'request_id': 'req-776ade8b-0c8f-4df7-8ec1-27271e06047b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.750908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082fb31a01874b8daf492ba1b5823440', 'request_id': 'req-776ade8b-0c8f-4df7-8ec1-27271e06047b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.764188 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] The token cache is being invalidate because project 082fb31a01874b8daf492ba1b5823440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:32:56.764515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.765977 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.767943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1303/2583] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:32:56 2022] DELETE /identity/v3/projects/082fb31a01874b8daf492ba1b5823440 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:56.771988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e019ec-659b-44f4-bae7-7e3c86a189f9 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:56.783100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e019ec-659b-44f4-bae7-7e3c86a189f9 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:56.840627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7316bd-2ca4-449b-8a17-ea050ea7861f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:56.841514 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7316bd-2ca4-449b-8a17-ea050ea7861f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:56.841793 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7316bd-2ca4-449b-8a17-ea050ea7861f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:56.842083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7316bd-2ca4-449b-8a17-ea050ea7861f admin admin] PATH_INFO: `/v3/users/96c8cae24ff848eba0d50530b2b02606` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:56.843241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7316bd-2ca4-449b-8a17-ea050ea7861f admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c8cae24ff848eba0d50530b2b02606)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:56.845193 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7316bd-2ca4-449b-8a17-ea050ea7861f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:56.892430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6f7316bd-2ca4-449b-8a17-ea050ea7861f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c8cae24ff848eba0d50530b2b02606'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.904321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6f7316bd-2ca4-449b-8a17-ea050ea7861f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c8cae24ff848eba0d50530b2b02606'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.911240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6f7316bd-2ca4-449b-8a17-ea050ea7861f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c8cae24ff848eba0d50530b2b02606'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.918774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6f7316bd-2ca4-449b-8a17-ea050ea7861f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c8cae24ff848eba0d50530b2b02606'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.919499 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6f7316bd-2ca4-449b-8a17-ea050ea7861f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c8cae24ff848eba0d50530b2b02606'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:56.925742 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1281/2584] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:32:56 2022] DELETE /identity/v3/users/96c8cae24ff848eba0d50530b2b02606 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:57.219321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:57.220994 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:57.239449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ade8b-0c8f-4df7-8ec1-27271e06047b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:57.311955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d97c68-28b8-4062-8b9b-251f0cfb8629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:57.312835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d97c68-28b8-4062-8b9b-251f0cfb8629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:57.313155 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d97c68-28b8-4062-8b9b-251f0cfb8629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:57.313438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d97c68-28b8-4062-8b9b-251f0cfb8629 admin admin] PATH_INFO: `/v3/projects/d8ca06c10b08481b87e8d4cf11c89a51` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:57.314683 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d97c68-28b8-4062-8b9b-251f0cfb8629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ca06c10b08481b87e8d4cf11c89a51)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:57.316658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d97c68-28b8-4062-8b9b-251f0cfb8629 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:57.371638 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-69d97c68-28b8-4062-8b9b-251f0cfb8629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ca06c10b08481b87e8d4cf11c89a51', 'request_id': 'req-69d97c68-28b8-4062-8b9b-251f0cfb8629'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:57.378691 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-69d97c68-28b8-4062-8b9b-251f0cfb8629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ca06c10b08481b87e8d4cf11c89a51', 'request_id': 'req-69d97c68-28b8-4062-8b9b-251f0cfb8629'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:57.386514 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-69d97c68-28b8-4062-8b9b-251f0cfb8629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ca06c10b08481b87e8d4cf11c89a51', 'request_id': 'req-69d97c68-28b8-4062-8b9b-251f0cfb8629'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:57.397535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-69d97c68-28b8-4062-8b9b-251f0cfb8629 admin admin] The token cache is being invalidate because project d8ca06c10b08481b87e8d4cf11c89a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:32:57.397874 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-69d97c68-28b8-4062-8b9b-251f0cfb8629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:57.398575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-69d97c68-28b8-4062-8b9b-251f0cfb8629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:57.400260 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1304/2585] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:32:57 2022] DELETE /identity/v3/projects/d8ca06c10b08481b87e8d4cf11c89a51 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:57.405639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60db52c-4377-4e6f-adc1-d24eb460a735 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:57.405963 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60db52c-4377-4e6f-adc1-d24eb460a735 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:57.406270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60db52c-4377-4e6f-adc1-d24eb460a735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:57.426068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b60db52c-4377-4e6f-adc1-d24eb460a735 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:57.427418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b60db52c-4377-4e6f-adc1-d24eb460a735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:57.454885 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:57.491355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1282/2586] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:57.500820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6cbff-1039-4d9e-8b54-c5197ca057b0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:57.501045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6cbff-1039-4d9e-8b54-c5197ca057b0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:57.501354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6cbff-1039-4d9e-8b54-c5197ca057b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:57.520870 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1ab6cbff-1039-4d9e-8b54-c5197ca057b0 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:57.522113 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1ab6cbff-1039-4d9e-8b54-c5197ca057b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:57.530469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1305/2587] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:57.535041 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60db52c-4377-4e6f-adc1-d24eb460a735 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:57.551614 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60db52c-4377-4e6f-adc1-d24eb460a735 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:57.556728 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbba0a6-3999-4235-be85-964e7c2c7e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:57.557979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbba0a6-3999-4235-be85-964e7c2c7e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:57.558396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbba0a6-3999-4235-be85-964e7c2c7e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:57.558765 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbba0a6-3999-4235-be85-964e7c2c7e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:57.559834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbba0a6-3999-4235-be85-964e7c2c7e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:32:57.560033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbba0a6-3999-4235-be85-964e7c2c7e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:57.561904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbba0a6-3999-4235-be85-964e7c2c7e3d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:57.578706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1283/2588] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:32:57.580657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6cbff-1039-4d9e-8b54-c5197ca057b0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:57.595447 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6cbff-1039-4d9e-8b54-c5197ca057b0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:57.600755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42ef43-f03a-43ec-bca8-7a4c0c185969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:57.601487 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ef43-f03a-43ec-bca8-7a4c0c185969 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:57.601776 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ef43-f03a-43ec-bca8-7a4c0c185969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:57.602079 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ef43-f03a-43ec-bca8-7a4c0c185969 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:57.602881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42ef43-f03a-43ec-bca8-7a4c0c185969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:57.605703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42ef43-f03a-43ec-bca8-7a4c0c185969 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:57.650639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1306/2589] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:32:57 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:57.654736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbba0a6-3999-4235-be85-964e7c2c7e3d admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:57.668224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbba0a6-3999-4235-be85-964e7c2c7e3d admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:57.740575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54a853-09e5-482c-b025-fe146b628d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:57.741287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54a853-09e5-482c-b025-fe146b628d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:57.741576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54a853-09e5-482c-b025-fe146b628d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:57.741855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54a853-09e5-482c-b025-fe146b628d78 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:57.742568 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54a853-09e5-482c-b025-fe146b628d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:57.745089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54a853-09e5-482c-b025-fe146b628d78 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:57.768396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1284/2590] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:32:57 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:57.772720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42ef43-f03a-43ec-bca8-7a4c0c185969 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:57.783332 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42ef43-f03a-43ec-bca8-7a4c0c185969 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:57.788823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a0f0e-a323-4224-9dbc-6a50194f5982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:57.789526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0f0e-a323-4224-9dbc-6a50194f5982 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:57.789818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0f0e-a323-4224-9dbc-6a50194f5982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:57.790097 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0f0e-a323-4224-9dbc-6a50194f5982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:57.790827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a0f0e-a323-4224-9dbc-6a50194f5982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:57.792466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a0f0e-a323-4224-9dbc-6a50194f5982 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:57.795563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:57.811993 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1307/2591] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:57.813264 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54a853-09e5-482c-b025-fe146b628d78 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:57.825093 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54a853-09e5-482c-b025-fe146b628d78 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:57.830908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf8227-5492-4c54-a275-8951dc279778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:57.831501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf8227-5492-4c54-a275-8951dc279778 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:57.831788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf8227-5492-4c54-a275-8951dc279778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:57.832100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf8227-5492-4c54-a275-8951dc279778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:57.832803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf8227-5492-4c54-a275-8951dc279778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:57.834450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf8227-5492-4c54-a275-8951dc279778 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:57.846065 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1285/2592] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:32:57.850382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a0f0e-a323-4224-9dbc-6a50194f5982 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:57.861049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a0f0e-a323-4224-9dbc-6a50194f5982 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:57.865855 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a8857-903a-409d-ae9b-80e33de582cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:57.866744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a8857-903a-409d-ae9b-80e33de582cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:57.867034 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a8857-903a-409d-ae9b-80e33de582cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:57.867315 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a8857-903a-409d-ae9b-80e33de582cf admin admin] PATH_INFO: `/v3/projects/cb24e6f701884516948238daa97bdb97/users/addfa3fb1f044da38a62cacf89c28dba/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:57.883658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a8857-903a-409d-ae9b-80e33de582cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb24e6f701884516948238daa97bdb97, user_id=addfa3fb1f044da38a62cacf89c28dba, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:57.887037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a8857-903a-409d-ae9b-80e33de582cf admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:57.901562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1308/2593] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:32:57 2022] PUT /identity/v3/projects/cb24e6f701884516948238daa97bdb97/users/addfa3fb1f044da38a62cacf89c28dba/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:57.912503 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128883-ead9-4563-97ed-d8663a49dd20 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:57.912884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128883-ead9-4563-97ed-d8663a49dd20 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:57.913953 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128883-ead9-4563-97ed-d8663a49dd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:57.944317 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-12128883-ead9-4563-97ed-d8663a49dd20 None None] MFA Rules not processed for user `addfa3fb1f044da38a62cacf89c28dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:57.945600 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-12128883-ead9-4563-97ed-d8663a49dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:58.024496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1286/2594] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:58.032270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a8857-903a-409d-ae9b-80e33de582cf admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:58.034042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-db2a8857-903a-409d-ae9b-80e33de582cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:58.097279 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a8857-903a-409d-ae9b-80e33de582cf admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:58.102581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b04af0-5717-4a32-a1bf-ede598cbe432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:58.103299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b04af0-5717-4a32-a1bf-ede598cbe432 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:58.103586 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b04af0-5717-4a32-a1bf-ede598cbe432 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:58.103868 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b04af0-5717-4a32-a1bf-ede598cbe432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:58.114119 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b04af0-5717-4a32-a1bf-ede598cbe432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:58.115594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b04af0-5717-4a32-a1bf-ede598cbe432 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:58.126429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1309/2595] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:32:58.147735 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12128883-ead9-4563-97ed-d8663a49dd20 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:58.179790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:58.215616 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12128883-ead9-4563-97ed-d8663a49dd20 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:58.220646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:58.221566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:58.221851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:58.222128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] PATH_INFO: `/v3/users/addfa3fb1f044da38a62cacf89c28dba` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:58.223340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=addfa3fb1f044da38a62cacf89c28dba)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:58.225322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:58.277775 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'addfa3fb1f044da38a62cacf89c28dba'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:58.291216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'addfa3fb1f044da38a62cacf89c28dba'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:58.299337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'addfa3fb1f044da38a62cacf89c28dba'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:58.307173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'addfa3fb1f044da38a62cacf89c28dba'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:58.308456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'addfa3fb1f044da38a62cacf89c28dba'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:58.314966 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1287/2596] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:32:58 2022] DELETE /identity/v3/users/addfa3fb1f044da38a62cacf89c28dba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:32:58.319558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee274ee-7992-40a1-b49b-8a5cbe5db2f1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:58.319949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee274ee-7992-40a1-b49b-8a5cbe5db2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:58.320290 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee274ee-7992-40a1-b49b-8a5cbe5db2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:58.337919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1ee274ee-7992-40a1-b49b-8a5cbe5db2f1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:58.339760 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1ee274ee-7992-40a1-b49b-8a5cbe5db2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:58.403653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1310/2597] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:32:58.413848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:58.415815 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:58.482673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebffed-297b-407d-911d-e40cd0452418 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:58.487136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480ee50-2886-418e-973e-6808fbc7bff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:58.487815 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480ee50-2886-418e-973e-6808fbc7bff6 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:58.488106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480ee50-2886-418e-973e-6808fbc7bff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:58.488387 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480ee50-2886-418e-973e-6808fbc7bff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:58.505014 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480ee50-2886-418e-973e-6808fbc7bff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:58.506540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480ee50-2886-418e-973e-6808fbc7bff6 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:58.517907 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1288/2598] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:32:58.859468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee274ee-7992-40a1-b49b-8a5cbe5db2f1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:58.861150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1ee274ee-7992-40a1-b49b-8a5cbe5db2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:58.875914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee274ee-7992-40a1-b49b-8a5cbe5db2f1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:58.882910 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a843426-e4d8-4354-9585-f5982f672e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:58.884362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a843426-e4d8-4354-9585-f5982f672e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:58.884885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a843426-e4d8-4354-9585-f5982f672e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:58.885815 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a843426-e4d8-4354-9585-f5982f672e9b admin admin] PATH_INFO: `/v3/projects/cb24e6f701884516948238daa97bdb97` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:58.887579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a843426-e4d8-4354-9585-f5982f672e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb24e6f701884516948238daa97bdb97)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:58.890170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a843426-e4d8-4354-9585-f5982f672e9b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:58.954971 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2a843426-e4d8-4354-9585-f5982f672e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb24e6f701884516948238daa97bdb97', 'request_id': 'req-2a843426-e4d8-4354-9585-f5982f672e9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:58.961670 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2a843426-e4d8-4354-9585-f5982f672e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb24e6f701884516948238daa97bdb97', 'request_id': 'req-2a843426-e4d8-4354-9585-f5982f672e9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:58.975346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2a843426-e4d8-4354-9585-f5982f672e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb24e6f701884516948238daa97bdb97', 'request_id': 'req-2a843426-e4d8-4354-9585-f5982f672e9b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:58.989746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:58.993503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2a843426-e4d8-4354-9585-f5982f672e9b admin admin] The token cache is being invalidate because project cb24e6f701884516948238daa97bdb97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:32:58.993804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2a843426-e4d8-4354-9585-f5982f672e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:58.995226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2a843426-e4d8-4354-9585-f5982f672e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:32:58.997590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1311/2599] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:32:58 2022] DELETE /identity/v3/projects/cb24e6f701884516948238daa97bdb97 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:32:59.004900 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8a156-d4eb-4ea7-b7cc-67350603cb28 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:59.006033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8a156-d4eb-4ea7-b7cc-67350603cb28 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:59.006401 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8a156-d4eb-4ea7-b7cc-67350603cb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:59.031928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-16a8a156-d4eb-4ea7-b7cc-67350603cb28 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:59.033238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-16a8a156-d4eb-4ea7-b7cc-67350603cb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:59.096062 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:59.124047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1289/2600] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:59.131943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eea1c-c3c9-4eac-85e9-a30c186ab16b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:59.132235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eea1c-c3c9-4eac-85e9-a30c186ab16b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:59.132544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eea1c-c3c9-4eac-85e9-a30c186ab16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:59.158001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-df3eea1c-c3c9-4eac-85e9-a30c186ab16b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:59.159325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-df3eea1c-c3c9-4eac-85e9-a30c186ab16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:59.169612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1312/2601] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:59.175451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8a156-d4eb-4ea7-b7cc-67350603cb28 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:59.190680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8a156-d4eb-4ea7-b7cc-67350603cb28 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:59.196991 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75750c9b-4154-4da3-9960-f147545b1923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:59.198624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75750c9b-4154-4da3-9960-f147545b1923 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:59.199199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75750c9b-4154-4da3-9960-f147545b1923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:59.200339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75750c9b-4154-4da3-9960-f147545b1923 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:59.200886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75750c9b-4154-4da3-9960-f147545b1923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:32:59.201291 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75750c9b-4154-4da3-9960-f147545b1923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:59.203025 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75750c9b-4154-4da3-9960-f147545b1923 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:59.217724 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1290/2602] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:32:59.224190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eea1c-c3c9-4eac-85e9-a30c186ab16b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:59.237146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eea1c-c3c9-4eac-85e9-a30c186ab16b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:59.242504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c8275-37ce-48a0-997c-b109e3fa2e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:59.243181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c8275-37ce-48a0-997c-b109e3fa2e4e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:59.243511 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c8275-37ce-48a0-997c-b109e3fa2e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:59.243793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c8275-37ce-48a0-997c-b109e3fa2e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:59.245014 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c8275-37ce-48a0-997c-b109e3fa2e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:59.247049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c8275-37ce-48a0-997c-b109e3fa2e4e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:59.278812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1313/2603] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:32:59 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:59.283290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75750c9b-4154-4da3-9960-f147545b1923 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:59.295431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75750c9b-4154-4da3-9960-f147545b1923 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:59.371206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e6b2-ce39-4ff6-9bc0-15d65f751c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:59.372208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e6b2-ce39-4ff6-9bc0-15d65f751c5b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:59.372702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e6b2-ce39-4ff6-9bc0-15d65f751c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:59.373316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e6b2-ce39-4ff6-9bc0-15d65f751c5b admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:59.374243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168e6b2-ce39-4ff6-9bc0-15d65f751c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:59.377281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168e6b2-ce39-4ff6-9bc0-15d65f751c5b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:59.402551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1291/2604] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:32:59 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:59.406561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c8275-37ce-48a0-997c-b109e3fa2e4e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:59.421748 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c8275-37ce-48a0-997c-b109e3fa2e4e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:59.427582 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4ce9a-ab1a-46a6-8aaa-b36b81aaa2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:59.428277 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4ce9a-ab1a-46a6-8aaa-b36b81aaa2db admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:59.428565 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4ce9a-ab1a-46a6-8aaa-b36b81aaa2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:59.428846 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4ce9a-ab1a-46a6-8aaa-b36b81aaa2db admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:59.429627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4ce9a-ab1a-46a6-8aaa-b36b81aaa2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:59.431945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4ce9a-ab1a-46a6-8aaa-b36b81aaa2db admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:59.448356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1314/2605] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:59.451793 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e6b2-ce39-4ff6-9bc0-15d65f751c5b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:59.463489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e6b2-ce39-4ff6-9bc0-15d65f751c5b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:59.481838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dd2d5-408f-45aa-8044-598cc4ae33ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:59.482534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dd2d5-408f-45aa-8044-598cc4ae33ba admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:59.482826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dd2d5-408f-45aa-8044-598cc4ae33ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:59.483111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dd2d5-408f-45aa-8044-598cc4ae33ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:59.483869 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dd2d5-408f-45aa-8044-598cc4ae33ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:59.485695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dd2d5-408f-45aa-8044-598cc4ae33ba admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:59.498933 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1292/2606] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:32:59.503299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4ce9a-ab1a-46a6-8aaa-b36b81aaa2db admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:59.520929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4ce9a-ab1a-46a6-8aaa-b36b81aaa2db admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:59.526060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f51ae2-0d19-40c7-bec3-c3effccde167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:59.527234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f51ae2-0d19-40c7-bec3-c3effccde167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:59.527597 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f51ae2-0d19-40c7-bec3-c3effccde167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:59.527959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f51ae2-0d19-40c7-bec3-c3effccde167 admin admin] PATH_INFO: `/v3/projects/97a405e9597a482294be4f39d249cea3/users/83e87c8990d446558fb61112cca6a270/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:59.545237 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f51ae2-0d19-40c7-bec3-c3effccde167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a405e9597a482294be4f39d249cea3, user_id=83e87c8990d446558fb61112cca6a270, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:59.547810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f51ae2-0d19-40c7-bec3-c3effccde167 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:59.566335 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1315/2607] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:32:59 2022] PUT /identity/v3/projects/97a405e9597a482294be4f39d249cea3/users/83e87c8990d446558fb61112cca6a270/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:32:59.571196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae79465-de6e-494f-bd98-544dd43c5e51 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:59.571604 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae79465-de6e-494f-bd98-544dd43c5e51 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:59.572037 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae79465-de6e-494f-bd98-544dd43c5e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:59.590914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-cae79465-de6e-494f-bd98-544dd43c5e51 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:32:59.592227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cae79465-de6e-494f-bd98-544dd43c5e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:59.663395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1293/2608] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:32:59.670656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f51ae2-0d19-40c7-bec3-c3effccde167 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:32:59.672340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-67f51ae2-0d19-40c7-bec3-c3effccde167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:32:59.745731 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f51ae2-0d19-40c7-bec3-c3effccde167 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:59.751409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1b4d5-b2b9-4609-b688-768d64064f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:59.752184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1b4d5-b2b9-4609-b688-768d64064f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:59.752626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1b4d5-b2b9-4609-b688-768d64064f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:59.753089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1b4d5-b2b9-4609-b688-768d64064f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:59.765105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1b4d5-b2b9-4609-b688-768d64064f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:59.766713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1b4d5-b2b9-4609-b688-768d64064f68 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:59.779701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1316/2609] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:33:03.983973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916574a-786c-404b-a8ce-819e1769f0ab None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:03.984564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916574a-786c-404b-a8ce-819e1769f0ab None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:03.984852 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916574a-786c-404b-a8ce-819e1769f0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.032560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0916574a-786c-404b-a8ce-819e1769f0ab None None] MFA Rules not processed for user `83e87c8990d446558fb61112cca6a270`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:04.033847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0916574a-786c-404b-a8ce-819e1769f0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:04.115942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:04.147324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1294/2610] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:33:04.155410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1b4d5-b2b9-4609-b688-768d64064f68 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:04.170112 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1b4d5-b2b9-4609-b688-768d64064f68 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:04.176362 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887e914-6576-4c1c-8fb1-daf60b1d5f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:04.177044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887e914-6576-4c1c-8fb1-daf60b1d5f5b admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:04.177430 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887e914-6576-4c1c-8fb1-daf60b1d5f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:04.177728 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887e914-6576-4c1c-8fb1-daf60b1d5f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.178461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887e914-6576-4c1c-8fb1-daf60b1d5f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:04.180534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887e914-6576-4c1c-8fb1-daf60b1d5f5b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:04.214492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1317/2611] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:33:04 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:33:04.219945 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916574a-786c-404b-a8ce-819e1769f0ab None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:04.233100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916574a-786c-404b-a8ce-819e1769f0ab None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:04.315181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e9689-bb58-4652-8b47-736e63c449e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:04.316270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e9689-bb58-4652-8b47-736e63c449e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:04.316568 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e9689-bb58-4652-8b47-736e63c449e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:04.316855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e9689-bb58-4652-8b47-736e63c449e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.317655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e9689-bb58-4652-8b47-736e63c449e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:04.319576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e9689-bb58-4652-8b47-736e63c449e3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:04.347366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1295/2612] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:33:04 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:33:04.352251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887e914-6576-4c1c-8fb1-daf60b1d5f5b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:04.366568 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887e914-6576-4c1c-8fb1-daf60b1d5f5b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:04.378439 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0aaa3-e90f-4700-93b2-5a621ab81836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:04.379329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0aaa3-e90f-4700-93b2-5a621ab81836 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:04.379485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0aaa3-e90f-4700-93b2-5a621ab81836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:04.379744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0aaa3-e90f-4700-93b2-5a621ab81836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.380495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0aaa3-e90f-4700-93b2-5a621ab81836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:04.382348 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0aaa3-e90f-4700-93b2-5a621ab81836 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:04.399837 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1318/2613] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:33:04.403526 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e9689-bb58-4652-8b47-736e63c449e3 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:04.417752 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e9689-bb58-4652-8b47-736e63c449e3 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:04.423838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3139704-a86e-46df-bda6-00c555a255e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:04.424751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3139704-a86e-46df-bda6-00c555a255e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:04.425040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3139704-a86e-46df-bda6-00c555a255e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:04.425369 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3139704-a86e-46df-bda6-00c555a255e7 admin admin] PATH_INFO: `/v3/projects/73696690f34b4a8493a4193cea58dbef/users/b7f27e4ca98f4b40a44d93175541ab5e/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.450293 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3139704-a86e-46df-bda6-00c555a255e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73696690f34b4a8493a4193cea58dbef, user_id=b7f27e4ca98f4b40a44d93175541ab5e, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:04.454211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3139704-a86e-46df-bda6-00c555a255e7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:04.471575 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1296/2614] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:33:04 2022] PUT /identity/v3/projects/73696690f34b4a8493a4193cea58dbef/users/b7f27e4ca98f4b40a44d93175541ab5e/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:04.475838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0aaa3-e90f-4700-93b2-5a621ab81836 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:04.487276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0aaa3-e90f-4700-93b2-5a621ab81836 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:04.553736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6562d2d-8150-463e-9d30-24534ddda246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:04.554425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6562d2d-8150-463e-9d30-24534ddda246 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:04.554715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6562d2d-8150-463e-9d30-24534ddda246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:04.555000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6562d2d-8150-463e-9d30-24534ddda246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.555768 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6562d2d-8150-463e-9d30-24534ddda246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:04.558572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6562d2d-8150-463e-9d30-24534ddda246 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:04.568304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1319/2615] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:33:04.572929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3139704-a86e-46df-bda6-00c555a255e7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:04.589664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3139704-a86e-46df-bda6-00c555a255e7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:04.596019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980e5f3-b809-40fa-9fe8-012c7aba62d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:04.596969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980e5f3-b809-40fa-9fe8-012c7aba62d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:04.597308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980e5f3-b809-40fa-9fe8-012c7aba62d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:04.597721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980e5f3-b809-40fa-9fe8-012c7aba62d3 admin admin] PATH_INFO: `/v3/projects/73696690f34b4a8493a4193cea58dbef/users/b7f27e4ca98f4b40a44d93175541ab5e/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.605644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980e5f3-b809-40fa-9fe8-012c7aba62d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73696690f34b4a8493a4193cea58dbef, user_id=b7f27e4ca98f4b40a44d93175541ab5e, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:04.605644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980e5f3-b809-40fa-9fe8-012c7aba62d3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:04.620996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1297/2616] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:33:04 2022] PUT /identity/v3/projects/73696690f34b4a8493a4193cea58dbef/users/b7f27e4ca98f4b40a44d93175541ab5e/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:09.921615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c3933-fa42-4c4c-ba8a-9b7e4403bc62 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:09.922135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c3933-fa42-4c4c-ba8a-9b7e4403bc62 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:09.922135 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c3933-fa42-4c4c-ba8a-9b7e4403bc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:09.927972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:09.951671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8b6c3933-fa42-4c4c-ba8a-9b7e4403bc62 None None] MFA Rules not processed for user `b7f27e4ca98f4b40a44d93175541ab5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:09.952920 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8b6c3933-fa42-4c4c-ba8a-9b7e4403bc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:10.031458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1320/2617] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:10.039273 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980e5f3-b809-40fa-9fe8-012c7aba62d3 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:10.041676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8980e5f3-b809-40fa-9fe8-012c7aba62d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:10.109401 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980e5f3-b809-40fa-9fe8-012c7aba62d3 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:10.113005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea80d6-f4b2-45fd-beb7-f0e6405ddbd6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a4ae82b1b4619b90f9ad0f3dea5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:10.113691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea80d6-f4b2-45fd-beb7-f0e6405ddbd6 service glance] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:10.113981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea80d6-f4b2-45fd-beb7-f0e6405ddbd6 service glance] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:10.114262 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea80d6-f4b2-45fd-beb7-f0e6405ddbd6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:10.171035 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:10.181956 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea80d6-f4b2-45fd-beb7-f0e6405ddbd6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:10.183431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea80d6-f4b2-45fd-beb7-f0e6405ddbd6 service glance] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:10.192941 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1298/2618] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:33:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:33:10.325335 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b47a77-df9d-4467-9072-b36940ab63fd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:10.325741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b47a77-df9d-4467-9072-b36940ab63fd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:10.326120 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b47a77-df9d-4467-9072-b36940ab63fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:10.366851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-07b47a77-df9d-4467-9072-b36940ab63fd None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:10.371719 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-07b47a77-df9d-4467-9072-b36940ab63fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:10.460907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1321/2619] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:10.485534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea80d6-f4b2-45fd-beb7-f0e6405ddbd6 service glance] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:10.487270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-36ea80d6-f4b2-45fd-beb7-f0e6405ddbd6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:10.642457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea80d6-f4b2-45fd-beb7-f0e6405ddbd6 service glance] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:10.648979 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c9d03-4200-428d-9f41-7375a8d5956a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:10.649698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c9d03-4200-428d-9f41-7375a8d5956a service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:10.649991 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c9d03-4200-428d-9f41-7375a8d5956a service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:10.650465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c9d03-4200-428d-9f41-7375a8d5956a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:10.665775 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c9d03-4200-428d-9f41-7375a8d5956a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:10.676451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c9d03-4200-428d-9f41-7375a8d5956a service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:10.700160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1299/2620] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:33:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:33:15.033807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b47a77-df9d-4467-9072-b36940ab63fd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:15.035400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-07b47a77-df9d-4467-9072-b36940ab63fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:15.116572 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b47a77-df9d-4467-9072-b36940ab63fd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:15.121502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc4742-a569-4791-9b1e-f84e5c3b1679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:15.122203 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc4742-a569-4791-9b1e-f84e5c3b1679 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:15.122492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc4742-a569-4791-9b1e-f84e5c3b1679 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:15.122908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc4742-a569-4791-9b1e-f84e5c3b1679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:15.125146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ffcc4742-a569-4791-9b1e-f84e5c3b1679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:15.196909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:15.229016 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc4742-a569-4791-9b1e-f84e5c3b1679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:15.230586 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc4742-a569-4791-9b1e-f84e5c3b1679 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:15.242877 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1322/2621] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:33:19.302265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c9d03-4200-428d-9f41-7375a8d5956a service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:19.304524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-622c9d03-4200-428d-9f41-7375a8d5956a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:19.330586 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c9d03-4200-428d-9f41-7375a8d5956a service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:19.335406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f1812-db2f-4a76-a328-289b3e2abdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:19.336290 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f1812-db2f-4a76-a328-289b3e2abdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:19.336580 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f1812-db2f-4a76-a328-289b3e2abdce admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:19.336859 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f1812-db2f-4a76-a328-289b3e2abdce admin admin] PATH_INFO: `/v3/users/0c4b2c84be7d4670a7232ae93db14740` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:19.338637 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f1812-db2f-4a76-a328-289b3e2abdce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4b2c84be7d4670a7232ae93db14740)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:19.343267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f1812-db2f-4a76-a328-289b3e2abdce admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:19.403504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ed6f1812-db2f-4a76-a328-289b3e2abdce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4b2c84be7d4670a7232ae93db14740'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:19.417708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ed6f1812-db2f-4a76-a328-289b3e2abdce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4b2c84be7d4670a7232ae93db14740'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:19.425137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ed6f1812-db2f-4a76-a328-289b3e2abdce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4b2c84be7d4670a7232ae93db14740'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:19.434343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ed6f1812-db2f-4a76-a328-289b3e2abdce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4b2c84be7d4670a7232ae93db14740'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:19.434981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ed6f1812-db2f-4a76-a328-289b3e2abdce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4b2c84be7d4670a7232ae93db14740'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:19.442378 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1300/2622] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:33:19 2022] DELETE /identity/v3/users/0c4b2c84be7d4670a7232ae93db14740 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:19.656206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc4742-a569-4791-9b1e-f84e5c3b1679 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:19.669181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc4742-a569-4791-9b1e-f84e5c3b1679 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:19.758938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:19.760526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:19.761016 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:19.761598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1 admin admin] PATH_INFO: `/v3/projects/06be5826a11e438fb7d87f2d37678e22` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:19.762937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06be5826a11e438fb7d87f2d37678e22)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:19.765036 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:19.823055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06be5826a11e438fb7d87f2d37678e22', 'request_id': 'req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:19.833086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06be5826a11e438fb7d87f2d37678e22', 'request_id': 'req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:19.843802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06be5826a11e438fb7d87f2d37678e22', 'request_id': 'req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:19.859432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1 admin admin] The token cache is being invalidate because project 06be5826a11e438fb7d87f2d37678e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:33:19.859730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:19.860387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fc1046e5-0265-44f5-93b9-0e6c17b51ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:19.862164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1323/2623] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:33:19 2022] DELETE /identity/v3/projects/06be5826a11e438fb7d87f2d37678e22 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:19.867623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711a9de-226e-4bd4-a8f3-73ee77ebff2f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:19.868014 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711a9de-226e-4bd4-a8f3-73ee77ebff2f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:19.868388 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711a9de-226e-4bd4-a8f3-73ee77ebff2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:19.890095 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2711a9de-226e-4bd4-a8f3-73ee77ebff2f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:19.891774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2711a9de-226e-4bd4-a8f3-73ee77ebff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:19.950874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:19.973122 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1301/2624] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:19.978015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aa081-b684-4031-b4f8-1e2931aedd67 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:19.978396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aa081-b684-4031-b4f8-1e2931aedd67 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:19.978756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aa081-b684-4031-b4f8-1e2931aedd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.003028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b02aa081-b684-4031-b4f8-1e2931aedd67 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:20.004903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b02aa081-b684-4031-b4f8-1e2931aedd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:20.017105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1324/2625] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:20.019181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711a9de-226e-4bd4-a8f3-73ee77ebff2f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:20.030830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711a9de-226e-4bd4-a8f3-73ee77ebff2f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:20.036333 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe9972-c961-4c8b-90f0-5c4968608eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:20.037219 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe9972-c961-4c8b-90f0-5c4968608eec admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.037511 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe9972-c961-4c8b-90f0-5c4968608eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.037785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe9972-c961-4c8b-90f0-5c4968608eec admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.038519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe9972-c961-4c8b-90f0-5c4968608eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:20.038828 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe9972-c961-4c8b-90f0-5c4968608eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:20.040612 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe9972-c961-4c8b-90f0-5c4968608eec admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:20.059542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1302/2626] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:33:20.060313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aa081-b684-4031-b4f8-1e2931aedd67 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:20.071574 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aa081-b684-4031-b4f8-1e2931aedd67 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:20.079615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903e818-8342-4257-8632-c0db5d8fa3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:20.080292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903e818-8342-4257-8632-c0db5d8fa3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.080578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903e818-8342-4257-8632-c0db5d8fa3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.080858 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903e818-8342-4257-8632-c0db5d8fa3b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.081765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903e818-8342-4257-8632-c0db5d8fa3b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:20.083819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903e818-8342-4257-8632-c0db5d8fa3b4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:20.112930 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1325/2627] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:33:20 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:33:20.117341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe9972-c961-4c8b-90f0-5c4968608eec admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:20.128985 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe9972-c961-4c8b-90f0-5c4968608eec admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:20.211859 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228bc60-7f63-4b5a-969c-9befedbcca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:20.212523 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228bc60-7f63-4b5a-969c-9befedbcca8c admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.212800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228bc60-7f63-4b5a-969c-9befedbcca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.213178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228bc60-7f63-4b5a-969c-9befedbcca8c admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.213839 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228bc60-7f63-4b5a-969c-9befedbcca8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:20.216057 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228bc60-7f63-4b5a-969c-9befedbcca8c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:20.243482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1303/2628] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:33:20 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:33:20.245701 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903e818-8342-4257-8632-c0db5d8fa3b4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:20.256877 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903e818-8342-4257-8632-c0db5d8fa3b4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:20.262382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a6faa-5b0f-4ce7-85e5-1004abadadf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:20.263059 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a6faa-5b0f-4ce7-85e5-1004abadadf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.263394 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a6faa-5b0f-4ce7-85e5-1004abadadf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.263684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a6faa-5b0f-4ce7-85e5-1004abadadf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.264427 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a6faa-5b0f-4ce7-85e5-1004abadadf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:20.266339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a6faa-5b0f-4ce7-85e5-1004abadadf1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:20.288314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1326/2629] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:33:20.291635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228bc60-7f63-4b5a-969c-9befedbcca8c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:20.311531 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228bc60-7f63-4b5a-969c-9befedbcca8c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:20.320599 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f218f-78e8-4926-b78a-0c26a363e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:20.321516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f218f-78e8-4926-b78a-0c26a363e8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.324141 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f218f-78e8-4926-b78a-0c26a363e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.324141 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f218f-78e8-4926-b78a-0c26a363e8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.325012 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f218f-78e8-4926-b78a-0c26a363e8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:20.327218 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f218f-78e8-4926-b78a-0c26a363e8f1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:20.351145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1304/2630] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:33:20.357354 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a6faa-5b0f-4ce7-85e5-1004abadadf1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:20.368181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a6faa-5b0f-4ce7-85e5-1004abadadf1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:20.373802 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c162d94-d533-4b25-906e-299be5a9e74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:20.374767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c162d94-d533-4b25-906e-299be5a9e74d admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.375052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c162d94-d533-4b25-906e-299be5a9e74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.375406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c162d94-d533-4b25-906e-299be5a9e74d admin admin] PATH_INFO: `/v3/projects/9606409f9b8e4183967332829e4b5d10/users/9ab0201f4aa849e3b62bb0a7377b9ac7/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.392344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c162d94-d533-4b25-906e-299be5a9e74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9606409f9b8e4183967332829e4b5d10, user_id=9ab0201f4aa849e3b62bb0a7377b9ac7, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:20.395049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c162d94-d533-4b25-906e-299be5a9e74d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:20.418076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1327/2631] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:33:20 2022] PUT /identity/v3/projects/9606409f9b8e4183967332829e4b5d10/users/9ab0201f4aa849e3b62bb0a7377b9ac7/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:20.419876 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20678a14-2c8d-47f6-82e6-e29f193fd5a3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.420173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20678a14-2c8d-47f6-82e6-e29f193fd5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.420473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20678a14-2c8d-47f6-82e6-e29f193fd5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.450230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-20678a14-2c8d-47f6-82e6-e29f193fd5a3 None None] MFA Rules not processed for user `9ab0201f4aa849e3b62bb0a7377b9ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:20.451507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-20678a14-2c8d-47f6-82e6-e29f193fd5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:20.535071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1305/2632] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:33:20.546681 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c162d94-d533-4b25-906e-299be5a9e74d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:20.548648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5c162d94-d533-4b25-906e-299be5a9e74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:20.563183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:20.641970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c162d94-d533-4b25-906e-299be5a9e74d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:20.648061 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79a6c0-7d6a-4499-a143-b0325588ded0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:20.648717 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79a6c0-7d6a-4499-a143-b0325588ded0 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.649001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79a6c0-7d6a-4499-a143-b0325588ded0 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.649305 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79a6c0-7d6a-4499-a143-b0325588ded0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.658372 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79a6c0-7d6a-4499-a143-b0325588ded0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:20.659986 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79a6c0-7d6a-4499-a143-b0325588ded0 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:20.670467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1328/2633] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:33:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:33:20.982851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64133e75-ee81-4274-a65d-c9bf46e1b091 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.983241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64133e75-ee81-4274-a65d-c9bf46e1b091 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.984023 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64133e75-ee81-4274-a65d-c9bf46e1b091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:21.004797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-64133e75-ee81-4274-a65d-c9bf46e1b091 None None] MFA Rules not processed for user `83e87c8990d446558fb61112cca6a270`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:21.006340 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-64133e75-ee81-4274-a65d-c9bf46e1b091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:21.062545 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:21.078614 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1306/2634] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:22.946596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521c7e4-98e8-4814-ad4c-59e2dc1ed910 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:22.947105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521c7e4-98e8-4814-ad4c-59e2dc1ed910 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:22.947422 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521c7e4-98e8-4814-ad4c-59e2dc1ed910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:22.965207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c521c7e4-98e8-4814-ad4c-59e2dc1ed910 None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:22.966367 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c521c7e4-98e8-4814-ad4c-59e2dc1ed910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:23.025772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1329/2635] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Jul 15 15:33:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:23.038814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64133e75-ee81-4274-a65d-c9bf46e1b091 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:23.040339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-64133e75-ee81-4274-a65d-c9bf46e1b091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:23.114145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64133e75-ee81-4274-a65d-c9bf46e1b091 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:23.119588 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c5655-a805-44f7-b458-2630e20e59a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:23.120461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c5655-a805-44f7-b458-2630e20e59a9 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:23.120932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c5655-a805-44f7-b458-2630e20e59a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:23.121399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c5655-a805-44f7-b458-2630e20e59a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:23.130868 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c5655-a805-44f7-b458-2630e20e59a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:23.132654 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c5655-a805-44f7-b458-2630e20e59a9 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:23.141489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1307/2636] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:33:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:33:23.434591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521c7e4-98e8-4814-ad4c-59e2dc1ed910 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:23.559917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521c7e4-98e8-4814-ad4c-59e2dc1ed910 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:23.565469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:23.566527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:23.567027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:23.567027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] PATH_INFO: `/v3/users/9ab0201f4aa849e3b62bb0a7377b9ac7` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:23.568183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab0201f4aa849e3b62bb0a7377b9ac7)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:23.570187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:23.636242 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:23.644981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab0201f4aa849e3b62bb0a7377b9ac7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:23.663653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab0201f4aa849e3b62bb0a7377b9ac7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:23.677010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab0201f4aa849e3b62bb0a7377b9ac7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:23.693740 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab0201f4aa849e3b62bb0a7377b9ac7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:23.694526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab0201f4aa849e3b62bb0a7377b9ac7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:23.701867 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1330/2637] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:33:23 2022] DELETE /identity/v3/users/9ab0201f4aa849e3b62bb0a7377b9ac7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:23.706410 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8b73-82d5-4531-b1e5-9155844635d2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:23.706710 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8b73-82d5-4531-b1e5-9155844635d2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:23.706995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8b73-82d5-4531-b1e5-9155844635d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:23.728843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-bf3a8b73-82d5-4531-b1e5-9155844635d2 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:23.730132 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bf3a8b73-82d5-4531-b1e5-9155844635d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:23.837504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1308/2638] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:23.848392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:23.849891 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:23.934013 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f3ea2-df14-46be-9247-566d65e0ab57 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:23.939307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7db81-0d37-4b08-a847-66525cee565e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:23.940069 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7db81-0d37-4b08-a847-66525cee565e service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:23.940419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7db81-0d37-4b08-a847-66525cee565e service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:23.940758 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7db81-0d37-4b08-a847-66525cee565e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:23.951646 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7db81-0d37-4b08-a847-66525cee565e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:23.953200 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7db81-0d37-4b08-a847-66525cee565e service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:23.963380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1331/2639] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:33:24.282705 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8b73-82d5-4531-b1e5-9155844635d2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:24.284743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bf3a8b73-82d5-4531-b1e5-9155844635d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:24.298708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8b73-82d5-4531-b1e5-9155844635d2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.303560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376936f-be15-495b-adfc-d62b792ba27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.304434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376936f-be15-495b-adfc-d62b792ba27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.304761 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376936f-be15-495b-adfc-d62b792ba27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.304988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376936f-be15-495b-adfc-d62b792ba27c admin admin] PATH_INFO: `/v3/projects/9606409f9b8e4183967332829e4b5d10` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.306314 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376936f-be15-495b-adfc-d62b792ba27c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9606409f9b8e4183967332829e4b5d10)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.308294 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376936f-be15-495b-adfc-d62b792ba27c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.373491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3376936f-be15-495b-adfc-d62b792ba27c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9606409f9b8e4183967332829e4b5d10', 'request_id': 'req-3376936f-be15-495b-adfc-d62b792ba27c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:24.382673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3376936f-be15-495b-adfc-d62b792ba27c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9606409f9b8e4183967332829e4b5d10', 'request_id': 'req-3376936f-be15-495b-adfc-d62b792ba27c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:24.392903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3376936f-be15-495b-adfc-d62b792ba27c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9606409f9b8e4183967332829e4b5d10', 'request_id': 'req-3376936f-be15-495b-adfc-d62b792ba27c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:24.406929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3376936f-be15-495b-adfc-d62b792ba27c admin admin] The token cache is being invalidate because project 9606409f9b8e4183967332829e4b5d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:33:24.407357 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3376936f-be15-495b-adfc-d62b792ba27c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:24.408022 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3376936f-be15-495b-adfc-d62b792ba27c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:24.409648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1309/2640] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:33:24 2022] DELETE /identity/v3/projects/9606409f9b8e4183967332829e4b5d10 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:24.414624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bb331-e988-4f36-9b39-d7d42c9cd374 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.414913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bb331-e988-4f36-9b39-d7d42c9cd374 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.415190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bb331-e988-4f36-9b39-d7d42c9cd374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.433838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-520bb331-e988-4f36-9b39-d7d42c9cd374 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:24.435103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-520bb331-e988-4f36-9b39-d7d42c9cd374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:24.502028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1332/2641] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:33:24.515088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed4644-c089-4aab-a596-a97bea31f2d3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.516150 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed4644-c089-4aab-a596-a97bea31f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.519047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed4644-c089-4aab-a596-a97bea31f2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.533780 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:24.540465 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f2ed4644-c089-4aab-a596-a97bea31f2d3 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:24.542336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f2ed4644-c089-4aab-a596-a97bea31f2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:24.551542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1310/2642] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:33:24.555958 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bb331-e988-4f36-9b39-d7d42c9cd374 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:24.568368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bb331-e988-4f36-9b39-d7d42c9cd374 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.574473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448026b-fd09-4c4a-9acb-84945078e638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.575732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448026b-fd09-4c4a-9acb-84945078e638 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.576297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448026b-fd09-4c4a-9acb-84945078e638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.576908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448026b-fd09-4c4a-9acb-84945078e638 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.578273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448026b-fd09-4c4a-9acb-84945078e638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:24.578807 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448026b-fd09-4c4a-9acb-84945078e638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.580659 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448026b-fd09-4c4a-9acb-84945078e638 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.595618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1333/2643] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:24.599877 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed4644-c089-4aab-a596-a97bea31f2d3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:24.611196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed4644-c089-4aab-a596-a97bea31f2d3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.616015 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b87abb-291f-44c5-bb09-9d3834cb9c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.616877 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b87abb-291f-44c5-bb09-9d3834cb9c64 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.617197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b87abb-291f-44c5-bb09-9d3834cb9c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.617491 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b87abb-291f-44c5-bb09-9d3834cb9c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.618301 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b87abb-291f-44c5-bb09-9d3834cb9c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.620920 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b87abb-291f-44c5-bb09-9d3834cb9c64 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.649354 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1311/2644] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:33:24 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:33:24.654293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448026b-fd09-4c4a-9acb-84945078e638 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:24.666532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448026b-fd09-4c4a-9acb-84945078e638 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.720512 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:24.741953 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9f59b-ef91-46d4-a94e-912b46ee9fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.742794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9f59b-ef91-46d4-a94e-912b46ee9fff admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.743080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9f59b-ef91-46d4-a94e-912b46ee9fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.743364 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9f59b-ef91-46d4-a94e-912b46ee9fff admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.744143 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9f59b-ef91-46d4-a94e-912b46ee9fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.746136 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9f59b-ef91-46d4-a94e-912b46ee9fff admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.772249 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1334/2645] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:33:24 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:33:24.776780 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b87abb-291f-44c5-bb09-9d3834cb9c64 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:24.787538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b87abb-291f-44c5-bb09-9d3834cb9c64 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.792704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4305851-d4ef-4bdd-9da9-ce3bebc10975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.793426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305851-d4ef-4bdd-9da9-ce3bebc10975 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.793717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305851-d4ef-4bdd-9da9-ce3bebc10975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.794016 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305851-d4ef-4bdd-9da9-ce3bebc10975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.794774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4305851-d4ef-4bdd-9da9-ce3bebc10975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.796490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4305851-d4ef-4bdd-9da9-ce3bebc10975 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.813310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1312/2646] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:33:24.815851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9f59b-ef91-46d4-a94e-912b46ee9fff admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:24.827542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9f59b-ef91-46d4-a94e-912b46ee9fff admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.832438 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbd3f5-5901-4ee9-bd33-57aadbc47085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.833140 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbd3f5-5901-4ee9-bd33-57aadbc47085 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.833584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbd3f5-5901-4ee9-bd33-57aadbc47085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.833871 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbd3f5-5901-4ee9-bd33-57aadbc47085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.834610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbd3f5-5901-4ee9-bd33-57aadbc47085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.837201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbd3f5-5901-4ee9-bd33-57aadbc47085 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.851897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1335/2647] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:33:24.855895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4305851-d4ef-4bdd-9da9-ce3bebc10975 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:24.866740 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4305851-d4ef-4bdd-9da9-ce3bebc10975 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.873475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57819041-3097-4dbf-889a-dcf132d48673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.874475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57819041-3097-4dbf-889a-dcf132d48673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.874834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57819041-3097-4dbf-889a-dcf132d48673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.875121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57819041-3097-4dbf-889a-dcf132d48673 admin admin] PATH_INFO: `/v3/projects/c0ce1244a96049879268854613e14b8f/users/4eff6a1eae834f0aaee133bf1e45c9cd/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.892627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57819041-3097-4dbf-889a-dcf132d48673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ce1244a96049879268854613e14b8f, user_id=4eff6a1eae834f0aaee133bf1e45c9cd, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.895352 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57819041-3097-4dbf-889a-dcf132d48673 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.910551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1313/2648] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:33:24 2022] PUT /identity/v3/projects/c0ce1244a96049879268854613e14b8f/users/4eff6a1eae834f0aaee133bf1e45c9cd/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:33:24.923213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1bee-2347-43a4-bec0-f0818e3c4f1f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.923514 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1bee-2347-43a4-bec0-f0818e3c4f1f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.923797 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1bee-2347-43a4-bec0-f0818e3c4f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.953750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-962d1bee-2347-43a4-bec0-f0818e3c4f1f None None] MFA Rules not processed for user `4eff6a1eae834f0aaee133bf1e45c9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:24.955206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-962d1bee-2347-43a4-bec0-f0818e3c4f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:25.037700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1336/2649] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:25.038978 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57819041-3097-4dbf-889a-dcf132d48673 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:25.138395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57819041-3097-4dbf-889a-dcf132d48673 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:25.144663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc497e-6521-4e98-b131-32931987ef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:25.145454 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc497e-6521-4e98-b131-32931987ef3c admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:25.145821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc497e-6521-4e98-b131-32931987ef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:25.146113 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc497e-6521-4e98-b131-32931987ef3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:25.146959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc497e-6521-4e98-b131-32931987ef3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:25.149236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc497e-6521-4e98-b131-32931987ef3c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:25.184645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1314/2650] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:33:25 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:33:25.188932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d1bee-2347-43a4-bec0-f0818e3c4f1f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:25.208470 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d1bee-2347-43a4-bec0-f0818e3c4f1f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:25.284702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155804a-42aa-4c12-8b69-0f8c2bbdb75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:25.285334 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155804a-42aa-4c12-8b69-0f8c2bbdb75e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:25.285623 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155804a-42aa-4c12-8b69-0f8c2bbdb75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:25.285905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155804a-42aa-4c12-8b69-0f8c2bbdb75e admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:25.286610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155804a-42aa-4c12-8b69-0f8c2bbdb75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:25.288552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155804a-42aa-4c12-8b69-0f8c2bbdb75e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:25.314250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1337/2651] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:33:25 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:33:25.318611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc497e-6521-4e98-b131-32931987ef3c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:25.331445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc497e-6521-4e98-b131-32931987ef3c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:25.336573 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cbb9-05be-45d5-be1c-43324f564ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:25.337322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cbb9-05be-45d5-be1c-43324f564ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:25.337615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cbb9-05be-45d5-be1c-43324f564ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:25.337898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cbb9-05be-45d5-be1c-43324f564ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:25.338661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9cbb9-05be-45d5-be1c-43324f564ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:25.340295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9cbb9-05be-45d5-be1c-43324f564ddb admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:25.351812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1315/2652] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:33:25.356648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155804a-42aa-4c12-8b69-0f8c2bbdb75e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:25.367555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155804a-42aa-4c12-8b69-0f8c2bbdb75e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:25.373559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e6d2-2d8e-4ff1-a00f-fbc4510ce64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:25.374551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e6d2-2d8e-4ff1-a00f-fbc4510ce64d admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:25.374834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e6d2-2d8e-4ff1-a00f-fbc4510ce64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:25.375192 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e6d2-2d8e-4ff1-a00f-fbc4510ce64d admin admin] PATH_INFO: `/v3/projects/980f545a00ae4ebebe9044b48ba0cac0/users/2885fe0100f94bcd9bbfee77ab29b9ff/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:25.392431 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2e6d2-2d8e-4ff1-a00f-fbc4510ce64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=980f545a00ae4ebebe9044b48ba0cac0, user_id=2885fe0100f94bcd9bbfee77ab29b9ff, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:25.395271 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2e6d2-2d8e-4ff1-a00f-fbc4510ce64d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:25.413544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1338/2653] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:33:25 2022] PUT /identity/v3/projects/980f545a00ae4ebebe9044b48ba0cac0/users/2885fe0100f94bcd9bbfee77ab29b9ff/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:25.417845 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cbb9-05be-45d5-be1c-43324f564ddb admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:25.428585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cbb9-05be-45d5-be1c-43324f564ddb admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:25.493418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526b57d-ea35-4477-b8be-d8f6bd578047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:25.494613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526b57d-ea35-4477-b8be-d8f6bd578047 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:25.494902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526b57d-ea35-4477-b8be-d8f6bd578047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:25.495190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526b57d-ea35-4477-b8be-d8f6bd578047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:25.495994 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526b57d-ea35-4477-b8be-d8f6bd578047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:25.497707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526b57d-ea35-4477-b8be-d8f6bd578047 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:25.512348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1316/2654] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:33:25.514310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e6d2-2d8e-4ff1-a00f-fbc4510ce64d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:25.525800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e6d2-2d8e-4ff1-a00f-fbc4510ce64d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:25.530900 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe954-ffe6-4f90-a4ef-aba9c2cfc596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:25.531793 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe954-ffe6-4f90-a4ef-aba9c2cfc596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:25.532073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe954-ffe6-4f90-a4ef-aba9c2cfc596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:25.533047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe954-ffe6-4f90-a4ef-aba9c2cfc596 admin admin] PATH_INFO: `/v3/projects/980f545a00ae4ebebe9044b48ba0cac0/users/2885fe0100f94bcd9bbfee77ab29b9ff/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:25.535726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fe954-ffe6-4f90-a4ef-aba9c2cfc596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=980f545a00ae4ebebe9044b48ba0cac0, user_id=2885fe0100f94bcd9bbfee77ab29b9ff, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:25.541771 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fe954-ffe6-4f90-a4ef-aba9c2cfc596 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:25.553800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1339/2655] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:33:25 2022] PUT /identity/v3/projects/980f545a00ae4ebebe9044b48ba0cac0/users/2885fe0100f94bcd9bbfee77ab29b9ff/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:25.564630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c99ee-9c2d-45ed-8fa5-19f235be32fe None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:25.564923 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c99ee-9c2d-45ed-8fa5-19f235be32fe None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:25.565247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c99ee-9c2d-45ed-8fa5-19f235be32fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:25.591127 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:25.594648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-cc2c99ee-9c2d-45ed-8fa5-19f235be32fe None None] MFA Rules not processed for user `2885fe0100f94bcd9bbfee77ab29b9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:25.596261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cc2c99ee-9c2d-45ed-8fa5-19f235be32fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:25.686779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1317/2656] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:25.698788 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe954-ffe6-4f90-a4ef-aba9c2cfc596 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:25.700579 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cb8fe954-ffe6-4f90-a4ef-aba9c2cfc596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:25.712222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:25.768401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe954-ffe6-4f90-a4ef-aba9c2cfc596 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:25.772683 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974477e9-58e1-46cc-90c6-b8c2ed1d154e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:25.773490 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974477e9-58e1-46cc-90c6-b8c2ed1d154e service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:25.774008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974477e9-58e1-46cc-90c6-b8c2ed1d154e service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:25.774368 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974477e9-58e1-46cc-90c6-b8c2ed1d154e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:25.785948 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974477e9-58e1-46cc-90c6-b8c2ed1d154e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:25.787509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974477e9-58e1-46cc-90c6-b8c2ed1d154e service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:25.804076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1340/2657] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:33:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:33:25.881673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c99ee-9c2d-45ed-8fa5-19f235be32fe None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:25.895743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c99ee-9c2d-45ed-8fa5-19f235be32fe None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:25.899834 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31692b5-b2a8-4c47-b23f-45e52b811a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:25.901013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31692b5-b2a8-4c47-b23f-45e52b811a54 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:25.901329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31692b5-b2a8-4c47-b23f-45e52b811a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:25.901603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31692b5-b2a8-4c47-b23f-45e52b811a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:25.975351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31692b5-b2a8-4c47-b23f-45e52b811a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:25.977004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31692b5-b2a8-4c47-b23f-45e52b811a54 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:25.991803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1318/2658] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:33:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:33:35.793324 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=22 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:35.986767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=56 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:41.753825 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974477e9-58e1-46cc-90c6-b8c2ed1d154e service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:41.755349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-974477e9-58e1-46cc-90c6-b8c2ed1d154e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:41.918700 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974477e9-58e1-46cc-90c6-b8c2ed1d154e service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:41.924816 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d27394-b914-4c4e-bd93-9360abcf3863 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba61318896f43e5a68e80f38ae5f3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:41.925506 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27394-b914-4c4e-bd93-9360abcf3863 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:41.925798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27394-b914-4c4e-bd93-9360abcf3863 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:41.926148 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27394-b914-4c4e-bd93-9360abcf3863 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:41.928359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e7d27394-b914-4c4e-bd93-9360abcf3863 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:41.950594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d27394-b914-4c4e-bd93-9360abcf3863 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:41.953311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d27394-b914-4c4e-bd93-9360abcf3863 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:41.971312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1341/2659] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:33:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:33:47.125850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31692b5-b2a8-4c47-b23f-45e52b811a54 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:47.127820 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f31692b5-b2a8-4c47-b23f-45e52b811a54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:47.232522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31692b5-b2a8-4c47-b23f-45e52b811a54 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:47.238797 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dfdcb-82a6-4f5b-8ef7-bbf904eb536c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:47.239937 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dfdcb-82a6-4f5b-8ef7-bbf904eb536c service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:47.240438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dfdcb-82a6-4f5b-8ef7-bbf904eb536c service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:47.240918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dfdcb-82a6-4f5b-8ef7-bbf904eb536c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:47.244670 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-914dfdcb-82a6-4f5b-8ef7-bbf904eb536c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:47.359281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dfdcb-82a6-4f5b-8ef7-bbf904eb536c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:47.362010 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dfdcb-82a6-4f5b-8ef7-bbf904eb536c service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:47.380338 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1319/2660] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:33:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:33:51.963099 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=63 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:52.425609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d27394-b914-4c4e-bd93-9360abcf3863 service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:52.428812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e7d27394-b914-4c4e-bd93-9360abcf3863 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:52.773244 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d27394-b914-4c4e-bd93-9360abcf3863 service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:52.781877 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736e020-df5f-486e-9556-4760100868eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:52.783333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e020-df5f-486e-9556-4760100868eb service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:52.783908 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e020-df5f-486e-9556-4760100868eb service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:52.784284 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e020-df5f-486e-9556-4760100868eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:52.787216 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0736e020-df5f-486e-9556-4760100868eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:52.824466 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736e020-df5f-486e-9556-4760100868eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:52.827090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736e020-df5f-486e-9556-4760100868eb service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:52.845531 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1342/2661] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:33:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:33:56.913926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dfdcb-82a6-4f5b-8ef7-bbf904eb536c service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:57.008926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dfdcb-82a6-4f5b-8ef7-bbf904eb536c service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:57.014538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:57.016550 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:57.016550 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:57.016550 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] PATH_INFO: `/v3/users/4eff6a1eae834f0aaee133bf1e45c9cd` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:57.017786 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eff6a1eae834f0aaee133bf1e45c9cd)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:57.019783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:57.048861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:57.080236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eff6a1eae834f0aaee133bf1e45c9cd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:57.092643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eff6a1eae834f0aaee133bf1e45c9cd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:57.100064 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eff6a1eae834f0aaee133bf1e45c9cd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:57.109525 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eff6a1eae834f0aaee133bf1e45c9cd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:57.110198 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eff6a1eae834f0aaee133bf1e45c9cd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:57.116709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1320/2662] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:33:56 2022] DELETE /identity/v3/users/4eff6a1eae834f0aaee133bf1e45c9cd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:57.121721 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4936e-e7ff-4b2d-a5fd-78fd88d6aa66 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:57.122234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4936e-e7ff-4b2d-a5fd-78fd88d6aa66 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:57.122344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4936e-e7ff-4b2d-a5fd-78fd88d6aa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:57.163192 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e2c4936e-e7ff-4b2d-a5fd-78fd88d6aa66 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:57.165019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e2c4936e-e7ff-4b2d-a5fd-78fd88d6aa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:57.232189 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1343/2663] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:57.242871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:57.244606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:57.350217 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525277dd-3bc9-4b39-9111-4dbd492e901b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:57.354615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482627b-a99c-4e63-8e18-2e23a34812f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:57.355396 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482627b-a99c-4e63-8e18-2e23a34812f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:57.355675 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482627b-a99c-4e63-8e18-2e23a34812f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:57.355973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482627b-a99c-4e63-8e18-2e23a34812f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:57.365973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482627b-a99c-4e63-8e18-2e23a34812f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:57.367437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482627b-a99c-4e63-8e18-2e23a34812f5 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:57.379214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1321/2664] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:33:57.702703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4936e-e7ff-4b2d-a5fd-78fd88d6aa66 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:57.702703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e2c4936e-e7ff-4b2d-a5fd-78fd88d6aa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:57.715665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4936e-e7ff-4b2d-a5fd-78fd88d6aa66 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:57.722050 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:57.723140 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:57.723425 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:57.723776 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] PATH_INFO: `/v3/projects/c0ce1244a96049879268854613e14b8f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:57.725201 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ce1244a96049879268854613e14b8f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:57.727309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:57.785618 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:57.801968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ce1244a96049879268854613e14b8f', 'request_id': 'req-4f429e31-d511-4644-b98d-45c5cf745d4c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:57.813988 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ce1244a96049879268854613e14b8f', 'request_id': 'req-4f429e31-d511-4644-b98d-45c5cf745d4c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:57.826061 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ce1244a96049879268854613e14b8f', 'request_id': 'req-4f429e31-d511-4644-b98d-45c5cf745d4c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:57.839090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] The token cache is being invalidate because project c0ce1244a96049879268854613e14b8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:33:57.839534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:57.840255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:57.841943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1344/2665] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:33:57 2022] DELETE /identity/v3/projects/c0ce1244a96049879268854613e14b8f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:57.846399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482627b-a99c-4e63-8e18-2e23a34812f5 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:57.859224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482627b-a99c-4e63-8e18-2e23a34812f5 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:57.949181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1202215-4a4d-4253-9323-30a46a9feb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:57.950199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1202215-4a4d-4253-9323-30a46a9feb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:57.950398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1202215-4a4d-4253-9323-30a46a9feb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:57.950676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1202215-4a4d-4253-9323-30a46a9feb49 admin admin] PATH_INFO: `/v3/users/2885fe0100f94bcd9bbfee77ab29b9ff` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:57.952111 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1202215-4a4d-4253-9323-30a46a9feb49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2885fe0100f94bcd9bbfee77ab29b9ff)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:57.954147 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1202215-4a4d-4253-9323-30a46a9feb49 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:57.989986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:58.023364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b1202215-4a4d-4253-9323-30a46a9feb49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2885fe0100f94bcd9bbfee77ab29b9ff'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:58.041903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b1202215-4a4d-4253-9323-30a46a9feb49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2885fe0100f94bcd9bbfee77ab29b9ff'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:58.052126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b1202215-4a4d-4253-9323-30a46a9feb49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2885fe0100f94bcd9bbfee77ab29b9ff'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:58.067538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b1202215-4a4d-4253-9323-30a46a9feb49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2885fe0100f94bcd9bbfee77ab29b9ff'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:58.068648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b1202215-4a4d-4253-9323-30a46a9feb49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2885fe0100f94bcd9bbfee77ab29b9ff'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:58.083050 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1322/2666] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:33:57 2022] DELETE /identity/v3/users/2885fe0100f94bcd9bbfee77ab29b9ff => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:33:58.518739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:58.520850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:58.561512 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f429e31-d511-4644-b98d-45c5cf745d4c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:58.668922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:58.670628 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:58.671152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:58.671633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a admin admin] PATH_INFO: `/v3/projects/980f545a00ae4ebebe9044b48ba0cac0` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:58.673863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=980f545a00ae4ebebe9044b48ba0cac0)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:58.677525 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:58.769103 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '980f545a00ae4ebebe9044b48ba0cac0', 'request_id': 'req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:58.778345 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '980f545a00ae4ebebe9044b48ba0cac0', 'request_id': 'req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:58.789048 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '980f545a00ae4ebebe9044b48ba0cac0', 'request_id': 'req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:58.805513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a admin admin] The token cache is being invalidate because project 980f545a00ae4ebebe9044b48ba0cac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:33:58.805818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:58.806533 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ca207430-5eb8-4ee5-b7ab-5b3512f02d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:33:58.808257 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1345/2667] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:33:58 2022] DELETE /identity/v3/projects/980f545a00ae4ebebe9044b48ba0cac0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:58.813369 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9384191-09c1-4184-b717-d5d627a23f83 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:58.813709 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9384191-09c1-4184-b717-d5d627a23f83 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:58.814046 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9384191-09c1-4184-b717-d5d627a23f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:58.878821 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a9384191-09c1-4184-b717-d5d627a23f83 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:58.880088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a9384191-09c1-4184-b717-d5d627a23f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:58.968222 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1323/2668] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:58.976847 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898ff7e-a43e-402a-a45f-89e2bb93ae51 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:58.977262 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898ff7e-a43e-402a-a45f-89e2bb93ae51 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:58.977589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898ff7e-a43e-402a-a45f-89e2bb93ae51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:59.006133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b898ff7e-a43e-402a-a45f-89e2bb93ae51 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:59.007549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b898ff7e-a43e-402a-a45f-89e2bb93ae51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:59.018264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1346/2669] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:59.022849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9384191-09c1-4184-b717-d5d627a23f83 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:59.034270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9384191-09c1-4184-b717-d5d627a23f83 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:59.039910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa295290-dd03-4bbd-8439-5a657d1aacd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:59.040615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa295290-dd03-4bbd-8439-5a657d1aacd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:59.040898 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa295290-dd03-4bbd-8439-5a657d1aacd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:59.041221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa295290-dd03-4bbd-8439-5a657d1aacd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:59.041975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa295290-dd03-4bbd-8439-5a657d1aacd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:59.042291 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa295290-dd03-4bbd-8439-5a657d1aacd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:59.043975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa295290-dd03-4bbd-8439-5a657d1aacd1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:59.060996 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1324/2670] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:59.062314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898ff7e-a43e-402a-a45f-89e2bb93ae51 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:59.073545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898ff7e-a43e-402a-a45f-89e2bb93ae51 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:59.079212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c4627-ae69-4109-80fa-b6aefc0ffcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:59.079513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c4627-ae69-4109-80fa-b6aefc0ffcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:59.079799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c4627-ae69-4109-80fa-b6aefc0ffcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:59.080074 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c4627-ae69-4109-80fa-b6aefc0ffcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:59.080833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c4627-ae69-4109-80fa-b6aefc0ffcf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:59.082909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c4627-ae69-4109-80fa-b6aefc0ffcf2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:59.113918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1347/2671] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:33:59 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:33:59.119373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa295290-dd03-4bbd-8439-5a657d1aacd1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:59.137975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa295290-dd03-4bbd-8439-5a657d1aacd1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:59.234161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a67b0-2dfe-4ef1-bb42-be8b4301fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:59.234161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a67b0-2dfe-4ef1-bb42-be8b4301fee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:59.234543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a67b0-2dfe-4ef1-bb42-be8b4301fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:59.235017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a67b0-2dfe-4ef1-bb42-be8b4301fee2 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:59.236224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a67b0-2dfe-4ef1-bb42-be8b4301fee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:59.239785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a67b0-2dfe-4ef1-bb42-be8b4301fee2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:59.255072 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:59.285100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1325/2672] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:33:59 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:33:59.288961 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c4627-ae69-4109-80fa-b6aefc0ffcf2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:59.306062 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c4627-ae69-4109-80fa-b6aefc0ffcf2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:59.312078 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06679544-05b7-4331-a5be-db351706152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:59.312890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06679544-05b7-4331-a5be-db351706152f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:59.313444 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06679544-05b7-4331-a5be-db351706152f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:59.313586 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06679544-05b7-4331-a5be-db351706152f admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:59.314626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06679544-05b7-4331-a5be-db351706152f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:59.316820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06679544-05b7-4331-a5be-db351706152f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:59.330551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1348/2673] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:33:59.334859 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a67b0-2dfe-4ef1-bb42-be8b4301fee2 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:59.352663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a67b0-2dfe-4ef1-bb42-be8b4301fee2 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:59.367261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb3c14-79dc-4b97-b15c-510c8d4a3050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:59.368464 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb3c14-79dc-4b97-b15c-510c8d4a3050 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:59.368748 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb3c14-79dc-4b97-b15c-510c8d4a3050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:59.369025 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb3c14-79dc-4b97-b15c-510c8d4a3050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:59.369849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb3c14-79dc-4b97-b15c-510c8d4a3050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:59.371633 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb3c14-79dc-4b97-b15c-510c8d4a3050 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:59.389126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1326/2674] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:33:59.392616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06679544-05b7-4331-a5be-db351706152f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:59.406086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06679544-05b7-4331-a5be-db351706152f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:59.414293 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce94960-b4ea-4ff7-8927-e4c8571ce83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:59.415567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce94960-b4ea-4ff7-8927-e4c8571ce83b admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:59.415979 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce94960-b4ea-4ff7-8927-e4c8571ce83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:59.416358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce94960-b4ea-4ff7-8927-e4c8571ce83b admin admin] PATH_INFO: `/v3/projects/68c359e3d36e4ce48085e3fe3e2d39e2/users/70728b15fa0043c3aee3006b4a5825c8/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:59.433578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:59.437972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce94960-b4ea-4ff7-8927-e4c8571ce83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c359e3d36e4ce48085e3fe3e2d39e2, user_id=70728b15fa0043c3aee3006b4a5825c8, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:59.441571 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce94960-b4ea-4ff7-8927-e4c8571ce83b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:59.464096 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1349/2675] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:33:59 2022] PUT /identity/v3/projects/68c359e3d36e4ce48085e3fe3e2d39e2/users/70728b15fa0043c3aee3006b4a5825c8/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:59.475201 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadc001-0d61-4d8c-aa6f-b379709aea92 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:59.476123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadc001-0d61-4d8c-aa6f-b379709aea92 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:59.476402 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadc001-0d61-4d8c-aa6f-b379709aea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:59.518775 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2cadc001-0d61-4d8c-aa6f-b379709aea92 None None] MFA Rules not processed for user `70728b15fa0043c3aee3006b4a5825c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:59.520404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2cadc001-0d61-4d8c-aa6f-b379709aea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:59.627423 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1327/2676] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:33:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:33:59.632064 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce94960-b4ea-4ff7-8927-e4c8571ce83b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:59.750533 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce94960-b4ea-4ff7-8927-e4c8571ce83b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:59.759578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248f8d4-a741-4563-863e-e085f57c89a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:59.760750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248f8d4-a741-4563-863e-e085f57c89a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:59.761297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248f8d4-a741-4563-863e-e085f57c89a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:59.761817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248f8d4-a741-4563-863e-e085f57c89a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:59.763147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248f8d4-a741-4563-863e-e085f57c89a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:59.767312 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248f8d4-a741-4563-863e-e085f57c89a1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:59.819073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1350/2677] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:33:59 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:33:59.820477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadc001-0d61-4d8c-aa6f-b379709aea92 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:59.838958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadc001-0d61-4d8c-aa6f-b379709aea92 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:59.934770 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa843e58-7a02-497f-b8b5-bc37d66f8e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:59.935487 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa843e58-7a02-497f-b8b5-bc37d66f8e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:59.935781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa843e58-7a02-497f-b8b5-bc37d66f8e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:59.936306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa843e58-7a02-497f-b8b5-bc37d66f8e42 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:59.937039 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa843e58-7a02-497f-b8b5-bc37d66f8e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:59.939566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa843e58-7a02-497f-b8b5-bc37d66f8e42 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:59.968004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1328/2678] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:33:59 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:33:59.972133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248f8d4-a741-4563-863e-e085f57c89a1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:59.986335 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248f8d4-a741-4563-863e-e085f57c89a1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:59.992375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860595e3-b6f8-4206-b1ca-d1056cfae45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:59.993115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860595e3-b6f8-4206-b1ca-d1056cfae45b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:59.993413 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860595e3-b6f8-4206-b1ca-d1056cfae45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:59.993688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860595e3-b6f8-4206-b1ca-d1056cfae45b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:59.994469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860595e3-b6f8-4206-b1ca-d1056cfae45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:59.996416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860595e3-b6f8-4206-b1ca-d1056cfae45b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:00.010414 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1351/2679] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:34:00.015522 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa843e58-7a02-497f-b8b5-bc37d66f8e42 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:00.028378 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa843e58-7a02-497f-b8b5-bc37d66f8e42 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:00.035696 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15ed9-868e-44b6-bb07-c8428cd6d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:00.036798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15ed9-868e-44b6-bb07-c8428cd6d772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:00.038736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15ed9-868e-44b6-bb07-c8428cd6d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:00.038736 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15ed9-868e-44b6-bb07-c8428cd6d772 admin admin] PATH_INFO: `/v3/projects/b2caa91432294d7e8cedd11971e0bf53/users/a68a1395fbec435c8fc357e681ace121/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:00.066627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e15ed9-868e-44b6-bb07-c8428cd6d772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2caa91432294d7e8cedd11971e0bf53, user_id=a68a1395fbec435c8fc357e681ace121, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:00.069851 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e15ed9-868e-44b6-bb07-c8428cd6d772 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:00.099893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1329/2680] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:00 2022] PUT /identity/v3/projects/b2caa91432294d7e8cedd11971e0bf53/users/a68a1395fbec435c8fc357e681ace121/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:00.103105 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860595e3-b6f8-4206-b1ca-d1056cfae45b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:00.115624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860595e3-b6f8-4206-b1ca-d1056cfae45b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:00.218499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaec448-4243-4d7b-8dd1-912a2b6ebec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:00.219697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec448-4243-4d7b-8dd1-912a2b6ebec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:00.220220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec448-4243-4d7b-8dd1-912a2b6ebec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:00.220729 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec448-4243-4d7b-8dd1-912a2b6ebec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:00.222415 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaec448-4243-4d7b-8dd1-912a2b6ebec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:00.225822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaec448-4243-4d7b-8dd1-912a2b6ebec7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:00.243120 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1352/2681] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:34:00.250583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15ed9-868e-44b6-bb07-c8428cd6d772 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:00.262810 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15ed9-868e-44b6-bb07-c8428cd6d772 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:00.269601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761a152-5bfd-4a47-b943-f9d45bf6bda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:00.271322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761a152-5bfd-4a47-b943-f9d45bf6bda2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:00.271631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761a152-5bfd-4a47-b943-f9d45bf6bda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:00.272191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761a152-5bfd-4a47-b943-f9d45bf6bda2 admin admin] PATH_INFO: `/v3/projects/b2caa91432294d7e8cedd11971e0bf53/users/a68a1395fbec435c8fc357e681ace121/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:00.276931 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761a152-5bfd-4a47-b943-f9d45bf6bda2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2caa91432294d7e8cedd11971e0bf53, user_id=a68a1395fbec435c8fc357e681ace121, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:00.282275 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761a152-5bfd-4a47-b943-f9d45bf6bda2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:00.303002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1330/2682] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:00 2022] PUT /identity/v3/projects/b2caa91432294d7e8cedd11971e0bf53/users/a68a1395fbec435c8fc357e681ace121/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:00.321929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257cc23-9f52-4156-8d8c-5cab955e5bcb None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:00.322407 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257cc23-9f52-4156-8d8c-5cab955e5bcb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:00.322895 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257cc23-9f52-4156-8d8c-5cab955e5bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:00.370355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f257cc23-9f52-4156-8d8c-5cab955e5bcb None None] MFA Rules not processed for user `a68a1395fbec435c8fc357e681ace121`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:00.371751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f257cc23-9f52-4156-8d8c-5cab955e5bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:00.438614 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:00.474292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1353/2683] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:34:00.486994 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761a152-5bfd-4a47-b943-f9d45bf6bda2 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:00.490799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5761a152-5bfd-4a47-b943-f9d45bf6bda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:00.550151 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:00.626489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761a152-5bfd-4a47-b943-f9d45bf6bda2 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:00.631003 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befe496-53d5-400c-bdc7-a60455c49fb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:00.631671 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befe496-53d5-400c-bdc7-a60455c49fb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:00.631946 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befe496-53d5-400c-bdc7-a60455c49fb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:00.632298 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befe496-53d5-400c-bdc7-a60455c49fb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:00.739347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befe496-53d5-400c-bdc7-a60455c49fb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:00.741324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befe496-53d5-400c-bdc7-a60455c49fb8 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:00.754031 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1331/2684] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:03.663192 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257cc23-9f52-4156-8d8c-5cab955e5bcb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:03.666544 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f257cc23-9f52-4156-8d8c-5cab955e5bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:03.688462 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257cc23-9f52-4156-8d8c-5cab955e5bcb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:03.694695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c81671-26f9-487a-b86c-c2fc75f507da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:03.695823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c81671-26f9-487a-b86c-c2fc75f507da service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:03.695823 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c81671-26f9-487a-b86c-c2fc75f507da service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:03.699018 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c81671-26f9-487a-b86c-c2fc75f507da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:03.707962 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c81671-26f9-487a-b86c-c2fc75f507da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:03.709505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c81671-26f9-487a-b86c-c2fc75f507da service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:03.721131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1354/2685] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:04.369395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befe496-53d5-400c-bdc7-a60455c49fb8 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:04.370958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6befe496-53d5-400c-bdc7-a60455c49fb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:04.484549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befe496-53d5-400c-bdc7-a60455c49fb8 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:04.490572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5dba9-5b82-431d-af36-f226ce915202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:04.491360 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5dba9-5b82-431d-af36-f226ce915202 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:04.491753 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5dba9-5b82-431d-af36-f226ce915202 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:04.492171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5dba9-5b82-431d-af36-f226ce915202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:04.494664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-beb5dba9-5b82-431d-af36-f226ce915202 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:04.582456 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5dba9-5b82-431d-af36-f226ce915202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:04.584297 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5dba9-5b82-431d-af36-f226ce915202 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:04.589781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:04.598652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1332/2686] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:04.971821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c81671-26f9-487a-b86c-c2fc75f507da service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:04.973884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-81c81671-26f9-487a-b86c-c2fc75f507da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:05.048963 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c81671-26f9-487a-b86c-c2fc75f507da service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:05.053085 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c5918-cb02-4bda-b3df-b6ba89552d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:05.054015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5918-cb02-4bda-b3df-b6ba89552d90 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:05.054407 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5918-cb02-4bda-b3df-b6ba89552d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:05.055329 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5918-cb02-4bda-b3df-b6ba89552d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:05.057556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e34c5918-cb02-4bda-b3df-b6ba89552d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:05.144158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c5918-cb02-4bda-b3df-b6ba89552d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:05.146261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c5918-cb02-4bda-b3df-b6ba89552d90 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:05.162932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1355/2687] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:09.157959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5dba9-5b82-431d-af36-f226ce915202 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:09.160719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-beb5dba9-5b82-431d-af36-f226ce915202 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:09.299608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5dba9-5b82-431d-af36-f226ce915202 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:09.308038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1515b-ea0e-4e78-a5a0-7533893b7585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba61318896f43e5a68e80f38ae5f3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:09.308632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1515b-ea0e-4e78-a5a0-7533893b7585 service placement] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:09.308939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1515b-ea0e-4e78-a5a0-7533893b7585 service placement] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:09.309202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1515b-ea0e-4e78-a5a0-7533893b7585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:09.311482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b9f1515b-ea0e-4e78-a5a0-7533893b7585 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:09.328532 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1515b-ea0e-4e78-a5a0-7533893b7585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:09.330878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1515b-ea0e-4e78-a5a0-7533893b7585 service placement] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:09.347809 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1333/2688] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:13.629959 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c5918-cb02-4bda-b3df-b6ba89552d90 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:13.632839 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e34c5918-cb02-4bda-b3df-b6ba89552d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:13.655288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c5918-cb02-4bda-b3df-b6ba89552d90 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:13.661649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:13.662631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:13.663053 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:13.663393 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] PATH_INFO: `/v3/users/54c2a1853b3840dc882c0428dd142d61` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:13.665756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c2a1853b3840dc882c0428dd142d61)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:13.668366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:13.737327 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c2a1853b3840dc882c0428dd142d61'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:13.752965 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c2a1853b3840dc882c0428dd142d61'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:13.764726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c2a1853b3840dc882c0428dd142d61'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:13.771472 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:13.776491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c2a1853b3840dc882c0428dd142d61'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:13.777781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c2a1853b3840dc882c0428dd142d61'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:13.791944 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1356/2689] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:34:13 2022] DELETE /identity/v3/users/54c2a1853b3840dc882c0428dd142d61 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:34:14.021695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1515b-ea0e-4e78-a5a0-7533893b7585 service placement] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:14.039803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1515b-ea0e-4e78-a5a0-7533893b7585 service placement] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:14.119243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:14.120045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:14.120339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:14.120624 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] PATH_INFO: `/v3/projects/57fcc98f64a94801918f5c7d757dfdce` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:14.121925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=57fcc98f64a94801918f5c7d757dfdce)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:14.123908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:14.187450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57fcc98f64a94801918f5c7d757dfdce', 'request_id': 'req-a6d70b27-ee61-4606-a7fe-e083b8246afe'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.197401 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57fcc98f64a94801918f5c7d757dfdce', 'request_id': 'req-a6d70b27-ee61-4606-a7fe-e083b8246afe'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.204905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57fcc98f64a94801918f5c7d757dfdce', 'request_id': 'req-a6d70b27-ee61-4606-a7fe-e083b8246afe'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.217973 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] The token cache is being invalidate because project 57fcc98f64a94801918f5c7d757dfdce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:34:14.218270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.219005 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.220634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1334/2690] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:34:14 2022] DELETE /identity/v3/projects/57fcc98f64a94801918f5c7d757dfdce => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:14.225730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:14.228090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:14.251259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70366aef-f538-4506-b860-2f7b5d7e1e17 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:14.325379 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:14.326409 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:14.326696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:14.326987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] PATH_INFO: `/v3/users/76a24c281c1f46ab8b97fdae81f77a48` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:14.328285 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a24c281c1f46ab8b97fdae81f77a48)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:14.330307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:14.393215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a24c281c1f46ab8b97fdae81f77a48'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.408750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a24c281c1f46ab8b97fdae81f77a48'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.419396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a24c281c1f46ab8b97fdae81f77a48'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.433259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a24c281c1f46ab8b97fdae81f77a48'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.434419 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a24c281c1f46ab8b97fdae81f77a48'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.442861 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1357/2691] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:34:14 2022] DELETE /identity/v3/users/76a24c281c1f46ab8b97fdae81f77a48 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:14.719145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:14.721292 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:14.741307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d70b27-ee61-4606-a7fe-e083b8246afe admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:14.758327 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:14.817832 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c4170-4f92-4fac-8573-5cf5b48ea327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:14.818731 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c4170-4f92-4fac-8573-5cf5b48ea327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:14.819017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c4170-4f92-4fac-8573-5cf5b48ea327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:14.819300 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c4170-4f92-4fac-8573-5cf5b48ea327 admin admin] PATH_INFO: `/v3/projects/67998dd629ac4599a85fcfaa2ec41be0` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:14.821161 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c4170-4f92-4fac-8573-5cf5b48ea327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67998dd629ac4599a85fcfaa2ec41be0)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:14.823140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c4170-4f92-4fac-8573-5cf5b48ea327 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:14.880056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ac3c4170-4f92-4fac-8573-5cf5b48ea327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67998dd629ac4599a85fcfaa2ec41be0', 'request_id': 'req-ac3c4170-4f92-4fac-8573-5cf5b48ea327'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.887891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ac3c4170-4f92-4fac-8573-5cf5b48ea327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67998dd629ac4599a85fcfaa2ec41be0', 'request_id': 'req-ac3c4170-4f92-4fac-8573-5cf5b48ea327'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.895556 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ac3c4170-4f92-4fac-8573-5cf5b48ea327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67998dd629ac4599a85fcfaa2ec41be0', 'request_id': 'req-ac3c4170-4f92-4fac-8573-5cf5b48ea327'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.907128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ac3c4170-4f92-4fac-8573-5cf5b48ea327 admin admin] The token cache is being invalidate because project 67998dd629ac4599a85fcfaa2ec41be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:34:14.907422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ac3c4170-4f92-4fac-8573-5cf5b48ea327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.908113 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ac3c4170-4f92-4fac-8573-5cf5b48ea327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:14.909711 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1335/2692] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:34:14 2022] DELETE /identity/v3/projects/67998dd629ac4599a85fcfaa2ec41be0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:17.275726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:17.277320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:17.297956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cf9e0-d820-43dd-96be-debb85e82dea admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:17.381218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:17.382542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:17.382837 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:17.383257 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] PATH_INFO: `/v3/users/70728b15fa0043c3aee3006b4a5825c8` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:17.385885 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70728b15fa0043c3aee3006b4a5825c8)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:17.389609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:17.420231 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:17.482167 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70728b15fa0043c3aee3006b4a5825c8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:17.502416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70728b15fa0043c3aee3006b4a5825c8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:17.514042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70728b15fa0043c3aee3006b4a5825c8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:17.526464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70728b15fa0043c3aee3006b4a5825c8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:17.527439 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70728b15fa0043c3aee3006b4a5825c8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:17.539649 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1358/2693] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:34:17 2022] DELETE /identity/v3/users/70728b15fa0043c3aee3006b4a5825c8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:17.544492 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333ce72-6208-4c36-adb4-c9334434f53e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:17.545216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333ce72-6208-4c36-adb4-c9334434f53e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:17.545216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333ce72-6208-4c36-adb4-c9334434f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:17.564830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8333ce72-6208-4c36-adb4-c9334434f53e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:17.566341 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8333ce72-6208-4c36-adb4-c9334434f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:17.666401 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1336/2694] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:34:17.678785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:17.680895 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:17.761801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f25a7-146a-48c9-9274-657b78eda720 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:17.768243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e14255-8fe0-47e3-95d8-cbda7ca8a419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:17.769412 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e14255-8fe0-47e3-95d8-cbda7ca8a419 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:17.769925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e14255-8fe0-47e3-95d8-cbda7ca8a419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:17.770420 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e14255-8fe0-47e3-95d8-cbda7ca8a419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:17.787480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e14255-8fe0-47e3-95d8-cbda7ca8a419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:17.790080 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e14255-8fe0-47e3-95d8-cbda7ca8a419 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:17.801502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1359/2695] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:18.133404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333ce72-6208-4c36-adb4-c9334434f53e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:18.135458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8333ce72-6208-4c36-adb4-c9334434f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:18.153444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333ce72-6208-4c36-adb4-c9334434f53e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:18.161474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:18.162960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:18.163328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:18.163743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] PATH_INFO: `/v3/projects/68c359e3d36e4ce48085e3fe3e2d39e2` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:18.165281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c359e3d36e4ce48085e3fe3e2d39e2)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:18.169378 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:18.235871 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:18.241538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c359e3d36e4ce48085e3fe3e2d39e2', 'request_id': 'req-a1ac6b8b-b231-461a-a20b-b30945900697'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:18.255030 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c359e3d36e4ce48085e3fe3e2d39e2', 'request_id': 'req-a1ac6b8b-b231-461a-a20b-b30945900697'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:18.267195 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c359e3d36e4ce48085e3fe3e2d39e2', 'request_id': 'req-a1ac6b8b-b231-461a-a20b-b30945900697'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:18.287642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] The token cache is being invalidate because project 68c359e3d36e4ce48085e3fe3e2d39e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:34:18.287642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:18.287642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:18.287642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1337/2696] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:34:18 2022] DELETE /identity/v3/projects/68c359e3d36e4ce48085e3fe3e2d39e2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:34:18.292657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e14255-8fe0-47e3-95d8-cbda7ca8a419 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:18.303799 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e14255-8fe0-47e3-95d8-cbda7ca8a419 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:18.393712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c2da9-078e-44b6-b938-9bfbbd3b4825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:18.395275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c2da9-078e-44b6-b938-9bfbbd3b4825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:18.395741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c2da9-078e-44b6-b938-9bfbbd3b4825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:18.396196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c2da9-078e-44b6-b938-9bfbbd3b4825 admin admin] PATH_INFO: `/v3/users/a68a1395fbec435c8fc357e681ace121` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:18.398403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c2da9-078e-44b6-b938-9bfbbd3b4825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68a1395fbec435c8fc357e681ace121)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:18.402179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c2da9-078e-44b6-b938-9bfbbd3b4825 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:18.457608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:18.466287 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c25c2da9-078e-44b6-b938-9bfbbd3b4825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68a1395fbec435c8fc357e681ace121'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:18.485647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c25c2da9-078e-44b6-b938-9bfbbd3b4825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68a1395fbec435c8fc357e681ace121'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:18.493931 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c25c2da9-078e-44b6-b938-9bfbbd3b4825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68a1395fbec435c8fc357e681ace121'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:18.502842 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c25c2da9-078e-44b6-b938-9bfbbd3b4825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68a1395fbec435c8fc357e681ace121'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:18.503677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c25c2da9-078e-44b6-b938-9bfbbd3b4825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68a1395fbec435c8fc357e681ace121'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:18.513889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1360/2697] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:34:18 2022] DELETE /identity/v3/users/a68a1395fbec435c8fc357e681ace121 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:34:18.836666 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:18.838951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:18.855241 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac6b8b-b231-461a-a20b-b30945900697 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:18.954430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535052c-b2d3-4bc9-929b-9f3129b426dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:18.955311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535052c-b2d3-4bc9-929b-9f3129b426dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:18.955585 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535052c-b2d3-4bc9-929b-9f3129b426dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:18.956094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535052c-b2d3-4bc9-929b-9f3129b426dd admin admin] PATH_INFO: `/v3/projects/b2caa91432294d7e8cedd11971e0bf53` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:18.957196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535052c-b2d3-4bc9-929b-9f3129b426dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2caa91432294d7e8cedd11971e0bf53)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:18.959155 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535052c-b2d3-4bc9-929b-9f3129b426dd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:19.036128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2535052c-b2d3-4bc9-929b-9f3129b426dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2caa91432294d7e8cedd11971e0bf53', 'request_id': 'req-2535052c-b2d3-4bc9-929b-9f3129b426dd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:19.047758 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2535052c-b2d3-4bc9-929b-9f3129b426dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2caa91432294d7e8cedd11971e0bf53', 'request_id': 'req-2535052c-b2d3-4bc9-929b-9f3129b426dd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:19.055702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2535052c-b2d3-4bc9-929b-9f3129b426dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2caa91432294d7e8cedd11971e0bf53', 'request_id': 'req-2535052c-b2d3-4bc9-929b-9f3129b426dd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:19.074516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2535052c-b2d3-4bc9-929b-9f3129b426dd admin admin] The token cache is being invalidate because project b2caa91432294d7e8cedd11971e0bf53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:34:19.074848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2535052c-b2d3-4bc9-929b-9f3129b426dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:19.075551 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2535052c-b2d3-4bc9-929b-9f3129b426dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:19.077429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1338/2698] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:34:18 2022] DELETE /identity/v3/projects/b2caa91432294d7e8cedd11971e0bf53 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:19.082783 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8c26-c804-44a3-bb46-c9ae24afd62b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:19.083218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8c26-c804-44a3-bb46-c9ae24afd62b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:19.083668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8c26-c804-44a3-bb46-c9ae24afd62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:19.111690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2b4c8c26-c804-44a3-bb46-c9ae24afd62b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:19.113004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2b4c8c26-c804-44a3-bb46-c9ae24afd62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:19.180724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1361/2699] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:19.190017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94156626-5cad-4e3c-95ae-c0a55f2e616c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:19.190639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94156626-5cad-4e3c-95ae-c0a55f2e616c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:19.191001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94156626-5cad-4e3c-95ae-c0a55f2e616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:19.215431 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-94156626-5cad-4e3c-95ae-c0a55f2e616c None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:19.216682 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-94156626-5cad-4e3c-95ae-c0a55f2e616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:19.228922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1339/2700] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:34:19.233780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c8c26-c804-44a3-bb46-c9ae24afd62b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:19.247408 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c8c26-c804-44a3-bb46-c9ae24afd62b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:19.252974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebfd12-6927-49f1-830b-ceaabdf34fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:19.253699 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebfd12-6927-49f1-830b-ceaabdf34fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:19.254028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebfd12-6927-49f1-830b-ceaabdf34fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:19.254410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebfd12-6927-49f1-830b-ceaabdf34fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:19.255216 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebfd12-6927-49f1-830b-ceaabdf34fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:34:19.255562 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebfd12-6927-49f1-830b-ceaabdf34fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:19.259128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebfd12-6927-49f1-830b-ceaabdf34fb4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:19.275064 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1362/2701] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:34:19.280532 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94156626-5cad-4e3c-95ae-c0a55f2e616c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:19.292905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94156626-5cad-4e3c-95ae-c0a55f2e616c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:19.300361 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664421b-7c35-435a-9a4f-bca3842a7458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:19.301274 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664421b-7c35-435a-9a4f-bca3842a7458 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:19.301790 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664421b-7c35-435a-9a4f-bca3842a7458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:19.302150 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664421b-7c35-435a-9a4f-bca3842a7458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:19.303004 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664421b-7c35-435a-9a4f-bca3842a7458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:19.305838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664421b-7c35-435a-9a4f-bca3842a7458 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:19.345641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1340/2702] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:34:19 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:34:19.350385 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebfd12-6927-49f1-830b-ceaabdf34fb4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:19.361416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebfd12-6927-49f1-830b-ceaabdf34fb4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:19.444137 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cab58-1537-424b-99d5-37ca9dba10cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:19.444929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cab58-1537-424b-99d5-37ca9dba10cb admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:19.445250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cab58-1537-424b-99d5-37ca9dba10cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:19.445527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cab58-1537-424b-99d5-37ca9dba10cb admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:19.446266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cab58-1537-424b-99d5-37ca9dba10cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:19.448261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cab58-1537-424b-99d5-37ca9dba10cb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:19.472465 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1363/2703] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:34:19 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:34:19.477964 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664421b-7c35-435a-9a4f-bca3842a7458 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:19.490214 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664421b-7c35-435a-9a4f-bca3842a7458 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:19.496517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71908718-8709-4a9b-8614-9153ffcbcb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:19.497239 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71908718-8709-4a9b-8614-9153ffcbcb5e admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:19.497527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71908718-8709-4a9b-8614-9153ffcbcb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:19.497951 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71908718-8709-4a9b-8614-9153ffcbcb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:19.499054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71908718-8709-4a9b-8614-9153ffcbcb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:19.500747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71908718-8709-4a9b-8614-9153ffcbcb5e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:19.513436 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1341/2704] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:34:19.518456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cab58-1537-424b-99d5-37ca9dba10cb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:19.531735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cab58-1537-424b-99d5-37ca9dba10cb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:19.539552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588df03-8c3d-44f1-b2b5-5397d89578ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:19.541202 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588df03-8c3d-44f1-b2b5-5397d89578ab admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:19.541727 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588df03-8c3d-44f1-b2b5-5397d89578ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:19.542234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588df03-8c3d-44f1-b2b5-5397d89578ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:19.544012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588df03-8c3d-44f1-b2b5-5397d89578ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:19.547250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588df03-8c3d-44f1-b2b5-5397d89578ab admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:19.561400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1364/2705] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:34:19.565881 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71908718-8709-4a9b-8614-9153ffcbcb5e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:19.577779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71908718-8709-4a9b-8614-9153ffcbcb5e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:19.588366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a74603-8b37-4c1c-a16b-7b68677aef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:19.589634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74603-8b37-4c1c-a16b-7b68677aef57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:19.590133 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74603-8b37-4c1c-a16b-7b68677aef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:19.590646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74603-8b37-4c1c-a16b-7b68677aef57 admin admin] PATH_INFO: `/v3/projects/49664462a32243788cfc8380f141b2de/users/fdc11dad9fe74c40ab8bd01161f6dbf3/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:19.612589 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a74603-8b37-4c1c-a16b-7b68677aef57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49664462a32243788cfc8380f141b2de, user_id=fdc11dad9fe74c40ab8bd01161f6dbf3, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:19.615482 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a74603-8b37-4c1c-a16b-7b68677aef57 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:19.626680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:19.637052 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1342/2706] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:19 2022] PUT /identity/v3/projects/49664462a32243788cfc8380f141b2de/users/fdc11dad9fe74c40ab8bd01161f6dbf3/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:34:19.657338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e732e3a-1345-4b32-8073-8aa3de11c964 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:19.657819 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e732e3a-1345-4b32-8073-8aa3de11c964 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:19.658325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e732e3a-1345-4b32-8073-8aa3de11c964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:19.696549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4e732e3a-1345-4b32-8073-8aa3de11c964 None None] MFA Rules not processed for user `fdc11dad9fe74c40ab8bd01161f6dbf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:19.698073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4e732e3a-1345-4b32-8073-8aa3de11c964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:19.708916 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:19.801726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1365/2707] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:19.808232 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a74603-8b37-4c1c-a16b-7b68677aef57 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:19.879838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a74603-8b37-4c1c-a16b-7b68677aef57 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:19.885311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc68300-02bb-433c-a2f8-ec1d7c3c6df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:19.886215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68300-02bb-433c-a2f8-ec1d7c3c6df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:19.886716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68300-02bb-433c-a2f8-ec1d7c3c6df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:19.886873 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68300-02bb-433c-a2f8-ec1d7c3c6df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:19.887490 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc68300-02bb-433c-a2f8-ec1d7c3c6df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:19.889539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc68300-02bb-433c-a2f8-ec1d7c3c6df7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:19.924327 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1343/2708] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:34:19 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:34:19.930274 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e732e3a-1345-4b32-8073-8aa3de11c964 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:19.947735 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e732e3a-1345-4b32-8073-8aa3de11c964 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:20.034955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e260b4c-4288-4e26-bb2a-4040f532efa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:20.036115 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260b4c-4288-4e26-bb2a-4040f532efa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:20.036590 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260b4c-4288-4e26-bb2a-4040f532efa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:20.037095 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260b4c-4288-4e26-bb2a-4040f532efa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:20.038288 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e260b4c-4288-4e26-bb2a-4040f532efa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:20.041962 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e260b4c-4288-4e26-bb2a-4040f532efa9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:20.076210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1366/2709] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:34:19 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:34:20.081535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc68300-02bb-433c-a2f8-ec1d7c3c6df7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:20.099815 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc68300-02bb-433c-a2f8-ec1d7c3c6df7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:20.107470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626adb-96d9-4f64-a784-796a76017f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:20.108631 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626adb-96d9-4f64-a784-796a76017f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:20.109182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626adb-96d9-4f64-a784-796a76017f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:20.109682 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626adb-96d9-4f64-a784-796a76017f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:20.111007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87626adb-96d9-4f64-a784-796a76017f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:20.113879 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87626adb-96d9-4f64-a784-796a76017f43 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:20.126106 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1344/2710] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:34:20.135175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e260b4c-4288-4e26-bb2a-4040f532efa9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:20.153876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e260b4c-4288-4e26-bb2a-4040f532efa9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:20.162746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b80b08-cd7e-4bfc-b6bc-92923e48f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:20.163987 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b80b08-cd7e-4bfc-b6bc-92923e48f192 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:20.164286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b80b08-cd7e-4bfc-b6bc-92923e48f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:20.164564 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b80b08-cd7e-4bfc-b6bc-92923e48f192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:20.165356 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b80b08-cd7e-4bfc-b6bc-92923e48f192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:20.167058 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b80b08-cd7e-4bfc-b6bc-92923e48f192 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:20.182270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1367/2711] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:34:20.189202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626adb-96d9-4f64-a784-796a76017f43 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:20.202982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626adb-96d9-4f64-a784-796a76017f43 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:20.211596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0360c-1abe-449a-98ec-1b09b20c6862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:20.213140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0360c-1abe-449a-98ec-1b09b20c6862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:20.213611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0360c-1abe-449a-98ec-1b09b20c6862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:20.214059 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0360c-1abe-449a-98ec-1b09b20c6862 admin admin] PATH_INFO: `/v3/projects/38f38574ab5a4185b9c8c65054c2fcff/users/6b79fa3471344f34aa31fc196d1bfd51/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:20.241047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0360c-1abe-449a-98ec-1b09b20c6862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f38574ab5a4185b9c8c65054c2fcff, user_id=6b79fa3471344f34aa31fc196d1bfd51, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:20.245892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0360c-1abe-449a-98ec-1b09b20c6862 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:20.266137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1345/2712] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:20 2022] PUT /identity/v3/projects/38f38574ab5a4185b9c8c65054c2fcff/users/6b79fa3471344f34aa31fc196d1bfd51/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:20.277695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ccc29-bd38-4902-93c6-b9bafdb78797 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:20.278019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ccc29-bd38-4902-93c6-b9bafdb78797 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:20.278259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ccc29-bd38-4902-93c6-b9bafdb78797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:20.328022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a84ccc29-bd38-4902-93c6-b9bafdb78797 None None] MFA Rules not processed for user `6b79fa3471344f34aa31fc196d1bfd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:20.329334 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a84ccc29-bd38-4902-93c6-b9bafdb78797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:20.438353 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1368/2713] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:34:20.443063 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0360c-1abe-449a-98ec-1b09b20c6862 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:20.530129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0360c-1abe-449a-98ec-1b09b20c6862 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:20.540324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216cc0b-83c4-4d3e-a13f-ec7c8311f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:20.541146 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216cc0b-83c4-4d3e-a13f-ec7c8311f739 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:20.541607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216cc0b-83c4-4d3e-a13f-ec7c8311f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:20.541917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216cc0b-83c4-4d3e-a13f-ec7c8311f739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:20.542680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216cc0b-83c4-4d3e-a13f-ec7c8311f739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:20.544791 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216cc0b-83c4-4d3e-a13f-ec7c8311f739 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:20.576909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1346/2714] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:34:20 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:34:20.583168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ccc29-bd38-4902-93c6-b9bafdb78797 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:20.603600 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ccc29-bd38-4902-93c6-b9bafdb78797 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:20.644567 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:20.715642 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105723c8-b254-47a1-8eff-1419ee69bfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:20.716444 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105723c8-b254-47a1-8eff-1419ee69bfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:20.716741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105723c8-b254-47a1-8eff-1419ee69bfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:20.717214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105723c8-b254-47a1-8eff-1419ee69bfb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:20.717950 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105723c8-b254-47a1-8eff-1419ee69bfb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:20.719925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105723c8-b254-47a1-8eff-1419ee69bfb2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:20.748437 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1369/2715] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:34:20 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:34:20.750669 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216cc0b-83c4-4d3e-a13f-ec7c8311f739 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:20.769539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216cc0b-83c4-4d3e-a13f-ec7c8311f739 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:20.778237 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc22f5-e19b-41b9-bad0-8b5d1aba680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:20.779342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc22f5-e19b-41b9-bad0-8b5d1aba680e admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:20.779798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc22f5-e19b-41b9-bad0-8b5d1aba680e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:20.780269 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc22f5-e19b-41b9-bad0-8b5d1aba680e admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:20.781506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc22f5-e19b-41b9-bad0-8b5d1aba680e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:20.783178 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc22f5-e19b-41b9-bad0-8b5d1aba680e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:20.797197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1347/2716] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:34:20.803371 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105723c8-b254-47a1-8eff-1419ee69bfb2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:20.820182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105723c8-b254-47a1-8eff-1419ee69bfb2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:20.826447 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31994e2f-cfc8-4a7d-ad0f-e696e5d76bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:20.827512 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31994e2f-cfc8-4a7d-ad0f-e696e5d76bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:20.827849 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31994e2f-cfc8-4a7d-ad0f-e696e5d76bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:20.828181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31994e2f-cfc8-4a7d-ad0f-e696e5d76bdc admin admin] PATH_INFO: `/v3/projects/a786ab1d746349efa3b9738338d1cdb0/users/f35fdde09b834de296a2336cdb5a3a4c/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:20.846405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31994e2f-cfc8-4a7d-ad0f-e696e5d76bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a786ab1d746349efa3b9738338d1cdb0, user_id=f35fdde09b834de296a2336cdb5a3a4c, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:20.849231 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31994e2f-cfc8-4a7d-ad0f-e696e5d76bdc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:20.866298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1370/2717] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:20 2022] PUT /identity/v3/projects/a786ab1d746349efa3b9738338d1cdb0/users/f35fdde09b834de296a2336cdb5a3a4c/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:20.871071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc22f5-e19b-41b9-bad0-8b5d1aba680e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:20.888054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc22f5-e19b-41b9-bad0-8b5d1aba680e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:20.924516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:20.977468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03a147-b187-40ab-b9f3-2a2b5be7ee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:20.978136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03a147-b187-40ab-b9f3-2a2b5be7ee77 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:20.978541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03a147-b187-40ab-b9f3-2a2b5be7ee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:20.979060 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03a147-b187-40ab-b9f3-2a2b5be7ee77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:20.980077 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03a147-b187-40ab-b9f3-2a2b5be7ee77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:20.981849 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03a147-b187-40ab-b9f3-2a2b5be7ee77 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:20.995156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1348/2718] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:34:21.001536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31994e2f-cfc8-4a7d-ad0f-e696e5d76bdc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:21.027019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31994e2f-cfc8-4a7d-ad0f-e696e5d76bdc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:21.034821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ab3b2-d989-4317-82c7-9e2d744ff906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:21.036292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab3b2-d989-4317-82c7-9e2d744ff906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:21.036629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab3b2-d989-4317-82c7-9e2d744ff906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:21.037007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab3b2-d989-4317-82c7-9e2d744ff906 admin admin] PATH_INFO: `/v3/projects/a786ab1d746349efa3b9738338d1cdb0/users/f35fdde09b834de296a2336cdb5a3a4c/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:21.041246 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ab3b2-d989-4317-82c7-9e2d744ff906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a786ab1d746349efa3b9738338d1cdb0, user_id=f35fdde09b834de296a2336cdb5a3a4c, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:21.046283 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ab3b2-d989-4317-82c7-9e2d744ff906 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:21.060207 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1371/2719] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:20 2022] PUT /identity/v3/projects/a786ab1d746349efa3b9738338d1cdb0/users/f35fdde09b834de296a2336cdb5a3a4c/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:21.071399 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea1704-4016-408f-9854-57874995e707 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:21.071865 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea1704-4016-408f-9854-57874995e707 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:21.072180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea1704-4016-408f-9854-57874995e707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:21.117641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-15ea1704-4016-408f-9854-57874995e707 None None] MFA Rules not processed for user `f35fdde09b834de296a2336cdb5a3a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:21.119451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-15ea1704-4016-408f-9854-57874995e707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:21.226884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1349/2720] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:21.253325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ab3b2-d989-4317-82c7-9e2d744ff906 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:21.255750 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d96ab3b2-d989-4317-82c7-9e2d744ff906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:21.327842 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ab3b2-d989-4317-82c7-9e2d744ff906 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:21.332060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a70b-349a-4e73-9bfc-6cb505480e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:21.332723 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a70b-349a-4e73-9bfc-6cb505480e2d service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:21.333009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a70b-349a-4e73-9bfc-6cb505480e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:21.333320 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a70b-349a-4e73-9bfc-6cb505480e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:21.344226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50a70b-349a-4e73-9bfc-6cb505480e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:21.345729 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50a70b-349a-4e73-9bfc-6cb505480e2d service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:21.357441 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1372/2721] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:21.405331 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea1704-4016-408f-9854-57874995e707 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:21.407026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-15ea1704-4016-408f-9854-57874995e707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:21.425516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea1704-4016-408f-9854-57874995e707 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:21.430517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b094f-c215-4355-8f9d-78e81fcad0fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:21.431187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b094f-c215-4355-8f9d-78e81fcad0fb service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:21.431477 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b094f-c215-4355-8f9d-78e81fcad0fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:21.431756 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b094f-c215-4355-8f9d-78e81fcad0fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:21.497285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b094f-c215-4355-8f9d-78e81fcad0fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:21.498763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b094f-c215-4355-8f9d-78e81fcad0fb service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:21.510032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1350/2722] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:34:24.526772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a70b-349a-4e73-9bfc-6cb505480e2d service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:24.614968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a70b-349a-4e73-9bfc-6cb505480e2d service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:24.623066 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:24.624704 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:24.625278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:24.625777 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] PATH_INFO: `/v3/users/fdc11dad9fe74c40ab8bd01161f6dbf3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:24.628152 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc11dad9fe74c40ab8bd01161f6dbf3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:24.631016 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:24.656554 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:24.701116 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc11dad9fe74c40ab8bd01161f6dbf3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:24.714522 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc11dad9fe74c40ab8bd01161f6dbf3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:24.722661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc11dad9fe74c40ab8bd01161f6dbf3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:24.733763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc11dad9fe74c40ab8bd01161f6dbf3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:24.735952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc11dad9fe74c40ab8bd01161f6dbf3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:24.747083 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1373/2723] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:34:24 2022] DELETE /identity/v3/users/fdc11dad9fe74c40ab8bd01161f6dbf3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:24.752295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fabb8-e2bc-427c-a546-e1833623145f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:24.752860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fabb8-e2bc-427c-a546-e1833623145f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:24.752860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fabb8-e2bc-427c-a546-e1833623145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:24.775068 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-100fabb8-e2bc-427c-a546-e1833623145f None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:24.776381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-100fabb8-e2bc-427c-a546-e1833623145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:24.826683 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:24.855650 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1351/2724] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:34:24.866416 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:24.868537 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:24.962980 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36976366-2ecf-42f1-af5a-45addb262544 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:24.969395 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6623a4e-f545-4801-8178-efdc179523e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:24.970473 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623a4e-f545-4801-8178-efdc179523e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:24.971257 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623a4e-f545-4801-8178-efdc179523e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:24.971421 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623a4e-f545-4801-8178-efdc179523e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:24.984106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6623a4e-f545-4801-8178-efdc179523e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:24.985797 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6623a4e-f545-4801-8178-efdc179523e3 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:25.005344 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1374/2725] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:25.500119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fabb8-e2bc-427c-a546-e1833623145f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:25.504576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-100fabb8-e2bc-427c-a546-e1833623145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:25.525440 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fabb8-e2bc-427c-a546-e1833623145f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:25.531582 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:25.533034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:25.533401 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:25.534467 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] PATH_INFO: `/v3/projects/49664462a32243788cfc8380f141b2de` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:25.535296 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49664462a32243788cfc8380f141b2de)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:25.537837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:25.622328 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49664462a32243788cfc8380f141b2de', 'request_id': 'req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:25.638109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49664462a32243788cfc8380f141b2de', 'request_id': 'req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:25.647565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49664462a32243788cfc8380f141b2de', 'request_id': 'req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:25.661082 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] The token cache is being invalidate because project 49664462a32243788cfc8380f141b2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:34:25.661712 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:25.662799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:25.665452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1352/2726] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:34:25 2022] DELETE /identity/v3/projects/49664462a32243788cfc8380f141b2de => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:25.669863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6623a4e-f545-4801-8178-efdc179523e3 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:25.682475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6623a4e-f545-4801-8178-efdc179523e3 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:25.777046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:25.777893 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:25.778186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:25.778492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] PATH_INFO: `/v3/users/6b79fa3471344f34aa31fc196d1bfd51` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:25.779838 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b79fa3471344f34aa31fc196d1bfd51)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:25.781876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:25.838247 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:25.847421 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b79fa3471344f34aa31fc196d1bfd51'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:25.864703 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b79fa3471344f34aa31fc196d1bfd51'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:25.873513 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b79fa3471344f34aa31fc196d1bfd51'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:25.884745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b79fa3471344f34aa31fc196d1bfd51'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:25.885480 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b79fa3471344f34aa31fc196d1bfd51'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:25.893911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1375/2727] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:34:25 2022] DELETE /identity/v3/users/6b79fa3471344f34aa31fc196d1bfd51 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:26.303521 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:26.307043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:26.327100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838bea3-fb0e-410e-b2ad-1be3c094a7b2 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:26.430102 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:26.431129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:26.431420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:26.431826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] PATH_INFO: `/v3/projects/38f38574ab5a4185b9c8c65054c2fcff` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:26.433174 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f38574ab5a4185b9c8c65054c2fcff)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:26.435286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:26.503707 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f38574ab5a4185b9c8c65054c2fcff', 'request_id': 'req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:26.516773 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f38574ab5a4185b9c8c65054c2fcff', 'request_id': 'req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:26.526087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f38574ab5a4185b9c8c65054c2fcff', 'request_id': 'req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:26.531619 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:26.548512 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] The token cache is being invalidate because project 38f38574ab5a4185b9c8c65054c2fcff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:34:26.548717 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:26.549587 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:26.551410 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1353/2728] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:34:26 2022] DELETE /identity/v3/projects/38f38574ab5a4185b9c8c65054c2fcff => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:26.556561 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:26.558742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:26.573493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727dd8a-c936-4662-9872-26f0e768dc74 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:26.640218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac2d7f-a6a4-46ce-a5b8-42adddfbc4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:26.641139 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac2d7f-a6a4-46ce-a5b8-42adddfbc4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:26.641428 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac2d7f-a6a4-46ce-a5b8-42adddfbc4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:26.641715 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac2d7f-a6a4-46ce-a5b8-42adddfbc4a7 admin admin] PATH_INFO: `/v3/users/f35fdde09b834de296a2336cdb5a3a4c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:26.643039 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac2d7f-a6a4-46ce-a5b8-42adddfbc4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35fdde09b834de296a2336cdb5a3a4c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:26.645199 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac2d7f-a6a4-46ce-a5b8-42adddfbc4a7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:26.717134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-58ac2d7f-a6a4-46ce-a5b8-42adddfbc4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35fdde09b834de296a2336cdb5a3a4c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:26.737589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-58ac2d7f-a6a4-46ce-a5b8-42adddfbc4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35fdde09b834de296a2336cdb5a3a4c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:26.748636 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-58ac2d7f-a6a4-46ce-a5b8-42adddfbc4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35fdde09b834de296a2336cdb5a3a4c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:26.760606 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-58ac2d7f-a6a4-46ce-a5b8-42adddfbc4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35fdde09b834de296a2336cdb5a3a4c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:26.761332 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-58ac2d7f-a6a4-46ce-a5b8-42adddfbc4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35fdde09b834de296a2336cdb5a3a4c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:26.768702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1376/2729] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:34:26 2022] DELETE /identity/v3/users/f35fdde09b834de296a2336cdb5a3a4c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:27.127755 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:27.129621 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:27.145649 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89227b75-41e6-4f4a-b4d2-6c894ce89bd5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:27.237706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62343fad-abaa-422d-825a-809cfbd2ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:27.238605 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62343fad-abaa-422d-825a-809cfbd2ff54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:27.238888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62343fad-abaa-422d-825a-809cfbd2ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:27.239167 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62343fad-abaa-422d-825a-809cfbd2ff54 admin admin] PATH_INFO: `/v3/projects/a786ab1d746349efa3b9738338d1cdb0` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:27.240461 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62343fad-abaa-422d-825a-809cfbd2ff54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a786ab1d746349efa3b9738338d1cdb0)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:27.242525 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62343fad-abaa-422d-825a-809cfbd2ff54 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:27.299236 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-62343fad-abaa-422d-825a-809cfbd2ff54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a786ab1d746349efa3b9738338d1cdb0', 'request_id': 'req-62343fad-abaa-422d-825a-809cfbd2ff54'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:27.308379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-62343fad-abaa-422d-825a-809cfbd2ff54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a786ab1d746349efa3b9738338d1cdb0', 'request_id': 'req-62343fad-abaa-422d-825a-809cfbd2ff54'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:27.316419 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-62343fad-abaa-422d-825a-809cfbd2ff54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a786ab1d746349efa3b9738338d1cdb0', 'request_id': 'req-62343fad-abaa-422d-825a-809cfbd2ff54'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:27.341704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-62343fad-abaa-422d-825a-809cfbd2ff54 admin admin] The token cache is being invalidate because project a786ab1d746349efa3b9738338d1cdb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:34:27.342003 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-62343fad-abaa-422d-825a-809cfbd2ff54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:27.342676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-62343fad-abaa-422d-825a-809cfbd2ff54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:27.344537 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1354/2730] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:34:27 2022] DELETE /identity/v3/projects/a786ab1d746349efa3b9738338d1cdb0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:27.352969 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a9203-1893-48c8-8038-11db505ff8c7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:27.353298 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a9203-1893-48c8-8038-11db505ff8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:27.353576 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a9203-1893-48c8-8038-11db505ff8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:27.371780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-326a9203-1893-48c8-8038-11db505ff8c7 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:27.373086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-326a9203-1893-48c8-8038-11db505ff8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:27.423266 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:27.458881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1377/2731] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:27.468324 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cdfaf-4850-48f9-9a7c-8ecbc2833ff6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:27.468620 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cdfaf-4850-48f9-9a7c-8ecbc2833ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:27.468904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cdfaf-4850-48f9-9a7c-8ecbc2833ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:27.488583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e23cdfaf-4850-48f9-9a7c-8ecbc2833ff6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:27.489913 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e23cdfaf-4850-48f9-9a7c-8ecbc2833ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:27.498540 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1355/2732] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:27.504132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a9203-1893-48c8-8038-11db505ff8c7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:27.519686 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a9203-1893-48c8-8038-11db505ff8c7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:27.525487 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbb9da-5d66-400e-bb04-ceb48bbe4d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:27.526173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbb9da-5d66-400e-bb04-ceb48bbe4d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:27.526467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbb9da-5d66-400e-bb04-ceb48bbe4d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:27.526753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbb9da-5d66-400e-bb04-ceb48bbe4d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:27.527563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbb9da-5d66-400e-bb04-ceb48bbe4d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:34:27.527995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbb9da-5d66-400e-bb04-ceb48bbe4d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:27.529611 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbb9da-5d66-400e-bb04-ceb48bbe4d1e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:27.543433 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1378/2733] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:34:27.549027 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cdfaf-4850-48f9-9a7c-8ecbc2833ff6 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:27.565850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cdfaf-4850-48f9-9a7c-8ecbc2833ff6 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:27.574365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b125c-74d7-4992-b52e-7cf3f92d6a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:27.575429 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b125c-74d7-4992-b52e-7cf3f92d6a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:27.575909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b125c-74d7-4992-b52e-7cf3f92d6a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:27.576366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b125c-74d7-4992-b52e-7cf3f92d6a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:27.577632 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b125c-74d7-4992-b52e-7cf3f92d6a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:27.580211 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b125c-74d7-4992-b52e-7cf3f92d6a72 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:27.617959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1356/2734] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:34:27 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:34:27.622402 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbb9da-5d66-400e-bb04-ceb48bbe4d1e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:27.641269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbb9da-5d66-400e-bb04-ceb48bbe4d1e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:27.722634 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a700-f7e1-4bd9-88b4-5c154348303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:27.723726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a700-f7e1-4bd9-88b4-5c154348303c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:27.723726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a700-f7e1-4bd9-88b4-5c154348303c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:27.723726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a700-f7e1-4bd9-88b4-5c154348303c admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:27.724632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780a700-f7e1-4bd9-88b4-5c154348303c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:27.726759 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780a700-f7e1-4bd9-88b4-5c154348303c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:27.753141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1379/2735] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:34:27 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:34:27.757775 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b125c-74d7-4992-b52e-7cf3f92d6a72 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:27.771552 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b125c-74d7-4992-b52e-7cf3f92d6a72 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:27.777426 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1d396-a8ff-45e9-8f23-5878da5c3986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:27.778200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1d396-a8ff-45e9-8f23-5878da5c3986 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:27.778420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1d396-a8ff-45e9-8f23-5878da5c3986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:27.779272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1d396-a8ff-45e9-8f23-5878da5c3986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:27.779437 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1d396-a8ff-45e9-8f23-5878da5c3986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:27.781114 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1d396-a8ff-45e9-8f23-5878da5c3986 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:27.794036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1357/2736] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:34:27.798439 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a700-f7e1-4bd9-88b4-5c154348303c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:27.810384 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a700-f7e1-4bd9-88b4-5c154348303c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:27.815615 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11055-ee55-4aa4-a409-579689552d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:27.816317 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11055-ee55-4aa4-a409-579689552d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:27.816595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11055-ee55-4aa4-a409-579689552d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:27.816869 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11055-ee55-4aa4-a409-579689552d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:27.817726 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b11055-ee55-4aa4-a409-579689552d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:27.819459 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b11055-ee55-4aa4-a409-579689552d5e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:27.831643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1380/2737] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:34:27.836581 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1d396-a8ff-45e9-8f23-5878da5c3986 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:27.847817 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1d396-a8ff-45e9-8f23-5878da5c3986 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:27.852982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cdc03-6749-4aa6-8bb3-4d1f578b2615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:27.853938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cdc03-6749-4aa6-8bb3-4d1f578b2615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:27.854247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cdc03-6749-4aa6-8bb3-4d1f578b2615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:27.854524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cdc03-6749-4aa6-8bb3-4d1f578b2615 admin admin] PATH_INFO: `/v3/projects/5d6fff7933474aab82271e4f143e2478/users/6ccf0e9cf82d4061b14c7cfc78020aa4/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:27.879040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cdc03-6749-4aa6-8bb3-4d1f578b2615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6fff7933474aab82271e4f143e2478, user_id=6ccf0e9cf82d4061b14c7cfc78020aa4, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:27.881874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cdc03-6749-4aa6-8bb3-4d1f578b2615 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:27.909969 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1358/2738] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:27 2022] PUT /identity/v3/projects/5d6fff7933474aab82271e4f143e2478/users/6ccf0e9cf82d4061b14c7cfc78020aa4/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:27.922206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35e9a5-504e-4019-b018-acbf0ed1a377 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:27.922452 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35e9a5-504e-4019-b018-acbf0ed1a377 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:27.922728 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35e9a5-504e-4019-b018-acbf0ed1a377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:27.955432 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0c35e9a5-504e-4019-b018-acbf0ed1a377 None None] MFA Rules not processed for user `6ccf0e9cf82d4061b14c7cfc78020aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:27.956765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0c35e9a5-504e-4019-b018-acbf0ed1a377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:28.044585 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1381/2739] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:28.049758 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cdc03-6749-4aa6-8bb3-4d1f578b2615 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:28.094045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:28.154314 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cdc03-6749-4aa6-8bb3-4d1f578b2615 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:28.159792 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd3381-dc00-4562-b1f9-44bc729209c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:28.160858 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd3381-dc00-4562-b1f9-44bc729209c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:28.161317 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd3381-dc00-4562-b1f9-44bc729209c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:28.161488 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd3381-dc00-4562-b1f9-44bc729209c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:28.162260 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd3381-dc00-4562-b1f9-44bc729209c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:28.164908 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd3381-dc00-4562-b1f9-44bc729209c3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:28.196538 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1359/2740] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:34:28 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:34:28.201100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35e9a5-504e-4019-b018-acbf0ed1a377 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:28.214339 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35e9a5-504e-4019-b018-acbf0ed1a377 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:28.257827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:28.303859 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a24f9-a581-4a93-9e16-ccd282757352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:28.305170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a24f9-a581-4a93-9e16-ccd282757352 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:28.305464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a24f9-a581-4a93-9e16-ccd282757352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:28.305747 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a24f9-a581-4a93-9e16-ccd282757352 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:28.306474 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a24f9-a581-4a93-9e16-ccd282757352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:28.308684 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a24f9-a581-4a93-9e16-ccd282757352 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:28.337991 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1382/2741] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:34:28 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:34:28.341094 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd3381-dc00-4562-b1f9-44bc729209c3 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:28.359013 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd3381-dc00-4562-b1f9-44bc729209c3 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:28.364659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33cf74-ddf3-474a-9533-94c34a338d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:28.365507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33cf74-ddf3-474a-9533-94c34a338d76 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:28.365798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33cf74-ddf3-474a-9533-94c34a338d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:28.366083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33cf74-ddf3-474a-9533-94c34a338d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:28.367706 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33cf74-ddf3-474a-9533-94c34a338d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:28.369414 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33cf74-ddf3-474a-9533-94c34a338d76 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:28.393115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1360/2742] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:34:28.397475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a24f9-a581-4a93-9e16-ccd282757352 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:28.410737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a24f9-a581-4a93-9e16-ccd282757352 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:28.416303 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e3564-edb8-460d-bb38-fde1878d45b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:28.417834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e3564-edb8-460d-bb38-fde1878d45b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:28.417834 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e3564-edb8-460d-bb38-fde1878d45b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:28.418421 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e3564-edb8-460d-bb38-fde1878d45b1 admin admin] PATH_INFO: `/v3/projects/1001675f8f324872a3bcd64cdce18c6b/users/6027f51b4a4b4880b6076cf83b7d1928/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:28.435275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e3564-edb8-460d-bb38-fde1878d45b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1001675f8f324872a3bcd64cdce18c6b, user_id=6027f51b4a4b4880b6076cf83b7d1928, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:28.438092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e3564-edb8-460d-bb38-fde1878d45b1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:28.453841 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1383/2743] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:28 2022] PUT /identity/v3/projects/1001675f8f324872a3bcd64cdce18c6b/users/6027f51b4a4b4880b6076cf83b7d1928/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:28.458576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33cf74-ddf3-474a-9533-94c34a338d76 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:28.477147 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33cf74-ddf3-474a-9533-94c34a338d76 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:28.573505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426a7d8-5e6a-48b6-93a8-c81688ed41e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:28.574215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426a7d8-5e6a-48b6-93a8-c81688ed41e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:28.574610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426a7d8-5e6a-48b6-93a8-c81688ed41e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:28.574812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426a7d8-5e6a-48b6-93a8-c81688ed41e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:28.575962 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426a7d8-5e6a-48b6-93a8-c81688ed41e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:28.577693 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426a7d8-5e6a-48b6-93a8-c81688ed41e7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:28.589489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1361/2744] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:34:28.594599 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e3564-edb8-460d-bb38-fde1878d45b1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:28.608401 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e3564-edb8-460d-bb38-fde1878d45b1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:28.614301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa14feb-148b-46e0-b1a4-ab2f6cec5e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:28.615230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa14feb-148b-46e0-b1a4-ab2f6cec5e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:28.615514 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa14feb-148b-46e0-b1a4-ab2f6cec5e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:28.615794 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa14feb-148b-46e0-b1a4-ab2f6cec5e79 admin admin] PATH_INFO: `/v3/projects/1001675f8f324872a3bcd64cdce18c6b/users/6027f51b4a4b4880b6076cf83b7d1928/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:28.618049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa14feb-148b-46e0-b1a4-ab2f6cec5e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1001675f8f324872a3bcd64cdce18c6b, user_id=6027f51b4a4b4880b6076cf83b7d1928, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:28.620827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa14feb-148b-46e0-b1a4-ab2f6cec5e79 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:28.635941 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1384/2745] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:28 2022] PUT /identity/v3/projects/1001675f8f324872a3bcd64cdce18c6b/users/6027f51b4a4b4880b6076cf83b7d1928/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:28.706168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8e3c-5659-46f2-8174-0de3292bb28b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:28.706455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8e3c-5659-46f2-8174-0de3292bb28b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:28.706745 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8e3c-5659-46f2-8174-0de3292bb28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:28.739816 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-bcef8e3c-5659-46f2-8174-0de3292bb28b None None] MFA Rules not processed for user `6027f51b4a4b4880b6076cf83b7d1928`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:28.741123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bcef8e3c-5659-46f2-8174-0de3292bb28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:28.832524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1362/2746] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:34:28.846636 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa14feb-148b-46e0-b1a4-ab2f6cec5e79 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:28.848666 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4aa14feb-148b-46e0-b1a4-ab2f6cec5e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:28.929524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa14feb-148b-46e0-b1a4-ab2f6cec5e79 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:28.933848 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6523d90-c944-416a-9cb2-c48989dbd731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:28.934319 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523d90-c944-416a-9cb2-c48989dbd731 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:28.934671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523d90-c944-416a-9cb2-c48989dbd731 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:28.935120 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523d90-c944-416a-9cb2-c48989dbd731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:28.946007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6523d90-c944-416a-9cb2-c48989dbd731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:28.947664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6523d90-c944-416a-9cb2-c48989dbd731 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:28.961233 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1385/2747] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:29.050534 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef8e3c-5659-46f2-8174-0de3292bb28b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:29.061929 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef8e3c-5659-46f2-8174-0de3292bb28b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:29.072446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086dc22-ddaf-454f-98fb-6e6811b54f25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:29.072446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086dc22-ddaf-454f-98fb-6e6811b54f25 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:29.072446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086dc22-ddaf-454f-98fb-6e6811b54f25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:29.072446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086dc22-ddaf-454f-98fb-6e6811b54f25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:29.085462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:29.155314 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086dc22-ddaf-454f-98fb-6e6811b54f25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:29.156880 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086dc22-ddaf-454f-98fb-6e6811b54f25 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:29.166914 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1363/2748] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:29.452922 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6523d90-c944-416a-9cb2-c48989dbd731 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:29.518517 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6523d90-c944-416a-9cb2-c48989dbd731 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:29.523358 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:29.524243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:29.524529 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:29.524810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] PATH_INFO: `/v3/users/6ccf0e9cf82d4061b14c7cfc78020aa4` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:29.526073 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccf0e9cf82d4061b14c7cfc78020aa4)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:29.528155 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:29.562751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:29.582626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccf0e9cf82d4061b14c7cfc78020aa4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:29.595028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccf0e9cf82d4061b14c7cfc78020aa4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:29.607299 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccf0e9cf82d4061b14c7cfc78020aa4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:29.617146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccf0e9cf82d4061b14c7cfc78020aa4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:29.617833 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccf0e9cf82d4061b14c7cfc78020aa4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:29.624549 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1386/2749] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:34:29 2022] DELETE /identity/v3/users/6ccf0e9cf82d4061b14c7cfc78020aa4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:29.629190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013b2c2-5b76-4248-9fdf-2725aa02a10a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:29.629666 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013b2c2-5b76-4248-9fdf-2725aa02a10a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:29.629780 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013b2c2-5b76-4248-9fdf-2725aa02a10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:29.650422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a013b2c2-5b76-4248-9fdf-2725aa02a10a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:29.651695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a013b2c2-5b76-4248-9fdf-2725aa02a10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:29.715883 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1364/2750] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:29.726301 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:29.727740 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:29.787164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b432b-1f8d-4c17-98d7-17d41aca861e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:29.791551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e5761-22c3-405f-a377-cbe75ad27e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:29.792218 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e5761-22c3-405f-a377-cbe75ad27e81 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:29.792507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e5761-22c3-405f-a377-cbe75ad27e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:29.792796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e5761-22c3-405f-a377-cbe75ad27e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:29.803062 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e5761-22c3-405f-a377-cbe75ad27e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:29.805191 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e5761-22c3-405f-a377-cbe75ad27e81 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:29.815932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1387/2751] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:30.125619 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013b2c2-5b76-4248-9fdf-2725aa02a10a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:30.127255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a013b2c2-5b76-4248-9fdf-2725aa02a10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:30.144116 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013b2c2-5b76-4248-9fdf-2725aa02a10a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:30.152441 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:30.153622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:30.154199 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:30.154605 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] PATH_INFO: `/v3/projects/5d6fff7933474aab82271e4f143e2478` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:30.156100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6fff7933474aab82271e4f143e2478)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:30.159210 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:30.231175 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6fff7933474aab82271e4f143e2478', 'request_id': 'req-07d66a48-5aa1-43b4-9835-b4b50e519511'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.243750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6fff7933474aab82271e4f143e2478', 'request_id': 'req-07d66a48-5aa1-43b4-9835-b4b50e519511'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.260691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6fff7933474aab82271e4f143e2478', 'request_id': 'req-07d66a48-5aa1-43b4-9835-b4b50e519511'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.272457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] The token cache is being invalidate because project 5d6fff7933474aab82271e4f143e2478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:34:30.273322 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.274051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.275779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1365/2752] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:34:30 2022] DELETE /identity/v3/projects/5d6fff7933474aab82271e4f143e2478 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:34:30.279872 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e5761-22c3-405f-a377-cbe75ad27e81 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:30.290522 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e5761-22c3-405f-a377-cbe75ad27e81 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:30.355796 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b4c2b-646d-437f-ba86-a3073237addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:30.356702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b4c2b-646d-437f-ba86-a3073237addd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:30.356968 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b4c2b-646d-437f-ba86-a3073237addd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:30.357276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b4c2b-646d-437f-ba86-a3073237addd admin admin] PATH_INFO: `/v3/users/6027f51b4a4b4880b6076cf83b7d1928` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:30.358520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b4c2b-646d-437f-ba86-a3073237addd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6027f51b4a4b4880b6076cf83b7d1928)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:30.360545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b4c2b-646d-437f-ba86-a3073237addd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:30.424676 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5b1b4c2b-646d-437f-ba86-a3073237addd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6027f51b4a4b4880b6076cf83b7d1928'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.426679 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:30.442106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5b1b4c2b-646d-437f-ba86-a3073237addd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6027f51b4a4b4880b6076cf83b7d1928'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.449712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5b1b4c2b-646d-437f-ba86-a3073237addd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6027f51b4a4b4880b6076cf83b7d1928'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.458347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5b1b4c2b-646d-437f-ba86-a3073237addd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6027f51b4a4b4880b6076cf83b7d1928'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.459364 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5b1b4c2b-646d-437f-ba86-a3073237addd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6027f51b4a4b4880b6076cf83b7d1928'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.470509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1388/2753] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:34:30 2022] DELETE /identity/v3/users/6027f51b4a4b4880b6076cf83b7d1928 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:30.779507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:30.781697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:30.801788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d66a48-5aa1-43b4-9835-b4b50e519511 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:30.851557 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:30.881903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569fe90-7415-4024-a66c-ce98586299e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:30.883360 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569fe90-7415-4024-a66c-ce98586299e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:30.883642 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569fe90-7415-4024-a66c-ce98586299e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:30.883919 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569fe90-7415-4024-a66c-ce98586299e6 admin admin] PATH_INFO: `/v3/projects/1001675f8f324872a3bcd64cdce18c6b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:30.885223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569fe90-7415-4024-a66c-ce98586299e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1001675f8f324872a3bcd64cdce18c6b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:30.887230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569fe90-7415-4024-a66c-ce98586299e6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:30.940002 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7569fe90-7415-4024-a66c-ce98586299e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1001675f8f324872a3bcd64cdce18c6b', 'request_id': 'req-7569fe90-7415-4024-a66c-ce98586299e6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.949310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7569fe90-7415-4024-a66c-ce98586299e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1001675f8f324872a3bcd64cdce18c6b', 'request_id': 'req-7569fe90-7415-4024-a66c-ce98586299e6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.956225 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7569fe90-7415-4024-a66c-ce98586299e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1001675f8f324872a3bcd64cdce18c6b', 'request_id': 'req-7569fe90-7415-4024-a66c-ce98586299e6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.969532 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7569fe90-7415-4024-a66c-ce98586299e6 admin admin] The token cache is being invalidate because project 1001675f8f324872a3bcd64cdce18c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:34:30.969807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7569fe90-7415-4024-a66c-ce98586299e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.970722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7569fe90-7415-4024-a66c-ce98586299e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:30.972528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1366/2754] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:34:30 2022] DELETE /identity/v3/projects/1001675f8f324872a3bcd64cdce18c6b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:30.980714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdb75a-610e-474a-81bb-964298f9a1d6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:30.981010 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdb75a-610e-474a-81bb-964298f9a1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:30.981366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdb75a-610e-474a-81bb-964298f9a1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:31.000536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a6fdb75a-610e-474a-81bb-964298f9a1d6 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:31.001836 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a6fdb75a-610e-474a-81bb-964298f9a1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:31.087919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1389/2755] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:34:31.093356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58508d-f18c-4c56-a74d-1c2640173693 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:31.093767 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58508d-f18c-4c56-a74d-1c2640173693 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:31.094158 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58508d-f18c-4c56-a74d-1c2640173693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:31.113684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-af58508d-f18c-4c56-a74d-1c2640173693 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:31.114925 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-af58508d-f18c-4c56-a74d-1c2640173693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:31.123081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1367/2756] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:31.127449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdb75a-610e-474a-81bb-964298f9a1d6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:31.146805 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdb75a-610e-474a-81bb-964298f9a1d6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:31.153315 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55fe7-9132-46c7-97ef-dccd3cf7b00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:31.154697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55fe7-9132-46c7-97ef-dccd3cf7b00d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:31.154697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55fe7-9132-46c7-97ef-dccd3cf7b00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:31.154945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55fe7-9132-46c7-97ef-dccd3cf7b00d admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:31.155559 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55fe7-9132-46c7-97ef-dccd3cf7b00d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:34:31.155876 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55fe7-9132-46c7-97ef-dccd3cf7b00d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:31.157566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55fe7-9132-46c7-97ef-dccd3cf7b00d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:31.170044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1390/2757] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:34:31.174643 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58508d-f18c-4c56-a74d-1c2640173693 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:31.184343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58508d-f18c-4c56-a74d-1c2640173693 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:31.189368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1994c1-dc35-4976-a1ff-03f8c1d77bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:31.190105 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1994c1-dc35-4976-a1ff-03f8c1d77bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:31.190319 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1994c1-dc35-4976-a1ff-03f8c1d77bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:31.190598 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1994c1-dc35-4976-a1ff-03f8c1d77bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:31.191288 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1994c1-dc35-4976-a1ff-03f8c1d77bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:31.193267 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1994c1-dc35-4976-a1ff-03f8c1d77bd8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:31.223293 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1368/2758] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:34:31 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:34:31.227778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55fe7-9132-46c7-97ef-dccd3cf7b00d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:31.238917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55fe7-9132-46c7-97ef-dccd3cf7b00d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:31.323666 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b5dfe-e01b-4673-913f-e5ff147acf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:31.324369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b5dfe-e01b-4673-913f-e5ff147acf46 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:31.324671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b5dfe-e01b-4673-913f-e5ff147acf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:31.324928 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b5dfe-e01b-4673-913f-e5ff147acf46 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:31.325687 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b5dfe-e01b-4673-913f-e5ff147acf46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:31.327880 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b5dfe-e01b-4673-913f-e5ff147acf46 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:31.354252 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1391/2759] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:34:31 2022] POST /identity/v3/users => generated 286 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:34:31.359092 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1994c1-dc35-4976-a1ff-03f8c1d77bd8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:31.376861 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1994c1-dc35-4976-a1ff-03f8c1d77bd8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:31.382760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5301798-8bac-4abf-9021-60dcdca7d5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:31.384047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5301798-8bac-4abf-9021-60dcdca7d5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:31.384381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5301798-8bac-4abf-9021-60dcdca7d5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:31.384984 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5301798-8bac-4abf-9021-60dcdca7d5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:31.385872 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5301798-8bac-4abf-9021-60dcdca7d5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:31.388096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5301798-8bac-4abf-9021-60dcdca7d5f6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:31.400284 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1369/2760] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:34:31.404702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b5dfe-e01b-4673-913f-e5ff147acf46 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:31.418497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b5dfe-e01b-4673-913f-e5ff147acf46 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:31.423787 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a5d83-e10a-48f3-9de9-c8ddc64d2040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:31.424469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a5d83-e10a-48f3-9de9-c8ddc64d2040 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:31.424756 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a5d83-e10a-48f3-9de9-c8ddc64d2040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:31.425037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a5d83-e10a-48f3-9de9-c8ddc64d2040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:31.425831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a5d83-e10a-48f3-9de9-c8ddc64d2040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:31.428158 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a5d83-e10a-48f3-9de9-c8ddc64d2040 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:31.444856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1392/2761] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:34:31.449826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5301798-8bac-4abf-9021-60dcdca7d5f6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:31.461449 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5301798-8bac-4abf-9021-60dcdca7d5f6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:31.467639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbbc92-46ec-4d56-bbab-b2b5dde159c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:31.468548 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbbc92-46ec-4d56-bbab-b2b5dde159c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:31.468838 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbbc92-46ec-4d56-bbab-b2b5dde159c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:31.469160 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbbc92-46ec-4d56-bbab-b2b5dde159c3 admin admin] PATH_INFO: `/v3/projects/726454cdec19405bad96fd7647d5255f/users/02d6fb20f48441a180ab538117f39de4/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:31.490734 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbbc92-46ec-4d56-bbab-b2b5dde159c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726454cdec19405bad96fd7647d5255f, user_id=02d6fb20f48441a180ab538117f39de4, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:31.493541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbbc92-46ec-4d56-bbab-b2b5dde159c3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:31.508799 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1370/2762] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:31 2022] PUT /identity/v3/projects/726454cdec19405bad96fd7647d5255f/users/02d6fb20f48441a180ab538117f39de4/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:31.528280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c403d-fc38-4e1a-8959-fe99e019091a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:31.528824 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c403d-fc38-4e1a-8959-fe99e019091a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:31.529376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c403d-fc38-4e1a-8959-fe99e019091a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:31.567779 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-031c403d-fc38-4e1a-8959-fe99e019091a None None] MFA Rules not processed for user `02d6fb20f48441a180ab538117f39de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:31.570111 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-031c403d-fc38-4e1a-8959-fe99e019091a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:31.600570 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:31.676150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1393/2763] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:31.681344 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbbc92-46ec-4d56-bbab-b2b5dde159c3 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:31.758278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbbc92-46ec-4d56-bbab-b2b5dde159c3 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:31.762934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c51a9a-83bd-47b0-9cca-82e76ccd3ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:31.763609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c51a9a-83bd-47b0-9cca-82e76ccd3ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:31.763899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c51a9a-83bd-47b0-9cca-82e76ccd3ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:31.764187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c51a9a-83bd-47b0-9cca-82e76ccd3ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:31.764903 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c51a9a-83bd-47b0-9cca-82e76ccd3ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:31.767175 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c51a9a-83bd-47b0-9cca-82e76ccd3ca6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:31.779563 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:31.807400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1371/2764] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:34:31 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:34:31.812804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c403d-fc38-4e1a-8959-fe99e019091a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:31.827151 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c403d-fc38-4e1a-8959-fe99e019091a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:31.899078 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa379c-2226-42cd-8e19-1ed37c7e7cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:31.899914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa379c-2226-42cd-8e19-1ed37c7e7cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:31.900208 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa379c-2226-42cd-8e19-1ed37c7e7cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:31.900493 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa379c-2226-42cd-8e19-1ed37c7e7cbc admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:31.901276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa379c-2226-42cd-8e19-1ed37c7e7cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:31.903453 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa379c-2226-42cd-8e19-1ed37c7e7cbc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:31.926714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1394/2765] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:34:31 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:34:31.931364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c51a9a-83bd-47b0-9cca-82e76ccd3ca6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:31.943884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c51a9a-83bd-47b0-9cca-82e76ccd3ca6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:31.948685 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58010b-e09f-4e38-982e-657563d285cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:31.949409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58010b-e09f-4e38-982e-657563d285cc admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:31.949704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58010b-e09f-4e38-982e-657563d285cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:31.949990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58010b-e09f-4e38-982e-657563d285cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:31.950846 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58010b-e09f-4e38-982e-657563d285cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:31.952516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58010b-e09f-4e38-982e-657563d285cc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:31.964605 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1372/2766] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:34:31.975523 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa379c-2226-42cd-8e19-1ed37c7e7cbc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:31.987042 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa379c-2226-42cd-8e19-1ed37c7e7cbc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:31.994598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdd8b5-9db8-432e-a452-2760430d1248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:31.995813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdd8b5-9db8-432e-a452-2760430d1248 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:31.996778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdd8b5-9db8-432e-a452-2760430d1248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:31.996778 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdd8b5-9db8-432e-a452-2760430d1248 admin admin] PATH_INFO: `/v3/projects/a63d0092cdae4e82a60469649b2a4165/users/09730808e09d428c860a9221f857ff82/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:32.013486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdd8b5-9db8-432e-a452-2760430d1248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63d0092cdae4e82a60469649b2a4165, user_id=09730808e09d428c860a9221f857ff82, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:32.016375 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdd8b5-9db8-432e-a452-2760430d1248 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:32.030230 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1395/2767] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:31 2022] PUT /identity/v3/projects/a63d0092cdae4e82a60469649b2a4165/users/09730808e09d428c860a9221f857ff82/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:32.034684 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58010b-e09f-4e38-982e-657563d285cc admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:32.046334 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58010b-e09f-4e38-982e-657563d285cc admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:32.122623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab3521-28a2-4d46-9f1e-655e95d6fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:32.123412 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab3521-28a2-4d46-9f1e-655e95d6fd05 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:32.123698 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab3521-28a2-4d46-9f1e-655e95d6fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:32.123990 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab3521-28a2-4d46-9f1e-655e95d6fd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:32.124856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab3521-28a2-4d46-9f1e-655e95d6fd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:32.126708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab3521-28a2-4d46-9f1e-655e95d6fd05 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:32.138716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1373/2768] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:34:32.143318 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdd8b5-9db8-432e-a452-2760430d1248 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:32.154483 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdd8b5-9db8-432e-a452-2760430d1248 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:32.159484 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce10644-820b-49c4-96d5-038e42aebed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:32.160380 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce10644-820b-49c4-96d5-038e42aebed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:32.160671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce10644-820b-49c4-96d5-038e42aebed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:32.160949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce10644-820b-49c4-96d5-038e42aebed3 admin admin] PATH_INFO: `/v3/projects/a63d0092cdae4e82a60469649b2a4165/users/09730808e09d428c860a9221f857ff82/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:32.163070 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce10644-820b-49c4-96d5-038e42aebed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63d0092cdae4e82a60469649b2a4165, user_id=09730808e09d428c860a9221f857ff82, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:32.170276 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce10644-820b-49c4-96d5-038e42aebed3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:32.184520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1396/2769] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:32 2022] PUT /identity/v3/projects/a63d0092cdae4e82a60469649b2a4165/users/09730808e09d428c860a9221f857ff82/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:32.196513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936e2b6-b271-403f-a12d-5e2bd1e3e8db None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:32.196807 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936e2b6-b271-403f-a12d-5e2bd1e3e8db None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:32.197146 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936e2b6-b271-403f-a12d-5e2bd1e3e8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:32.227283 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2936e2b6-b271-403f-a12d-5e2bd1e3e8db None None] MFA Rules not processed for user `09730808e09d428c860a9221f857ff82`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:32.228535 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2936e2b6-b271-403f-a12d-5e2bd1e3e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:32.302778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1374/2770] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:32.313577 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce10644-820b-49c4-96d5-038e42aebed3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:32.315365 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1ce10644-820b-49c4-96d5-038e42aebed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:32.375117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce10644-820b-49c4-96d5-038e42aebed3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:32.384897 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dbece-ff4a-4c63-9fd7-82b19ca2cb1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:32.385643 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dbece-ff4a-4c63-9fd7-82b19ca2cb1f service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:32.385938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dbece-ff4a-4c63-9fd7-82b19ca2cb1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:32.386229 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dbece-ff4a-4c63-9fd7-82b19ca2cb1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:32.418758 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:32.450255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dbece-ff4a-4c63-9fd7-82b19ca2cb1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:32.451746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dbece-ff4a-4c63-9fd7-82b19ca2cb1f service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:32.464938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1397/2771] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:35.090769 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936e2b6-b271-403f-a12d-5e2bd1e3e8db None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:35.165235 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936e2b6-b271-403f-a12d-5e2bd1e3e8db None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:35.173665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:35.174760 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:35.175208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:35.175751 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] PATH_INFO: `/v3/users/02d6fb20f48441a180ab538117f39de4` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:35.177531 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d6fb20f48441a180ab538117f39de4)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:35.185690 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:35.190438 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:35.255876 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d6fb20f48441a180ab538117f39de4'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:35.278163 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d6fb20f48441a180ab538117f39de4'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:35.289607 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d6fb20f48441a180ab538117f39de4'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:35.300348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d6fb20f48441a180ab538117f39de4'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:35.301321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d6fb20f48441a180ab538117f39de4'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:35.312138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1375/2772] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:34:35 2022] DELETE /identity/v3/users/02d6fb20f48441a180ab538117f39de4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:35.318790 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cce4c-fa7d-4e7e-988a-20476148eff2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:35.319527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cce4c-fa7d-4e7e-988a-20476148eff2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:35.319527 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cce4c-fa7d-4e7e-988a-20476148eff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:35.349469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-517cce4c-fa7d-4e7e-988a-20476148eff2 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:35.350886 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-517cce4c-fa7d-4e7e-988a-20476148eff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:35.434153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1398/2773] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:35.445380 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:35.447928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:35.536939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5456c-b65c-4d90-80c5-d33faf798ead admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:35.543201 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b7786-7d74-437a-88f3-17c25e8bd310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:35.544070 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b7786-7d74-437a-88f3-17c25e8bd310 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:35.544337 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b7786-7d74-437a-88f3-17c25e8bd310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:35.544622 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b7786-7d74-437a-88f3-17c25e8bd310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:35.558641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b7786-7d74-437a-88f3-17c25e8bd310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:35.560372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b7786-7d74-437a-88f3-17c25e8bd310 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:35.572853 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1376/2774] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:35.979641 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cce4c-fa7d-4e7e-988a-20476148eff2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:35.981926 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-517cce4c-fa7d-4e7e-988a-20476148eff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:36.003933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cce4c-fa7d-4e7e-988a-20476148eff2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:36.014907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:36.019574 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:36.020072 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:36.022777 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] PATH_INFO: `/v3/projects/726454cdec19405bad96fd7647d5255f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:36.028195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=726454cdec19405bad96fd7647d5255f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:36.030878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:36.111933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726454cdec19405bad96fd7647d5255f', 'request_id': 'req-3829fc6d-f02f-4efd-84ef-70767488d5fa'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.126238 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726454cdec19405bad96fd7647d5255f', 'request_id': 'req-3829fc6d-f02f-4efd-84ef-70767488d5fa'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.137730 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726454cdec19405bad96fd7647d5255f', 'request_id': 'req-3829fc6d-f02f-4efd-84ef-70767488d5fa'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.156574 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] The token cache is being invalidate because project 726454cdec19405bad96fd7647d5255f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:34:36.157594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.158196 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.160909 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1399/2775] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:34:35 2022] DELETE /identity/v3/projects/726454cdec19405bad96fd7647d5255f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:36.169244 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b7786-7d74-437a-88f3-17c25e8bd310 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:36.182079 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b7786-7d74-437a-88f3-17c25e8bd310 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:36.266224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d840253-bfc5-4e10-b1d1-72fc2316d098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:36.267230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d840253-bfc5-4e10-b1d1-72fc2316d098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:36.267584 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d840253-bfc5-4e10-b1d1-72fc2316d098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:36.268050 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d840253-bfc5-4e10-b1d1-72fc2316d098 admin admin] PATH_INFO: `/v3/users/09730808e09d428c860a9221f857ff82` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:36.269606 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d840253-bfc5-4e10-b1d1-72fc2316d098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09730808e09d428c860a9221f857ff82)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:36.272126 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d840253-bfc5-4e10-b1d1-72fc2316d098 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:36.328329 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:36.380762 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8d840253-bfc5-4e10-b1d1-72fc2316d098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09730808e09d428c860a9221f857ff82'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.398633 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8d840253-bfc5-4e10-b1d1-72fc2316d098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09730808e09d428c860a9221f857ff82'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.407845 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8d840253-bfc5-4e10-b1d1-72fc2316d098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09730808e09d428c860a9221f857ff82'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.418083 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8d840253-bfc5-4e10-b1d1-72fc2316d098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09730808e09d428c860a9221f857ff82'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.418750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8d840253-bfc5-4e10-b1d1-72fc2316d098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09730808e09d428c860a9221f857ff82'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.426019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1377/2776] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:34:36 2022] DELETE /identity/v3/users/09730808e09d428c860a9221f857ff82 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:36.767631 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:36.769241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:36.783598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829fc6d-f02f-4efd-84ef-70767488d5fa admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:36.861141 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:36.874495 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b578d5-e9fa-411f-af70-da21eb025698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:36.875763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b578d5-e9fa-411f-af70-da21eb025698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:36.876054 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b578d5-e9fa-411f-af70-da21eb025698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:36.876340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b578d5-e9fa-411f-af70-da21eb025698 admin admin] PATH_INFO: `/v3/projects/a63d0092cdae4e82a60469649b2a4165` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:36.877938 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b578d5-e9fa-411f-af70-da21eb025698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63d0092cdae4e82a60469649b2a4165)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:36.879688 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b578d5-e9fa-411f-af70-da21eb025698 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:36.939932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-48b578d5-e9fa-411f-af70-da21eb025698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63d0092cdae4e82a60469649b2a4165', 'request_id': 'req-48b578d5-e9fa-411f-af70-da21eb025698'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.947818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-48b578d5-e9fa-411f-af70-da21eb025698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63d0092cdae4e82a60469649b2a4165', 'request_id': 'req-48b578d5-e9fa-411f-af70-da21eb025698'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.959060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-48b578d5-e9fa-411f-af70-da21eb025698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63d0092cdae4e82a60469649b2a4165', 'request_id': 'req-48b578d5-e9fa-411f-af70-da21eb025698'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.971898 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-48b578d5-e9fa-411f-af70-da21eb025698 admin admin] The token cache is being invalidate because project a63d0092cdae4e82a60469649b2a4165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:34:36.972175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-48b578d5-e9fa-411f-af70-da21eb025698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.972873 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-48b578d5-e9fa-411f-af70-da21eb025698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:34:36.974478 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1400/2777] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:34:36 2022] DELETE /identity/v3/projects/a63d0092cdae4e82a60469649b2a4165 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:36.980696 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f57f5e-3292-4c33-9f11-fbe0fc500d98 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:36.981056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f57f5e-3292-4c33-9f11-fbe0fc500d98 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:36.981323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f57f5e-3292-4c33-9f11-fbe0fc500d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:37.003472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-90f57f5e-3292-4c33-9f11-fbe0fc500d98 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:37.004747 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-90f57f5e-3292-4c33-9f11-fbe0fc500d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:37.070205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1378/2778] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:37.078556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8458b8d-a303-449a-8da0-202a95e91cad None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:37.078777 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8458b8d-a303-449a-8da0-202a95e91cad None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:37.079047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8458b8d-a303-449a-8da0-202a95e91cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:37.099281 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c8458b8d-a303-449a-8da0-202a95e91cad None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:37.100574 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c8458b8d-a303-449a-8da0-202a95e91cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:37.109507 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1401/2779] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:37.114651 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f57f5e-3292-4c33-9f11-fbe0fc500d98 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:37.127644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f57f5e-3292-4c33-9f11-fbe0fc500d98 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:37.133627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391f19-03ad-413e-889d-3a1c426e4ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:37.134072 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391f19-03ad-413e-889d-3a1c426e4ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:37.134505 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391f19-03ad-413e-889d-3a1c426e4ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:37.134639 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391f19-03ad-413e-889d-3a1c426e4ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:37.135479 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56391f19-03ad-413e-889d-3a1c426e4ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:34:37.135701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56391f19-03ad-413e-889d-3a1c426e4ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:37.137409 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56391f19-03ad-413e-889d-3a1c426e4ca9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:37.152917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1379/2780] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:34:37.157942 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8458b8d-a303-449a-8da0-202a95e91cad None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:37.168477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8458b8d-a303-449a-8da0-202a95e91cad None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:37.173710 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84459d-3ea8-4a40-9ee8-f0afa9ec0359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:37.174448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84459d-3ea8-4a40-9ee8-f0afa9ec0359 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:37.174736 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84459d-3ea8-4a40-9ee8-f0afa9ec0359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:37.175017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84459d-3ea8-4a40-9ee8-f0afa9ec0359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:37.175769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84459d-3ea8-4a40-9ee8-f0afa9ec0359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:37.178109 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84459d-3ea8-4a40-9ee8-f0afa9ec0359 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:37.209569 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1402/2781] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:34:37 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:34:37.215443 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391f19-03ad-413e-889d-3a1c426e4ca9 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:37.232369 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391f19-03ad-413e-889d-3a1c426e4ca9 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:37.299073 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e521e-7fc7-4b72-a46e-a7a7cc016adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:37.299748 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e521e-7fc7-4b72-a46e-a7a7cc016adb admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:37.300070 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e521e-7fc7-4b72-a46e-a7a7cc016adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:37.300351 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e521e-7fc7-4b72-a46e-a7a7cc016adb admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:37.301139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e521e-7fc7-4b72-a46e-a7a7cc016adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:37.303043 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e521e-7fc7-4b72-a46e-a7a7cc016adb admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:37.325190 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1380/2782] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:34:37 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:34:37.329055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84459d-3ea8-4a40-9ee8-f0afa9ec0359 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:37.340639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84459d-3ea8-4a40-9ee8-f0afa9ec0359 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:37.345555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb5aa-7004-4aea-9bfc-ebf185779ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:37.346250 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb5aa-7004-4aea-9bfc-ebf185779ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:37.346510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb5aa-7004-4aea-9bfc-ebf185779ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:37.346789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb5aa-7004-4aea-9bfc-ebf185779ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:37.347780 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fb5aa-7004-4aea-9bfc-ebf185779ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:37.349153 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fb5aa-7004-4aea-9bfc-ebf185779ef9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:37.361837 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1403/2783] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:34:37.364523 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e521e-7fc7-4b72-a46e-a7a7cc016adb admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:37.375349 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e521e-7fc7-4b72-a46e-a7a7cc016adb admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:37.380265 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08d0d7-01e0-4379-a9c4-3d994b422652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:37.380981 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08d0d7-01e0-4379-a9c4-3d994b422652 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:37.381415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08d0d7-01e0-4379-a9c4-3d994b422652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:37.381601 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08d0d7-01e0-4379-a9c4-3d994b422652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:37.384085 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08d0d7-01e0-4379-a9c4-3d994b422652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:37.386474 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08d0d7-01e0-4379-a9c4-3d994b422652 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:37.400844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1381/2784] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:34:37.405275 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb5aa-7004-4aea-9bfc-ebf185779ef9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:37.417387 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb5aa-7004-4aea-9bfc-ebf185779ef9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:37.423104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d9e8f-accb-4b8d-a2a8-1a962c689f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:37.424176 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d9e8f-accb-4b8d-a2a8-1a962c689f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:37.425125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d9e8f-accb-4b8d-a2a8-1a962c689f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:37.425125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d9e8f-accb-4b8d-a2a8-1a962c689f08 admin admin] PATH_INFO: `/v3/projects/8a66da3852e34729a6c8d8a8ce62412d/users/b423151ccbbb4cc2a70100c825fc3a5f/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:37.445894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d9e8f-accb-4b8d-a2a8-1a962c689f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a66da3852e34729a6c8d8a8ce62412d, user_id=b423151ccbbb4cc2a70100c825fc3a5f, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:37.449126 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d9e8f-accb-4b8d-a2a8-1a962c689f08 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:37.473134 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1404/2785] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:34:37 2022] PUT /identity/v3/projects/8a66da3852e34729a6c8d8a8ce62412d/users/b423151ccbbb4cc2a70100c825fc3a5f/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:34:37.480088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae6d21-245f-4470-95ef-a525f4e4762e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:37.480088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae6d21-245f-4470-95ef-a525f4e4762e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:37.480304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae6d21-245f-4470-95ef-a525f4e4762e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:37.501446 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:37.516905 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a2ae6d21-245f-4470-95ef-a525f4e4762e None None] MFA Rules not processed for user `b423151ccbbb4cc2a70100c825fc3a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:37.518507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a2ae6d21-245f-4470-95ef-a525f4e4762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:37.612715 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1382/2786] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:34:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:37.625903 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d9e8f-accb-4b8d-a2a8-1a962c689f08 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:37.628269 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d15d9e8f-accb-4b8d-a2a8-1a962c689f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:37.694156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d9e8f-accb-4b8d-a2a8-1a962c689f08 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:37.698737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a812f5-e223-4f51-9348-f56f84ccb348 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a4ae82b1b4619b90f9ad0f3dea5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:37.699337 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a812f5-e223-4f51-9348-f56f84ccb348 service glance] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:37.699591 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a812f5-e223-4f51-9348-f56f84ccb348 service glance] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:37.700007 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a812f5-e223-4f51-9348-f56f84ccb348 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:37.710117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a812f5-e223-4f51-9348-f56f84ccb348 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:37.711850 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a812f5-e223-4f51-9348-f56f84ccb348 service glance] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:37.722534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1405/2787] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:47.609559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=28 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:47.717974 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:03.010226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae6d21-245f-4470-95ef-a525f4e4762e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:03.078061 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae6d21-245f-4470-95ef-a525f4e4762e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:03.088033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:03.089576 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:03.090072 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:03.090533 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] PATH_INFO: `/v3/users/b423151ccbbb4cc2a70100c825fc3a5f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:03.092473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b423151ccbbb4cc2a70100c825fc3a5f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:03.094507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:03.146082 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b423151ccbbb4cc2a70100c825fc3a5f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:03.159813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b423151ccbbb4cc2a70100c825fc3a5f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:03.167321 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b423151ccbbb4cc2a70100c825fc3a5f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:03.175506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b423151ccbbb4cc2a70100c825fc3a5f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:03.176402 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b423151ccbbb4cc2a70100c825fc3a5f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:03.182450 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1383/2788] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:35:03 2022] DELETE /identity/v3/users/b423151ccbbb4cc2a70100c825fc3a5f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:35:03.188458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfff8e-78f7-430b-b6a7-e0f400ef8b41 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:03.189204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfff8e-78f7-430b-b6a7-e0f400ef8b41 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:03.189488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfff8e-78f7-430b-b6a7-e0f400ef8b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:03.212800 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-97dfff8e-78f7-430b-b6a7-e0f400ef8b41 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:03.214236 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-97dfff8e-78f7-430b-b6a7-e0f400ef8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:03.284884 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1406/2789] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:35:03.295332 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:03.296878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:03.370095 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a804f-000b-482a-a003-cdcb000dc98f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:03.374208 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bb1f1-f1ea-49e1-8eb7-a423e5234dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:03.374891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bb1f1-f1ea-49e1-8eb7-a423e5234dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:03.375181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bb1f1-f1ea-49e1-8eb7-a423e5234dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:03.375463 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bb1f1-f1ea-49e1-8eb7-a423e5234dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:03.387721 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bb1f1-f1ea-49e1-8eb7-a423e5234dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:03.389278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bb1f1-f1ea-49e1-8eb7-a423e5234dc7 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:03.400542 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1384/2790] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:04.034292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfff8e-78f7-430b-b6a7-e0f400ef8b41 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:04.035827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-97dfff8e-78f7-430b-b6a7-e0f400ef8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:04.051340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfff8e-78f7-430b-b6a7-e0f400ef8b41 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:04.058668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:04.060193 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:04.060727 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:04.061313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] PATH_INFO: `/v3/projects/8a66da3852e34729a6c8d8a8ce62412d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:04.064658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a66da3852e34729a6c8d8a8ce62412d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:04.068451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:04.119713 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a66da3852e34729a6c8d8a8ce62412d', 'request_id': 'req-3608858b-e1a4-422a-8e95-231ddf7535ab'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:04.126173 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a66da3852e34729a6c8d8a8ce62412d', 'request_id': 'req-3608858b-e1a4-422a-8e95-231ddf7535ab'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:04.133801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a66da3852e34729a6c8d8a8ce62412d', 'request_id': 'req-3608858b-e1a4-422a-8e95-231ddf7535ab'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:04.144881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] The token cache is being invalidate because project 8a66da3852e34729a6c8d8a8ce62412d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:35:04.145235 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:04.145882 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:04.147980 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1407/2791] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:35:04 2022] DELETE /identity/v3/projects/8a66da3852e34729a6c8d8a8ce62412d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:35:13.395572 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:14.141970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:42.661468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a244a6-3ba9-4967-a4f4-cbebfb9686cf None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:42.662326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a244a6-3ba9-4967-a4f4-cbebfb9686cf None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:42.662326 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a244a6-3ba9-4967-a4f4-cbebfb9686cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:42.695704 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a6a244a6-3ba9-4967-a4f4-cbebfb9686cf None None] MFA Rules not processed for user `2a328efd184f4988bb033c83c3321991`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:42.697342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a6a244a6-3ba9-4967-a4f4-cbebfb9686cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:42.805986 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1385/2792] 10.222.0.64 () {58 vars in 967 bytes} [Fri Jul 15 15:35:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:42.877664 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:42.880534 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:42.998147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608858b-e1a4-422a-8e95-231ddf7535ab admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:43.005520 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6834a-9d53-4b19-be2c-ac9077a37746 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f3a308ee69455287ac460d9ab2aef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:43.007360 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6834a-9d53-4b19-be2c-ac9077a37746 service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:43.007840 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6834a-9d53-4b19-be2c-ac9077a37746 service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:43.008491 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6834a-9d53-4b19-be2c-ac9077a37746 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:43.024369 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6834a-9d53-4b19-be2c-ac9077a37746 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:43.026077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6834a-9d53-4b19-be2c-ac9077a37746 service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:43.042342 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1408/2793] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Jul 15 15:35:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:35:47.118281 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7cceb-a406-4eb9-965a-ea42998d0dd7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:47.119655 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7cceb-a406-4eb9-965a-ea42998d0dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:47.120989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7cceb-a406-4eb9-965a-ea42998d0dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:47.151159 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0de7cceb-a406-4eb9-965a-ea42998d0dd7 None None] MFA Rules not processed for user `2d9b9cce55b7477caea672af0dba0c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:47.152746 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0de7cceb-a406-4eb9-965a-ea42998d0dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:47.250021 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1386/2794] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:35:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:47.949008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6834a-9d53-4b19-be2c-ac9077a37746 service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:47.951094 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-32e6834a-9d53-4b19-be2c-ac9077a37746 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:48.055259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6834a-9d53-4b19-be2c-ac9077a37746 service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:48.062424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ade11d-7190-4790-9e26-eec33576e062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:48.063157 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ade11d-7190-4790-9e26-eec33576e062 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:48.064745 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ade11d-7190-4790-9e26-eec33576e062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:48.065510 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ade11d-7190-4790-9e26-eec33576e062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:48.068901 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-92ade11d-7190-4790-9e26-eec33576e062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:48.087128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ade11d-7190-4790-9e26-eec33576e062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:48.089204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ade11d-7190-4790-9e26-eec33576e062 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:48.102963 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1409/2795] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:48.596468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7cceb-a406-4eb9-965a-ea42998d0dd7 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:48.615230 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7cceb-a406-4eb9-965a-ea42998d0dd7 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:48.620843 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc5e27-c8f3-4113-8b89-d33e584d6f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:48.621574 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc5e27-c8f3-4113-8b89-d33e584d6f15 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:48.622260 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc5e27-c8f3-4113-8b89-d33e584d6f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:48.623187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc5e27-c8f3-4113-8b89-d33e584d6f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:48.627054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-20cc5e27-c8f3-4113-8b89-d33e584d6f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:48.763435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc5e27-c8f3-4113-8b89-d33e584d6f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:48.765287 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc5e27-c8f3-4113-8b89-d33e584d6f15 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:48.783156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1387/2796] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:49.895258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ade11d-7190-4790-9e26-eec33576e062 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:49.911995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ade11d-7190-4790-9e26-eec33576e062 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:49.917443 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25252ea-e16d-46e3-bed1-d68d5c1ae471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:49.918653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25252ea-e16d-46e3-bed1-d68d5c1ae471 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:49.918945 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25252ea-e16d-46e3-bed1-d68d5c1ae471 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:49.919224 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25252ea-e16d-46e3-bed1-d68d5c1ae471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:49.922645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a25252ea-e16d-46e3-bed1-d68d5c1ae471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:49.947373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25252ea-e16d-46e3-bed1-d68d5c1ae471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:49.949741 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25252ea-e16d-46e3-bed1-d68d5c1ae471 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:49.970822 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1410/2797] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:52.483918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc5e27-c8f3-4113-8b89-d33e584d6f15 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:52.486343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-20cc5e27-c8f3-4113-8b89-d33e584d6f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:52.524891 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:52.565700 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc5e27-c8f3-4113-8b89-d33e584d6f15 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:52.570875 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:52.571787 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:52.572081 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:52.572367 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] PATH_INFO: `/v3/users/83e87c8990d446558fb61112cca6a270` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:52.573648 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e87c8990d446558fb61112cca6a270)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:52.575699 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:52.646247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e87c8990d446558fb61112cca6a270'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:52.676420 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e87c8990d446558fb61112cca6a270'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:52.687427 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e87c8990d446558fb61112cca6a270'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:52.700278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e87c8990d446558fb61112cca6a270'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:52.700278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e87c8990d446558fb61112cca6a270'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:52.711372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1388/2798] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:35:52 2022] DELETE /identity/v3/users/83e87c8990d446558fb61112cca6a270 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:35:52.934696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25252ea-e16d-46e3-bed1-d68d5c1ae471 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:52.951093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25252ea-e16d-46e3-bed1-d68d5c1ae471 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:53.039123 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:53.040008 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:53.040290 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:53.040566 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] PATH_INFO: `/v3/projects/97a405e9597a482294be4f39d249cea3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:53.041853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a405e9597a482294be4f39d249cea3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:53.044150 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:53.072911 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:53.101405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a405e9597a482294be4f39d249cea3', 'request_id': 'req-8e71a5a3-959b-4f66-a502-db179cde2a77'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.108716 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a405e9597a482294be4f39d249cea3', 'request_id': 'req-8e71a5a3-959b-4f66-a502-db179cde2a77'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.119146 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a405e9597a482294be4f39d249cea3', 'request_id': 'req-8e71a5a3-959b-4f66-a502-db179cde2a77'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.132408 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] The token cache is being invalidate because project 97a405e9597a482294be4f39d249cea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:35:53.132724 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.133437 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.135009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1411/2799] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:35:52 2022] DELETE /identity/v3/projects/97a405e9597a482294be4f39d249cea3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:35:53.139404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:53.141307 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:53.155960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbd58f-b1f7-42e0-81c6-203eecd84999 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:53.243976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:53.245034 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:53.245583 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:53.245800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] PATH_INFO: `/v3/users/b7f27e4ca98f4b40a44d93175541ab5e` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:53.247020 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f27e4ca98f4b40a44d93175541ab5e)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:53.249285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:53.313433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f27e4ca98f4b40a44d93175541ab5e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.314994 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:53.337814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f27e4ca98f4b40a44d93175541ab5e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.348813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f27e4ca98f4b40a44d93175541ab5e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.358506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f27e4ca98f4b40a44d93175541ab5e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.359072 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f27e4ca98f4b40a44d93175541ab5e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.369713 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1389/2800] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:35:53 2022] DELETE /identity/v3/users/b7f27e4ca98f4b40a44d93175541ab5e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:35:53.636629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:53.638808 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:53.656049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71a5a3-959b-4f66-a502-db179cde2a77 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:53.736168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:53.737037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:53.737347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:53.737620 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] PATH_INFO: `/v3/projects/73696690f34b4a8493a4193cea58dbef` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:53.738860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] RBAC: Authorizing `identity:delete_project(project_id=73696690f34b4a8493a4193cea58dbef)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:53.741456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:53.794123 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73696690f34b4a8493a4193cea58dbef', 'request_id': 'req-0b4e1667-b3ca-4206-be03-e016f9ff60af'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.803452 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73696690f34b4a8493a4193cea58dbef', 'request_id': 'req-0b4e1667-b3ca-4206-be03-e016f9ff60af'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.812268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73696690f34b4a8493a4193cea58dbef', 'request_id': 'req-0b4e1667-b3ca-4206-be03-e016f9ff60af'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.825744 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] The token cache is being invalidate because project 73696690f34b4a8493a4193cea58dbef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:35:53.826040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.826753 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:35:53.828626 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1412/2801] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:35:53 2022] DELETE /identity/v3/projects/73696690f34b4a8493a4193cea58dbef => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:36:03.363097 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:03.821708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:39.419138 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:39.424180 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:39.494155 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f0e12-b270-4ff5-9172-2b43caaa7fdd admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:39.553317 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb4aac-f38e-4459-8ace-3feb7cdadb8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:39.553989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb4aac-f38e-4459-8ace-3feb7cdadb8f service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:39.554312 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb4aac-f38e-4459-8ace-3feb7cdadb8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:39.554597 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb4aac-f38e-4459-8ace-3feb7cdadb8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:39.556442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-53cb4aac-f38e-4459-8ace-3feb7cdadb8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:39.566977 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb4aac-f38e-4459-8ace-3feb7cdadb8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:39.568445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb4aac-f38e-4459-8ace-3feb7cdadb8f service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:39.579184 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1390/2802] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:36:49.573240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=46 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:58.093365 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:58.105241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:58.255656 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e1667-b3ca-4206-be03-e016f9ff60af admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:58.265515 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208aba5a-78dd-4ca8-a237-8a13df465414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b022a37031b940c3bd67861373926e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:58.266742 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208aba5a-78dd-4ca8-a237-8a13df465414 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:58.267212 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208aba5a-78dd-4ca8-a237-8a13df465414 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:58.267653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208aba5a-78dd-4ca8-a237-8a13df465414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:58.270545 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-208aba5a-78dd-4ca8-a237-8a13df465414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:58.290424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208aba5a-78dd-4ca8-a237-8a13df465414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:58.292309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208aba5a-78dd-4ca8-a237-8a13df465414 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:58.306658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1413/2803] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:07.539877 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb4aac-f38e-4459-8ace-3feb7cdadb8f service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:07.541942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-53cb4aac-f38e-4459-8ace-3feb7cdadb8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:07.631615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb4aac-f38e-4459-8ace-3feb7cdadb8f service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:07.637697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4232d73-2ef6-4e9c-8be6-a3fb9aedf876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:07.638785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232d73-2ef6-4e9c-8be6-a3fb9aedf876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:07.639084 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232d73-2ef6-4e9c-8be6-a3fb9aedf876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:07.639513 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232d73-2ef6-4e9c-8be6-a3fb9aedf876 admin admin] PATH_INFO: `/v3/users/2d9b9cce55b7477caea672af0dba0c8f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:07.641783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4232d73-2ef6-4e9c-8be6-a3fb9aedf876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9b9cce55b7477caea672af0dba0c8f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:07.643859 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4232d73-2ef6-4e9c-8be6-a3fb9aedf876 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:07.701428 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4232d73-2ef6-4e9c-8be6-a3fb9aedf876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9b9cce55b7477caea672af0dba0c8f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:07.717674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4232d73-2ef6-4e9c-8be6-a3fb9aedf876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9b9cce55b7477caea672af0dba0c8f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:07.726516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4232d73-2ef6-4e9c-8be6-a3fb9aedf876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9b9cce55b7477caea672af0dba0c8f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:07.734823 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4232d73-2ef6-4e9c-8be6-a3fb9aedf876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9b9cce55b7477caea672af0dba0c8f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:07.735470 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4232d73-2ef6-4e9c-8be6-a3fb9aedf876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9b9cce55b7477caea672af0dba0c8f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:07.748555 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1391/2804] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:37:07 2022] DELETE /identity/v3/users/2d9b9cce55b7477caea672af0dba0c8f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:37:07.972058 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208aba5a-78dd-4ca8-a237-8a13df465414 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:07.987774 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208aba5a-78dd-4ca8-a237-8a13df465414 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:08.076812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd52d6-a620-4922-9134-6a6ef5bfe833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:08.078106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd52d6-a620-4922-9134-6a6ef5bfe833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:08.078106 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd52d6-a620-4922-9134-6a6ef5bfe833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:08.078477 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd52d6-a620-4922-9134-6a6ef5bfe833 admin admin] PATH_INFO: `/v3/projects/d1e6108403f44e91b1b570037abae511` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:08.080357 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd52d6-a620-4922-9134-6a6ef5bfe833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e6108403f44e91b1b570037abae511)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:08.082651 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd52d6-a620-4922-9134-6a6ef5bfe833 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:08.142359 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-77fd52d6-a620-4922-9134-6a6ef5bfe833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e6108403f44e91b1b570037abae511', 'request_id': 'req-77fd52d6-a620-4922-9134-6a6ef5bfe833'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:08.151349 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-77fd52d6-a620-4922-9134-6a6ef5bfe833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e6108403f44e91b1b570037abae511', 'request_id': 'req-77fd52d6-a620-4922-9134-6a6ef5bfe833'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:08.162164 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-77fd52d6-a620-4922-9134-6a6ef5bfe833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e6108403f44e91b1b570037abae511', 'request_id': 'req-77fd52d6-a620-4922-9134-6a6ef5bfe833'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:08.179924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-77fd52d6-a620-4922-9134-6a6ef5bfe833 admin admin] The token cache is being invalidate because project d1e6108403f44e91b1b570037abae511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:37:08.180391 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-77fd52d6-a620-4922-9134-6a6ef5bfe833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:08.181457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-77fd52d6-a620-4922-9134-6a6ef5bfe833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:08.183989 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1414/2805] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:37:07 2022] DELETE /identity/v3/projects/d1e6108403f44e91b1b570037abae511 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:08.191486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe09144-dd0d-40c8-b6d8-d397a725df8b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:08.191829 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe09144-dd0d-40c8-b6d8-d397a725df8b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:08.192656 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe09144-dd0d-40c8-b6d8-d397a725df8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:08.216532 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-fbe09144-dd0d-40c8-b6d8-d397a725df8b None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:08.217737 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fbe09144-dd0d-40c8-b6d8-d397a725df8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:08.456146 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1392/2806] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:08.466633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa820a-0aea-4f1f-b0ef-674d8b524148 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:08.466904 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa820a-0aea-4f1f-b0ef-674d8b524148 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:08.467347 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa820a-0aea-4f1f-b0ef-674d8b524148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:08.495338 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-29fa820a-0aea-4f1f-b0ef-674d8b524148 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:08.497195 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-29fa820a-0aea-4f1f-b0ef-674d8b524148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:08.507709 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1415/2807] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:08.512608 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe09144-dd0d-40c8-b6d8-d397a725df8b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:08.524348 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe09144-dd0d-40c8-b6d8-d397a725df8b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:08.529413 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af7d1a-6a69-45a2-9a8c-c72fde660f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:08.530093 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af7d1a-6a69-45a2-9a8c-c72fde660f2e admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:08.530377 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af7d1a-6a69-45a2-9a8c-c72fde660f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:08.530658 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af7d1a-6a69-45a2-9a8c-c72fde660f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:08.531625 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af7d1a-6a69-45a2-9a8c-c72fde660f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:37:08.531938 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af7d1a-6a69-45a2-9a8c-c72fde660f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:08.533626 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af7d1a-6a69-45a2-9a8c-c72fde660f2e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:08.548226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1393/2808] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:37:08.552981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa820a-0aea-4f1f-b0ef-674d8b524148 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:08.563653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa820a-0aea-4f1f-b0ef-674d8b524148 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:08.570560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d056065-35df-40be-b2d1-c61bd5bb7283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:08.571245 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d056065-35df-40be-b2d1-c61bd5bb7283 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:08.571543 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d056065-35df-40be-b2d1-c61bd5bb7283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:08.571856 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d056065-35df-40be-b2d1-c61bd5bb7283 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:08.572558 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d056065-35df-40be-b2d1-c61bd5bb7283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:08.575181 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d056065-35df-40be-b2d1-c61bd5bb7283 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:08.581128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:08.634720 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1416/2809] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:37:08 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:08.638997 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af7d1a-6a69-45a2-9a8c-c72fde660f2e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:08.651554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af7d1a-6a69-45a2-9a8c-c72fde660f2e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:08.655899 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:08.738866 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2690-caf5-4103-b251-3530510716d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:08.740191 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2690-caf5-4103-b251-3530510716d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:08.740646 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2690-caf5-4103-b251-3530510716d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:08.741181 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2690-caf5-4103-b251-3530510716d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:08.742404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da2690-caf5-4103-b251-3530510716d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:08.745988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da2690-caf5-4103-b251-3530510716d7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:08.779054 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1394/2810] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:37:08 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:37:08.781503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d056065-35df-40be-b2d1-c61bd5bb7283 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:08.799695 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d056065-35df-40be-b2d1-c61bd5bb7283 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:08.806317 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295f7c4-1692-41b7-9bcf-4599cf620265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:08.807430 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f7c4-1692-41b7-9bcf-4599cf620265 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:08.807732 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f7c4-1692-41b7-9bcf-4599cf620265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:08.808107 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f7c4-1692-41b7-9bcf-4599cf620265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:08.808963 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295f7c4-1692-41b7-9bcf-4599cf620265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:08.810677 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295f7c4-1692-41b7-9bcf-4599cf620265 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:08.823211 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1417/2811] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:08.827833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2690-caf5-4103-b251-3530510716d7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:08.840310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2690-caf5-4103-b251-3530510716d7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:08.846569 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c845a-a7f0-44bd-bd8b-4c9c764a3692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:08.847285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c845a-a7f0-44bd-bd8b-4c9c764a3692 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:08.847570 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c845a-a7f0-44bd-bd8b-4c9c764a3692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:08.847848 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c845a-a7f0-44bd-bd8b-4c9c764a3692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:08.849355 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c845a-a7f0-44bd-bd8b-4c9c764a3692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:08.850992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c845a-a7f0-44bd-bd8b-4c9c764a3692 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:08.862389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1395/2812] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:08.867020 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295f7c4-1692-41b7-9bcf-4599cf620265 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:08.877471 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295f7c4-1692-41b7-9bcf-4599cf620265 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:08.882489 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0561f-4bb9-4779-8d9d-060307078a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:08.883468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0561f-4bb9-4779-8d9d-060307078a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:08.883755 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0561f-4bb9-4779-8d9d-060307078a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:08.884267 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0561f-4bb9-4779-8d9d-060307078a14 admin admin] PATH_INFO: `/v3/projects/268fd42ae64443b3a007e72fa2afc68a/users/55d616620f074571be6a70755c2024c5/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:08.902694 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0561f-4bb9-4779-8d9d-060307078a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=268fd42ae64443b3a007e72fa2afc68a, user_id=55d616620f074571be6a70755c2024c5, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:08.905424 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0561f-4bb9-4779-8d9d-060307078a14 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:08.920690 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1418/2813] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:37:08 2022] PUT /identity/v3/projects/268fd42ae64443b3a007e72fa2afc68a/users/55d616620f074571be6a70755c2024c5/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:08.931738 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44bd89-b18f-43fc-b7dd-45a9204aeab2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:08.932145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44bd89-b18f-43fc-b7dd-45a9204aeab2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:08.932475 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44bd89-b18f-43fc-b7dd-45a9204aeab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:08.970299 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ba44bd89-b18f-43fc-b7dd-45a9204aeab2 None None] MFA Rules not processed for user `55d616620f074571be6a70755c2024c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:08.971570 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ba44bd89-b18f-43fc-b7dd-45a9204aeab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:09.077983 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1396/2814] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:09.091548 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0561f-4bb9-4779-8d9d-060307078a14 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:09.094221 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-36b0561f-4bb9-4779-8d9d-060307078a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:09.183949 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0561f-4bb9-4779-8d9d-060307078a14 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:09.191392 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babbabe-11d3-41bb-8d7f-b66ffa717f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:09.194374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babbabe-11d3-41bb-8d7f-b66ffa717f23 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:09.194932 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babbabe-11d3-41bb-8d7f-b66ffa717f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:09.195461 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babbabe-11d3-41bb-8d7f-b66ffa717f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:09.209403 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babbabe-11d3-41bb-8d7f-b66ffa717f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:09.210995 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babbabe-11d3-41bb-8d7f-b66ffa717f23 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:09.221017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1419/2815] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:17.911958 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44bd89-b18f-43fc-b7dd-45a9204aeab2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:17.978117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44bd89-b18f-43fc-b7dd-45a9204aeab2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:17.985169 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:17.986430 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:17.986831 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:17.987226 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] PATH_INFO: `/v3/users/55d616620f074571be6a70755c2024c5` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:17.990133 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d616620f074571be6a70755c2024c5)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:17.993389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:18.010457 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:18.058904 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d616620f074571be6a70755c2024c5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:18.076202 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d616620f074571be6a70755c2024c5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:18.084667 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d616620f074571be6a70755c2024c5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:18.094687 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d616620f074571be6a70755c2024c5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:18.095638 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d616620f074571be6a70755c2024c5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:18.103942 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1397/2816] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:37:17 2022] DELETE /identity/v3/users/55d616620f074571be6a70755c2024c5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:18.109464 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d67c56-bfdd-4222-9850-39b7d0fd5cde None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:18.110001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d67c56-bfdd-4222-9850-39b7d0fd5cde None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:18.110117 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d67c56-bfdd-4222-9850-39b7d0fd5cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:18.131232 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-28d67c56-bfdd-4222-9850-39b7d0fd5cde None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:18.132535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-28d67c56-bfdd-4222-9850-39b7d0fd5cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:18.195702 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1420/2817] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:18.208435 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:18.211504 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:18.293026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80359f4e-74d4-4bfc-acf4-4d3a6193d696 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:18.297445 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ced433-7d91-49f5-8a08-f4a2323a98e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:18.298123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ced433-7d91-49f5-8a08-f4a2323a98e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:18.298397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ced433-7d91-49f5-8a08-f4a2323a98e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:18.298678 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ced433-7d91-49f5-8a08-f4a2323a98e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:18.309539 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ced433-7d91-49f5-8a08-f4a2323a98e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:18.311647 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ced433-7d91-49f5-8a08-f4a2323a98e8 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:18.322743 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1398/2818] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:18.682314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d67c56-bfdd-4222-9850-39b7d0fd5cde None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:18.684452 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-28d67c56-bfdd-4222-9850-39b7d0fd5cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:18.699297 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d67c56-bfdd-4222-9850-39b7d0fd5cde None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:18.704994 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbd430-ef01-499d-aad4-ce183756d91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:18.706655 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbd430-ef01-499d-aad4-ce183756d91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:18.706921 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbd430-ef01-499d-aad4-ce183756d91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:18.708129 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbd430-ef01-499d-aad4-ce183756d91d admin admin] PATH_INFO: `/v3/projects/268fd42ae64443b3a007e72fa2afc68a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:18.709718 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbd430-ef01-499d-aad4-ce183756d91d admin admin] RBAC: Authorizing `identity:delete_project(project_id=268fd42ae64443b3a007e72fa2afc68a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:18.712448 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbd430-ef01-499d-aad4-ce183756d91d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:18.789921 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:18.798881 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4dfbd430-ef01-499d-aad4-ce183756d91d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '268fd42ae64443b3a007e72fa2afc68a', 'request_id': 'req-4dfbd430-ef01-499d-aad4-ce183756d91d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:18.812360 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4dfbd430-ef01-499d-aad4-ce183756d91d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '268fd42ae64443b3a007e72fa2afc68a', 'request_id': 'req-4dfbd430-ef01-499d-aad4-ce183756d91d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:18.827555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4dfbd430-ef01-499d-aad4-ce183756d91d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '268fd42ae64443b3a007e72fa2afc68a', 'request_id': 'req-4dfbd430-ef01-499d-aad4-ce183756d91d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:18.840773 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4dfbd430-ef01-499d-aad4-ce183756d91d admin admin] The token cache is being invalidate because project 268fd42ae64443b3a007e72fa2afc68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:37:18.841123 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4dfbd430-ef01-499d-aad4-ce183756d91d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:18.841947 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4dfbd430-ef01-499d-aad4-ce183756d91d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:18.843927 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1421/2819] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:37:18 2022] DELETE /identity/v3/projects/268fd42ae64443b3a007e72fa2afc68a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:18.848719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e953-9cd3-499b-97cf-95fbaf309979 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:18.849009 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e953-9cd3-499b-97cf-95fbaf309979 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:18.849323 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e953-9cd3-499b-97cf-95fbaf309979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:18.868723 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9d33e953-9cd3-499b-97cf-95fbaf309979 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:18.870071 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9d33e953-9cd3-499b-97cf-95fbaf309979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:18.947570 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1399/2820] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:18.959917 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbafe2-894a-449f-bbca-39785af5cfa8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:18.960346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbafe2-894a-449f-bbca-39785af5cfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:18.960463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbafe2-894a-449f-bbca-39785af5cfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:18.981878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3ecbafe2-894a-449f-bbca-39785af5cfa8 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:18.983133 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3ecbafe2-894a-449f-bbca-39785af5cfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:18.993456 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1422/2821] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:18.998255 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33e953-9cd3-499b-97cf-95fbaf309979 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:19.010086 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33e953-9cd3-499b-97cf-95fbaf309979 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:19.017967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2c737-8132-4aac-bda7-d56710f9226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:19.018660 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2c737-8132-4aac-bda7-d56710f9226c admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.018955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2c737-8132-4aac-bda7-d56710f9226c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.019227 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2c737-8132-4aac-bda7-d56710f9226c admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.020592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2c737-8132-4aac-bda7-d56710f9226c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:37:19.020961 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2c737-8132-4aac-bda7-d56710f9226c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:19.022719 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2c737-8132-4aac-bda7-d56710f9226c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:19.057309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1400/2822] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:37:19.062696 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbafe2-894a-449f-bbca-39785af5cfa8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:19.073645 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbafe2-894a-449f-bbca-39785af5cfa8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:19.081999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f5dfa-f5c5-4df8-b77e-454a6356ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:19.083503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f5dfa-f5c5-4df8-b77e-454a6356ebde admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.083964 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f5dfa-f5c5-4df8-b77e-454a6356ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.084442 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f5dfa-f5c5-4df8-b77e-454a6356ebde admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.085719 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f5dfa-f5c5-4df8-b77e-454a6356ebde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:19.088428 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f5dfa-f5c5-4df8-b77e-454a6356ebde admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:19.120924 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1423/2823] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:37:19 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:37:19.125224 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2c737-8132-4aac-bda7-d56710f9226c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:19.136425 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2c737-8132-4aac-bda7-d56710f9226c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:19.158645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:19.207777 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8312a-ea63-4d36-8582-a2b01522020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:19.208473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8312a-ea63-4d36-8582-a2b01522020f admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.208766 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8312a-ea63-4d36-8582-a2b01522020f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.209040 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8312a-ea63-4d36-8582-a2b01522020f admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.209788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8312a-ea63-4d36-8582-a2b01522020f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:19.211847 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8312a-ea63-4d36-8582-a2b01522020f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:19.233716 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1401/2824] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:37:19 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:19.238249 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f5dfa-f5c5-4df8-b77e-454a6356ebde admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:19.251185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f5dfa-f5c5-4df8-b77e-454a6356ebde admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:19.256956 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa54971-5c2f-4c53-97c3-41c4d54588b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:19.257775 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa54971-5c2f-4c53-97c3-41c4d54588b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.258125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa54971-5c2f-4c53-97c3-41c4d54588b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.258445 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa54971-5c2f-4c53-97c3-41c4d54588b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.259246 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa54971-5c2f-4c53-97c3-41c4d54588b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:19.261047 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa54971-5c2f-4c53-97c3-41c4d54588b7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:19.273352 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1424/2825] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:37:19.277620 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8312a-ea63-4d36-8582-a2b01522020f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:19.288353 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8312a-ea63-4d36-8582-a2b01522020f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:19.293404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3e966-e43f-410b-8146-684a5574d69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:19.293999 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3e966-e43f-410b-8146-684a5574d69e admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.294285 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3e966-e43f-410b-8146-684a5574d69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.294565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3e966-e43f-410b-8146-684a5574d69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.295308 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3e966-e43f-410b-8146-684a5574d69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:19.297159 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3e966-e43f-410b-8146-684a5574d69e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:19.308406 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1402/2826] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:19.313340 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa54971-5c2f-4c53-97c3-41c4d54588b7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:19.325017 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa54971-5c2f-4c53-97c3-41c4d54588b7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:19.329955 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0a03a-de63-4e13-baf0-9bace37ffb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:19.330880 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0a03a-de63-4e13-baf0-9bace37ffb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.331168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0a03a-de63-4e13-baf0-9bace37ffb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.331451 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0a03a-de63-4e13-baf0-9bace37ffb64 admin admin] PATH_INFO: `/v3/projects/a522be5511434fb3af46f958dbfcd978/users/a3bff119caa0421db28bdce7cac33b63/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.347497 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0a03a-de63-4e13-baf0-9bace37ffb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a522be5511434fb3af46f958dbfcd978, user_id=a3bff119caa0421db28bdce7cac33b63, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:19.350213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0a03a-de63-4e13-baf0-9bace37ffb64 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:19.364890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1425/2827] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:37:19 2022] PUT /identity/v3/projects/a522be5511434fb3af46f958dbfcd978/users/a3bff119caa0421db28bdce7cac33b63/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:19.375560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81923ca-67cb-4ace-b503-8d54713ca8bf None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.375850 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81923ca-67cb-4ace-b503-8d54713ca8bf None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.376136 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81923ca-67cb-4ace-b503-8d54713ca8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.410666 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f81923ca-67cb-4ace-b503-8d54713ca8bf None None] MFA Rules not processed for user `a3bff119caa0421db28bdce7cac33b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:19.412309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f81923ca-67cb-4ace-b503-8d54713ca8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:19.495017 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1403/2828] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:19.501263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0a03a-de63-4e13-baf0-9bace37ffb64 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:19.573086 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0a03a-de63-4e13-baf0-9bace37ffb64 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:19.578206 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6125-5f48-4080-ac8a-6e04afcf4f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:19.578894 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6125-5f48-4080-ac8a-6e04afcf4f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.579187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6125-5f48-4080-ac8a-6e04afcf4f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.579469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6125-5f48-4080-ac8a-6e04afcf4f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.580187 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e6125-5f48-4080-ac8a-6e04afcf4f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:19.582241 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e6125-5f48-4080-ac8a-6e04afcf4f9e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:19.616975 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1426/2829] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:37:19 2022] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:19.621352 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81923ca-67cb-4ace-b503-8d54713ca8bf None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:19.632597 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81923ca-67cb-4ace-b503-8d54713ca8bf None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:19.692381 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acc2eb-4a58-4da2-aebb-907c7643bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:19.693090 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acc2eb-4a58-4da2-aebb-907c7643bc49 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.693382 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acc2eb-4a58-4da2-aebb-907c7643bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.693664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acc2eb-4a58-4da2-aebb-907c7643bc49 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.694363 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03acc2eb-4a58-4da2-aebb-907c7643bc49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:19.696495 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03acc2eb-4a58-4da2-aebb-907c7643bc49 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:19.718139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1404/2830] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:37:19 2022] POST /identity/v3/users => generated 308 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:19.723485 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6125-5f48-4080-ac8a-6e04afcf4f9e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:19.734554 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6125-5f48-4080-ac8a-6e04afcf4f9e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:19.739936 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fa835-a283-408d-a256-2e1fc5bb8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:19.740602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fa835-a283-408d-a256-2e1fc5bb8bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.740890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fa835-a283-408d-a256-2e1fc5bb8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.741304 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fa835-a283-408d-a256-2e1fc5bb8bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.742021 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fa835-a283-408d-a256-2e1fc5bb8bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:19.743639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fa835-a283-408d-a256-2e1fc5bb8bcc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:19.755469 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1427/2831] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:19.759794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acc2eb-4a58-4da2-aebb-907c7643bc49 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:19.770948 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acc2eb-4a58-4da2-aebb-907c7643bc49 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:19.776014 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874de4eb-729a-4215-99a4-c87b03140f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:19.776909 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874de4eb-729a-4215-99a4-c87b03140f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.777250 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874de4eb-729a-4215-99a4-c87b03140f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.777554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874de4eb-729a-4215-99a4-c87b03140f62 admin admin] PATH_INFO: `/v3/projects/d788e3ed19664958beada25deda042b4/users/149ca00a201e484f82a90f0edec77185/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.794130 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874de4eb-729a-4215-99a4-c87b03140f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d788e3ed19664958beada25deda042b4, user_id=149ca00a201e484f82a90f0edec77185, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:19.797008 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874de4eb-729a-4215-99a4-c87b03140f62 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:19.807779 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:19.814434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1405/2832] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:37:19 2022] PUT /identity/v3/projects/d788e3ed19664958beada25deda042b4/users/149ca00a201e484f82a90f0edec77185/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:19.818598 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fa835-a283-408d-a256-2e1fc5bb8bcc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:19.829789 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fa835-a283-408d-a256-2e1fc5bb8bcc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:19.873046 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:19.897211 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283b894-d9c5-40be-b2ef-e9bea5a150a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:19.897887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283b894-d9c5-40be-b2ef-e9bea5a150a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.898175 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283b894-d9c5-40be-b2ef-e9bea5a150a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.898449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283b894-d9c5-40be-b2ef-e9bea5a150a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.899214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283b894-d9c5-40be-b2ef-e9bea5a150a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:19.900835 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283b894-d9c5-40be-b2ef-e9bea5a150a0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:19.912867 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1428/2833] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:19.917142 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874de4eb-729a-4215-99a4-c87b03140f62 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:19.929206 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874de4eb-729a-4215-99a4-c87b03140f62 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:19.934960 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ac904-f4e2-4108-94a6-991d8a57e1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:19.936750 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ac904-f4e2-4108-94a6-991d8a57e1be admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.937038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ac904-f4e2-4108-94a6-991d8a57e1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.937442 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ac904-f4e2-4108-94a6-991d8a57e1be admin admin] PATH_INFO: `/v3/projects/d788e3ed19664958beada25deda042b4/users/149ca00a201e484f82a90f0edec77185/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.940759 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ac904-f4e2-4108-94a6-991d8a57e1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d788e3ed19664958beada25deda042b4, user_id=149ca00a201e484f82a90f0edec77185, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:19.944403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ac904-f4e2-4108-94a6-991d8a57e1be admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:19.956863 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1406/2834] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:37:19 2022] PUT /identity/v3/projects/d788e3ed19664958beada25deda042b4/users/149ca00a201e484f82a90f0edec77185/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:19.968224 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a59fca-1266-4f2c-ba01-648292960243 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:19.968528 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a59fca-1266-4f2c-ba01-648292960243 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:19.968814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a59fca-1266-4f2c-ba01-648292960243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:19.998863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-58a59fca-1266-4f2c-ba01-648292960243 None None] MFA Rules not processed for user `149ca00a201e484f82a90f0edec77185`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:20.000100 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-58a59fca-1266-4f2c-ba01-648292960243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:20.073468 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1429/2835] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:20.084812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ac904-f4e2-4108-94a6-991d8a57e1be admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:20.086680 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-015ac904-f4e2-4108-94a6-991d8a57e1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:20.154171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ac904-f4e2-4108-94a6-991d8a57e1be admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:20.158403 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd54fa9-f2ba-4de1-bbd8-3f3688cac528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:20.159056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd54fa9-f2ba-4de1-bbd8-3f3688cac528 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:20.159335 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd54fa9-f2ba-4de1-bbd8-3f3688cac528 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:20.159609 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd54fa9-f2ba-4de1-bbd8-3f3688cac528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:20.171668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd54fa9-f2ba-4de1-bbd8-3f3688cac528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:20.173156 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd54fa9-f2ba-4de1-bbd8-3f3688cac528 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:20.184140 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1407/2836] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:20.325633 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a59fca-1266-4f2c-ba01-648292960243 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:20.388457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a59fca-1266-4f2c-ba01-648292960243 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:20.393259 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:20.394124 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:20.394404 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:20.395311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] PATH_INFO: `/v3/users/a3bff119caa0421db28bdce7cac33b63` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:20.396671 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3bff119caa0421db28bdce7cac33b63)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:20.398665 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:20.459962 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3bff119caa0421db28bdce7cac33b63'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:20.475255 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:20.476919 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3bff119caa0421db28bdce7cac33b63'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:20.489556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3bff119caa0421db28bdce7cac33b63'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:20.499646 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3bff119caa0421db28bdce7cac33b63'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:20.500372 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3bff119caa0421db28bdce7cac33b63'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:20.507092 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1430/2837] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:37:20 2022] DELETE /identity/v3/users/a3bff119caa0421db28bdce7cac33b63 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:20.516468 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605956d-a0a5-4ccc-97e8-a8b9f3693c66 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:20.517051 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605956d-a0a5-4ccc-97e8-a8b9f3693c66 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:20.517375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605956d-a0a5-4ccc-97e8-a8b9f3693c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:20.534839 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2605956d-a0a5-4ccc-97e8-a8b9f3693c66 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:20.536036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2605956d-a0a5-4ccc-97e8-a8b9f3693c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:20.597815 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1408/2838] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:20.611458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:20.613009 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:20.699337 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afab2a-c964-4396-bef9-9aa9fc7778a6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:20.704104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c01871-914b-4901-bca2-1591919df11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:20.704776 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c01871-914b-4901-bca2-1591919df11e service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:20.705090 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c01871-914b-4901-bca2-1591919df11e service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:20.705382 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c01871-914b-4901-bca2-1591919df11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:20.718049 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c01871-914b-4901-bca2-1591919df11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:20.720216 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c01871-914b-4901-bca2-1591919df11e service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:20.734130 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1431/2839] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:21.035811 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605956d-a0a5-4ccc-97e8-a8b9f3693c66 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:21.037444 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2605956d-a0a5-4ccc-97e8-a8b9f3693c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:21.056796 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605956d-a0a5-4ccc-97e8-a8b9f3693c66 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:21.061476 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:21.062404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:21.062641 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:21.062922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] PATH_INFO: `/v3/projects/a522be5511434fb3af46f958dbfcd978` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:21.064113 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a522be5511434fb3af46f958dbfcd978)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:21.067163 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:21.124615 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a522be5511434fb3af46f958dbfcd978', 'request_id': 'req-4170f73e-c0da-48b4-b5a8-efd1e55cff67'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.134452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a522be5511434fb3af46f958dbfcd978', 'request_id': 'req-4170f73e-c0da-48b4-b5a8-efd1e55cff67'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.141280 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a522be5511434fb3af46f958dbfcd978', 'request_id': 'req-4170f73e-c0da-48b4-b5a8-efd1e55cff67'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.153570 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] The token cache is being invalidate because project a522be5511434fb3af46f958dbfcd978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:37:21.153879 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.154589 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.156276 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1409/2840] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:37:21 2022] DELETE /identity/v3/projects/a522be5511434fb3af46f958dbfcd978 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:37:21.162952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c01871-914b-4901-bca2-1591919df11e service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:21.179220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c01871-914b-4901-bca2-1591919df11e service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:21.247851 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b35da-4b52-4372-b16d-720c2e69cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:21.248809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b35da-4b52-4372-b16d-720c2e69cd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:21.249132 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b35da-4b52-4372-b16d-720c2e69cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:21.249463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b35da-4b52-4372-b16d-720c2e69cd36 admin admin] PATH_INFO: `/v3/users/149ca00a201e484f82a90f0edec77185` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:21.250936 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b35da-4b52-4372-b16d-720c2e69cd36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=149ca00a201e484f82a90f0edec77185)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:21.253552 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b35da-4b52-4372-b16d-720c2e69cd36 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:21.315462 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5b6b35da-4b52-4372-b16d-720c2e69cd36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149ca00a201e484f82a90f0edec77185'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.328697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5b6b35da-4b52-4372-b16d-720c2e69cd36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149ca00a201e484f82a90f0edec77185'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.344406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5b6b35da-4b52-4372-b16d-720c2e69cd36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149ca00a201e484f82a90f0edec77185'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.354625 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5b6b35da-4b52-4372-b16d-720c2e69cd36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149ca00a201e484f82a90f0edec77185'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.355396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5b6b35da-4b52-4372-b16d-720c2e69cd36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149ca00a201e484f82a90f0edec77185'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.361751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1432/2841] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:37:21 2022] DELETE /identity/v3/users/149ca00a201e484f82a90f0edec77185 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:21.698422 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:21.700998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:21.724554 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170f73e-c0da-48b4-b5a8-efd1e55cff67 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:21.738936 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:21.807119 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7b49e-c474-42bb-86d4-e0a652e48cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:21.808001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7b49e-c474-42bb-86d4-e0a652e48cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:21.808289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7b49e-c474-42bb-86d4-e0a652e48cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:21.808566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7b49e-c474-42bb-86d4-e0a652e48cba admin admin] PATH_INFO: `/v3/projects/d788e3ed19664958beada25deda042b4` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:21.809837 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7b49e-c474-42bb-86d4-e0a652e48cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d788e3ed19664958beada25deda042b4)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:21.811782 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7b49e-c474-42bb-86d4-e0a652e48cba admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:21.864612 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e7e7b49e-c474-42bb-86d4-e0a652e48cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd788e3ed19664958beada25deda042b4', 'request_id': 'req-e7e7b49e-c474-42bb-86d4-e0a652e48cba'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.874007 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e7e7b49e-c474-42bb-86d4-e0a652e48cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd788e3ed19664958beada25deda042b4', 'request_id': 'req-e7e7b49e-c474-42bb-86d4-e0a652e48cba'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.881418 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e7e7b49e-c474-42bb-86d4-e0a652e48cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd788e3ed19664958beada25deda042b4', 'request_id': 'req-e7e7b49e-c474-42bb-86d4-e0a652e48cba'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.893116 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e7e7b49e-c474-42bb-86d4-e0a652e48cba admin admin] The token cache is being invalidate because project d788e3ed19664958beada25deda042b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:37:21.893408 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e7e7b49e-c474-42bb-86d4-e0a652e48cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.894059 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e7e7b49e-c474-42bb-86d4-e0a652e48cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:21.896221 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1410/2842] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:37:21 2022] DELETE /identity/v3/projects/d788e3ed19664958beada25deda042b4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:37:21.901400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc3e35-8b3f-4663-82e2-e2ea818486b4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:21.901689 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc3e35-8b3f-4663-82e2-e2ea818486b4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:21.901980 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc3e35-8b3f-4663-82e2-e2ea818486b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:21.909342 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:21.924660 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0fcc3e35-8b3f-4663-82e2-e2ea818486b4 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:21.925962 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0fcc3e35-8b3f-4663-82e2-e2ea818486b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:21.991829 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1433/2843] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:37:22.058592 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b5703-da36-4cd2-91ba-db18b2ebb60a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.059364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b5703-da36-4cd2-91ba-db18b2ebb60a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.059364 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b5703-da36-4cd2-91ba-db18b2ebb60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.086559 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-045b5703-da36-4cd2-91ba-db18b2ebb60a None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:22.088653 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-045b5703-da36-4cd2-91ba-db18b2ebb60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:22.102342 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1411/2844] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:22.107022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc3e35-8b3f-4663-82e2-e2ea818486b4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:22.119820 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc3e35-8b3f-4663-82e2-e2ea818486b4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:22.124889 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5461d3-715d-463c-af54-e20224e32f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:22.125613 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5461d3-715d-463c-af54-e20224e32f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.125905 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5461d3-715d-463c-af54-e20224e32f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.126184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5461d3-715d-463c-af54-e20224e32f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.126929 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5461d3-715d-463c-af54-e20224e32f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:37:22.127243 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5461d3-715d-463c-af54-e20224e32f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:22.129526 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5461d3-715d-463c-af54-e20224e32f94 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:22.144022 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1434/2845] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:37:22.149413 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b5703-da36-4cd2-91ba-db18b2ebb60a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:22.160415 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b5703-da36-4cd2-91ba-db18b2ebb60a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:22.165660 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18838f7-c1f3-408e-9f0d-b2fdcdfe2288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:22.166365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18838f7-c1f3-408e-9f0d-b2fdcdfe2288 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.166652 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18838f7-c1f3-408e-9f0d-b2fdcdfe2288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.166928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18838f7-c1f3-408e-9f0d-b2fdcdfe2288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.167634 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18838f7-c1f3-408e-9f0d-b2fdcdfe2288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:22.169595 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18838f7-c1f3-408e-9f0d-b2fdcdfe2288 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:22.201433 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1412/2846] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:37:22 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:22.206503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5461d3-715d-463c-af54-e20224e32f94 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:22.226663 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5461d3-715d-463c-af54-e20224e32f94 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:22.324024 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f16ea-fbbc-41df-863c-54db29fa8f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:22.324616 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f16ea-fbbc-41df-863c-54db29fa8f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.324902 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f16ea-fbbc-41df-863c-54db29fa8f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.325229 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f16ea-fbbc-41df-863c-54db29fa8f7b admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.325981 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f16ea-fbbc-41df-863c-54db29fa8f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:22.328575 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f16ea-fbbc-41df-863c-54db29fa8f7b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:22.358055 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1435/2847] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:37:22 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:22.364840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18838f7-c1f3-408e-9f0d-b2fdcdfe2288 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:22.389395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18838f7-c1f3-408e-9f0d-b2fdcdfe2288 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:22.394814 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1a68-579d-4370-a7c2-2fc62a92c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:22.395517 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1a68-579d-4370-a7c2-2fc62a92c6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.395806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1a68-579d-4370-a7c2-2fc62a92c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.396091 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1a68-579d-4370-a7c2-2fc62a92c6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.396844 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e1a68-579d-4370-a7c2-2fc62a92c6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:22.399251 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e1a68-579d-4370-a7c2-2fc62a92c6b4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:22.418959 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1413/2848] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:22.425408 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f16ea-fbbc-41df-863c-54db29fa8f7b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:22.444044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f16ea-fbbc-41df-863c-54db29fa8f7b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:22.451568 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d86c0f-f755-438d-8d15-9440f9a0c1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:22.452261 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d86c0f-f755-438d-8d15-9440f9a0c1be admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.452532 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d86c0f-f755-438d-8d15-9440f9a0c1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.452900 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d86c0f-f755-438d-8d15-9440f9a0c1be admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.453818 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d86c0f-f755-438d-8d15-9440f9a0c1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:22.458569 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d86c0f-f755-438d-8d15-9440f9a0c1be admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:22.473486 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1436/2849] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:22.477741 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1a68-579d-4370-a7c2-2fc62a92c6b4 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:22.492330 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1a68-579d-4370-a7c2-2fc62a92c6b4 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:22.499139 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7e81-a8fa-4aa9-92b1-4aaff48a07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:22.500049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7e81-a8fa-4aa9-92b1-4aaff48a07cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.500339 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7e81-a8fa-4aa9-92b1-4aaff48a07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.500630 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7e81-a8fa-4aa9-92b1-4aaff48a07cf admin admin] PATH_INFO: `/v3/projects/611e932d087c4edeb1eeb8afa5f6724b/users/a0923a2e9fba4541a2bbf040ef97199c/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.518466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e7e81-a8fa-4aa9-92b1-4aaff48a07cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=611e932d087c4edeb1eeb8afa5f6724b, user_id=a0923a2e9fba4541a2bbf040ef97199c, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:22.521238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e7e81-a8fa-4aa9-92b1-4aaff48a07cf admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:22.536547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1414/2850] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:37:22 2022] PUT /identity/v3/projects/611e932d087c4edeb1eeb8afa5f6724b/users/a0923a2e9fba4541a2bbf040ef97199c/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:22.546960 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aee9e-da57-4b8e-ae3e-9649889ad15d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.547251 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aee9e-da57-4b8e-ae3e-9649889ad15d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.547553 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aee9e-da57-4b8e-ae3e-9649889ad15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.578970 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-305aee9e-da57-4b8e-ae3e-9649889ad15d None None] MFA Rules not processed for user `a0923a2e9fba4541a2bbf040ef97199c`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:22.580190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-305aee9e-da57-4b8e-ae3e-9649889ad15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:22.661278 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:22.668512 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1437/2851] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:22.673702 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7e81-a8fa-4aa9-92b1-4aaff48a07cf admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:22.719547 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:22.780131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7e81-a8fa-4aa9-92b1-4aaff48a07cf admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:22.784893 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc28a7-d20c-433e-ad6c-937f853c885e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:22.786121 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc28a7-d20c-433e-ad6c-937f853c885e admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.786397 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc28a7-d20c-433e-ad6c-937f853c885e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.786668 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc28a7-d20c-433e-ad6c-937f853c885e admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.787354 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc28a7-d20c-433e-ad6c-937f853c885e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:22.789295 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc28a7-d20c-433e-ad6c-937f853c885e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:22.816451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1415/2852] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:37:22 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:22.820982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305aee9e-da57-4b8e-ae3e-9649889ad15d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:22.832488 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305aee9e-da57-4b8e-ae3e-9649889ad15d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:22.900999 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f69f4a-26a1-4f08-9bbb-7995096964e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:22.901707 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f69f4a-26a1-4f08-9bbb-7995096964e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.901994 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f69f4a-26a1-4f08-9bbb-7995096964e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.902296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f69f4a-26a1-4f08-9bbb-7995096964e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.902992 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f69f4a-26a1-4f08-9bbb-7995096964e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:22.904933 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f69f4a-26a1-4f08-9bbb-7995096964e7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:22.928279 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1438/2853] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:37:22 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:22.933764 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc28a7-d20c-433e-ad6c-937f853c885e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:22.945922 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc28a7-d20c-433e-ad6c-937f853c885e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:22.952347 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2439c18-f52b-4cc8-bee9-2290c9dfa725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:22.953336 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2439c18-f52b-4cc8-bee9-2290c9dfa725 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.953691 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2439c18-f52b-4cc8-bee9-2290c9dfa725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.954128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2439c18-f52b-4cc8-bee9-2290c9dfa725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.955205 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2439c18-f52b-4cc8-bee9-2290c9dfa725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:22.957798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2439c18-f52b-4cc8-bee9-2290c9dfa725 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:22.969365 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1416/2854] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:22.974890 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f69f4a-26a1-4f08-9bbb-7995096964e7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:22.985028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f69f4a-26a1-4f08-9bbb-7995096964e7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:22.990517 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293aaf6-0fdb-4ebc-8abc-c44715bc7d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:22.991270 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293aaf6-0fdb-4ebc-8abc-c44715bc7d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.991560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293aaf6-0fdb-4ebc-8abc-c44715bc7d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.991937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293aaf6-0fdb-4ebc-8abc-c44715bc7d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.992624 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293aaf6-0fdb-4ebc-8abc-c44715bc7d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:22.994310 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293aaf6-0fdb-4ebc-8abc-c44715bc7d8c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:23.005337 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1439/2855] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:23.013917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2439c18-f52b-4cc8-bee9-2290c9dfa725 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:23.024697 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2439c18-f52b-4cc8-bee9-2290c9dfa725 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:23.029841 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a6fe5-6c83-4372-b8f8-6c6bf7e6b909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:23.030826 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6fe5-6c83-4372-b8f8-6c6bf7e6b909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:23.031145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6fe5-6c83-4372-b8f8-6c6bf7e6b909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:23.031466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6fe5-6c83-4372-b8f8-6c6bf7e6b909 admin admin] PATH_INFO: `/v3/projects/364790f1cafa4204be443b1314ea5b61/users/810f40ec7eca439ca1d5759a2bc99b9f/roles/b670784e829b4bffb77b03422132634a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:23.049389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a6fe5-6c83-4372-b8f8-6c6bf7e6b909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364790f1cafa4204be443b1314ea5b61, user_id=810f40ec7eca439ca1d5759a2bc99b9f, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:23.052047 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a6fe5-6c83-4372-b8f8-6c6bf7e6b909 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:23.066696 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1417/2856] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:37:23 2022] PUT /identity/v3/projects/364790f1cafa4204be443b1314ea5b61/users/810f40ec7eca439ca1d5759a2bc99b9f/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:23.084091 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc67f7-ebcf-4820-a627-de6b1b834f42 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:23.084388 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc67f7-ebcf-4820-a627-de6b1b834f42 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:23.084668 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc67f7-ebcf-4820-a627-de6b1b834f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:23.114071 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-01dc67f7-ebcf-4820-a627-de6b1b834f42 None None] MFA Rules not processed for user `810f40ec7eca439ca1d5759a2bc99b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:23.115307 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-01dc67f7-ebcf-4820-a627-de6b1b834f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:23.208852 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1440/2857] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:23.214278 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a6fe5-6c83-4372-b8f8-6c6bf7e6b909 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:23.302928 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a6fe5-6c83-4372-b8f8-6c6bf7e6b909 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:23.307714 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57753255-4529-45de-8d6b-6c4511283995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:23.308405 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57753255-4529-45de-8d6b-6c4511283995 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:23.308695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57753255-4529-45de-8d6b-6c4511283995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:23.308975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57753255-4529-45de-8d6b-6c4511283995 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:23.309696 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57753255-4529-45de-8d6b-6c4511283995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:23.311664 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57753255-4529-45de-8d6b-6c4511283995 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:23.341103 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1418/2858] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:37:23 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:23.345040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc67f7-ebcf-4820-a627-de6b1b834f42 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:23.356785 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc67f7-ebcf-4820-a627-de6b1b834f42 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:23.417589 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123275c-0549-4a4d-bd64-de1992d91285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:23.418318 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123275c-0549-4a4d-bd64-de1992d91285 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:23.418533 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123275c-0549-4a4d-bd64-de1992d91285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:23.418809 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123275c-0549-4a4d-bd64-de1992d91285 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:23.419516 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123275c-0549-4a4d-bd64-de1992d91285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:23.421470 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123275c-0549-4a4d-bd64-de1992d91285 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:23.431605 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:23.444037 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1441/2859] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:37:23 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:37:23.448452 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57753255-4529-45de-8d6b-6c4511283995 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:23.460148 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57753255-4529-45de-8d6b-6c4511283995 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:23.465334 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08373d75-451e-435a-a852-5b3592898801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:23.466045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373d75-451e-435a-a852-5b3592898801 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:23.466304 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373d75-451e-435a-a852-5b3592898801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:23.466579 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373d75-451e-435a-a852-5b3592898801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:23.467309 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08373d75-451e-435a-a852-5b3592898801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:23.468930 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08373d75-451e-435a-a852-5b3592898801 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:23.481967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1419/2860] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:23.487179 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123275c-0549-4a4d-bd64-de1992d91285 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:23.498434 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123275c-0549-4a4d-bd64-de1992d91285 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:23.503661 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66032320-8e9e-401e-a575-b0db22cebd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:23.505263 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66032320-8e9e-401e-a575-b0db22cebd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:23.505557 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66032320-8e9e-401e-a575-b0db22cebd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:23.505837 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66032320-8e9e-401e-a575-b0db22cebd54 admin admin] PATH_INFO: `/v3/projects/e5004959010c481faa3b470007a172d2/users/02068c75538848628ad931630f2657e3/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:23.523918 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66032320-8e9e-401e-a575-b0db22cebd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5004959010c481faa3b470007a172d2, user_id=02068c75538848628ad931630f2657e3, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:23.526682 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66032320-8e9e-401e-a575-b0db22cebd54 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:23.542877 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1442/2861] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:37:23 2022] PUT /identity/v3/projects/e5004959010c481faa3b470007a172d2/users/02068c75538848628ad931630f2657e3/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:23.550972 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08373d75-451e-435a-a852-5b3592898801 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:23.567462 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08373d75-451e-435a-a852-5b3592898801 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:23.653389 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45302b-65cf-4394-b7a6-78dd2f2e7652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:23.653695 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45302b-65cf-4394-b7a6-78dd2f2e7652 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:23.653982 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45302b-65cf-4394-b7a6-78dd2f2e7652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:23.654261 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45302b-65cf-4394-b7a6-78dd2f2e7652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:23.655012 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45302b-65cf-4394-b7a6-78dd2f2e7652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:23.656644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45302b-65cf-4394-b7a6-78dd2f2e7652 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:23.659200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:23.670038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1420/2862] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:23.674578 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66032320-8e9e-401e-a575-b0db22cebd54 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:23.686571 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66032320-8e9e-401e-a575-b0db22cebd54 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:23.693183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d00f6b-1de9-4088-944c-268435128f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:23.694258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d00f6b-1de9-4088-944c-268435128f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:23.694560 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d00f6b-1de9-4088-944c-268435128f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:23.695051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d00f6b-1de9-4088-944c-268435128f81 admin admin] PATH_INFO: `/v3/projects/e5004959010c481faa3b470007a172d2/users/02068c75538848628ad931630f2657e3/roles/87593f63c4744eac870c07b006022e77` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:23.697325 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d00f6b-1de9-4088-944c-268435128f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5004959010c481faa3b470007a172d2, user_id=02068c75538848628ad931630f2657e3, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:23.700004 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d00f6b-1de9-4088-944c-268435128f81 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:23.711087 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1443/2863] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:37:23 2022] PUT /identity/v3/projects/e5004959010c481faa3b470007a172d2/users/02068c75538848628ad931630f2657e3/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:23.722975 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ea8a5-1bb9-4a8c-9f94-17efca636d17 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:23.723258 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ea8a5-1bb9-4a8c-9f94-17efca636d17 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:23.723549 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ea8a5-1bb9-4a8c-9f94-17efca636d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:23.753989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b74ea8a5-1bb9-4a8c-9f94-17efca636d17 None None] MFA Rules not processed for user `02068c75538848628ad931630f2657e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:23.755783 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b74ea8a5-1bb9-4a8c-9f94-17efca636d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:23.853049 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1421/2864] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:23.865786 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d00f6b-1de9-4088-944c-268435128f81 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:23.867673 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-63d00f6b-1de9-4088-944c-268435128f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:23.943038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d00f6b-1de9-4088-944c-268435128f81 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:23.946913 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea882abe-39a3-4433-9693-bf9f893f68b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:23.947569 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882abe-39a3-4433-9693-bf9f893f68b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:23.947853 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882abe-39a3-4433-9693-bf9f893f68b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:23.948131 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882abe-39a3-4433-9693-bf9f893f68b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:23.959183 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea882abe-39a3-4433-9693-bf9f893f68b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:23.960653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea882abe-39a3-4433-9693-bf9f893f68b0 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:23.971454 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1444/2865] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:37:24.522026 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ea8a5-1bb9-4a8c-9f94-17efca636d17 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:24.523623 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b74ea8a5-1bb9-4a8c-9f94-17efca636d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:24.536989 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ea8a5-1bb9-4a8c-9f94-17efca636d17 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:24.540566 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d58d5-9ea0-49fb-85f3-496428d1359c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:24.541252 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d58d5-9ea0-49fb-85f3-496428d1359c service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:24.541541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d58d5-9ea0-49fb-85f3-496428d1359c service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:24.541813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d58d5-9ea0-49fb-85f3-496428d1359c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:24.617560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d58d5-9ea0-49fb-85f3-496428d1359c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:24.619018 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d58d5-9ea0-49fb-85f3-496428d1359c service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:24.628833 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1422/2866] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:28.794234 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea882abe-39a3-4433-9693-bf9f893f68b0 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:28.806028 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea882abe-39a3-4433-9693-bf9f893f68b0 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:28.810396 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20c2c0-43ad-4716-b88d-3e8a024e27f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:28.811051 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20c2c0-43ad-4716-b88d-3e8a024e27f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:28.811366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20c2c0-43ad-4716-b88d-3e8a024e27f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:28.811648 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20c2c0-43ad-4716-b88d-3e8a024e27f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:28.877015 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20c2c0-43ad-4716-b88d-3e8a024e27f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:28.878542 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20c2c0-43ad-4716-b88d-3e8a024e27f7 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:28.888583 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1445/2867] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:31.143661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d58d5-9ea0-49fb-85f3-496428d1359c service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:31.209100 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d58d5-9ea0-49fb-85f3-496428d1359c service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:31.213603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:31.214473 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:31.214758 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:31.215036 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] PATH_INFO: `/v3/users/a0923a2e9fba4541a2bbf040ef97199c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:31.216223 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0923a2e9fba4541a2bbf040ef97199c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:31.218195 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:31.241874 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:31.275056 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0923a2e9fba4541a2bbf040ef97199c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:31.287254 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0923a2e9fba4541a2bbf040ef97199c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:31.294346 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0923a2e9fba4541a2bbf040ef97199c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:31.303137 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0923a2e9fba4541a2bbf040ef97199c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:31.303813 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0923a2e9fba4541a2bbf040ef97199c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:31.310344 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1423/2868] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:37:31 2022] DELETE /identity/v3/users/a0923a2e9fba4541a2bbf040ef97199c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:37:31.315817 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85106e-6e4f-4e50-946e-4fbcd76e36c1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:31.316860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85106e-6e4f-4e50-946e-4fbcd76e36c1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:31.317038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85106e-6e4f-4e50-946e-4fbcd76e36c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:31.334286 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cf85106e-6e4f-4e50-946e-4fbcd76e36c1 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:31.335765 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cf85106e-6e4f-4e50-946e-4fbcd76e36c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:31.392000 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:31.403449 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1446/2869] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:31.413603 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:31.415045 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:31.478466 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07aff0-0be8-46b0-85b5-f7378c294ee4 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:31.482175 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68d042-c55a-4186-b3c1-8fbc5236a904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:31.482830 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68d042-c55a-4186-b3c1-8fbc5236a904 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:31.483117 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68d042-c55a-4186-b3c1-8fbc5236a904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:31.483398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68d042-c55a-4186-b3c1-8fbc5236a904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:31.493075 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68d042-c55a-4186-b3c1-8fbc5236a904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:31.494532 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68d042-c55a-4186-b3c1-8fbc5236a904 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:31.504661 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1424/2870] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:31.792239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85106e-6e4f-4e50-946e-4fbcd76e36c1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:31.793804 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cf85106e-6e4f-4e50-946e-4fbcd76e36c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:31.810602 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85106e-6e4f-4e50-946e-4fbcd76e36c1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:31.815423 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:31.816943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:31.817118 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:31.817423 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] PATH_INFO: `/v3/projects/611e932d087c4edeb1eeb8afa5f6724b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:31.818635 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] RBAC: Authorizing `identity:delete_project(project_id=611e932d087c4edeb1eeb8afa5f6724b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:31.820550 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:31.866714 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611e932d087c4edeb1eeb8afa5f6724b', 'request_id': 'req-565ee7bd-7c6f-4910-95a6-a4ed2634548b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:31.874273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611e932d087c4edeb1eeb8afa5f6724b', 'request_id': 'req-565ee7bd-7c6f-4910-95a6-a4ed2634548b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:31.882130 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611e932d087c4edeb1eeb8afa5f6724b', 'request_id': 'req-565ee7bd-7c6f-4910-95a6-a4ed2634548b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:31.893248 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] The token cache is being invalidate because project 611e932d087c4edeb1eeb8afa5f6724b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:37:31.893546 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:31.894184 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:31.896311 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1447/2871] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:37:31 2022] DELETE /identity/v3/projects/611e932d087c4edeb1eeb8afa5f6724b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:31.900441 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68d042-c55a-4186-b3c1-8fbc5236a904 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:31.910089 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68d042-c55a-4186-b3c1-8fbc5236a904 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:31.966892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:31.967812 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:31.968095 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:31.968373 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] PATH_INFO: `/v3/users/810f40ec7eca439ca1d5759a2bc99b9f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:31.969636 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=810f40ec7eca439ca1d5759a2bc99b9f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:31.971564 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:32.021567 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:32.023072 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '810f40ec7eca439ca1d5759a2bc99b9f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.039988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '810f40ec7eca439ca1d5759a2bc99b9f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.047032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '810f40ec7eca439ca1d5759a2bc99b9f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.057238 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '810f40ec7eca439ca1d5759a2bc99b9f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.057934 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '810f40ec7eca439ca1d5759a2bc99b9f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.064215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1425/2872] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:37:31 2022] DELETE /identity/v3/users/810f40ec7eca439ca1d5759a2bc99b9f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:32.347076 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:32.349122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:32.362587 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ee7bd-7c6f-4910-95a6-a4ed2634548b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:32.421333 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:32.422203 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:32.422505 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:32.422813 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] PATH_INFO: `/v3/projects/364790f1cafa4204be443b1314ea5b61` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:32.424044 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=364790f1cafa4204be443b1314ea5b61)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:32.426595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:32.482763 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364790f1cafa4204be443b1314ea5b61', 'request_id': 'req-2023088b-0695-4d16-b825-41cf4475a894'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.490475 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364790f1cafa4204be443b1314ea5b61', 'request_id': 'req-2023088b-0695-4d16-b825-41cf4475a894'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.500060 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364790f1cafa4204be443b1314ea5b61', 'request_id': 'req-2023088b-0695-4d16-b825-41cf4475a894'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.518523 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] The token cache is being invalidate because project 364790f1cafa4204be443b1314ea5b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:37:32.518914 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.519863 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.521487 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1448/2873] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:37:32 2022] DELETE /identity/v3/projects/364790f1cafa4204be443b1314ea5b61 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:32.525541 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:32.526967 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:32.541343 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef0c45-a20d-41fb-82a5-d6a035a9c504 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:32.603578 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e4afb-af01-4e8f-bc99-c6267d21509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:32.604486 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e4afb-af01-4e8f-bc99-c6267d21509a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:32.604776 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e4afb-af01-4e8f-bc99-c6267d21509a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:32.605055 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e4afb-af01-4e8f-bc99-c6267d21509a admin admin] PATH_INFO: `/v3/users/02068c75538848628ad931630f2657e3` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:32.606375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e4afb-af01-4e8f-bc99-c6267d21509a admin admin] RBAC: Authorizing `identity:delete_user(user_id=02068c75538848628ad931630f2657e3)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:32.608311 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e4afb-af01-4e8f-bc99-c6267d21509a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:32.666334 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-541e4afb-af01-4e8f-bc99-c6267d21509a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02068c75538848628ad931630f2657e3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.679902 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-541e4afb-af01-4e8f-bc99-c6267d21509a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02068c75538848628ad931630f2657e3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.686723 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-541e4afb-af01-4e8f-bc99-c6267d21509a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02068c75538848628ad931630f2657e3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.695247 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-541e4afb-af01-4e8f-bc99-c6267d21509a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02068c75538848628ad931630f2657e3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.695895 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-541e4afb-af01-4e8f-bc99-c6267d21509a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02068c75538848628ad931630f2657e3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:32.702015 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1426/2874] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:37:32 2022] DELETE /identity/v3/users/02068c75538848628ad931630f2657e3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:32.982860 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:32.984346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:33.000767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023088b-0695-4d16-b825-41cf4475a894 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:33.018963 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:33.075215 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c57431-6573-4489-92d5-70b5552d20cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:33.076038 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c57431-6573-4489-92d5-70b5552d20cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.076326 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c57431-6573-4489-92d5-70b5552d20cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.076610 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c57431-6573-4489-92d5-70b5552d20cb admin admin] PATH_INFO: `/v3/projects/e5004959010c481faa3b470007a172d2` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.077866 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c57431-6573-4489-92d5-70b5552d20cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5004959010c481faa3b470007a172d2)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:33.079801 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c57431-6573-4489-92d5-70b5552d20cb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:33.130185 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-90c57431-6573-4489-92d5-70b5552d20cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5004959010c481faa3b470007a172d2', 'request_id': 'req-90c57431-6573-4489-92d5-70b5552d20cb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:33.136337 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-90c57431-6573-4489-92d5-70b5552d20cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5004959010c481faa3b470007a172d2', 'request_id': 'req-90c57431-6573-4489-92d5-70b5552d20cb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:33.144426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-90c57431-6573-4489-92d5-70b5552d20cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5004959010c481faa3b470007a172d2', 'request_id': 'req-90c57431-6573-4489-92d5-70b5552d20cb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:33.154689 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-90c57431-6573-4489-92d5-70b5552d20cb admin admin] The token cache is being invalidate because project e5004959010c481faa3b470007a172d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:37:33.154978 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-90c57431-6573-4489-92d5-70b5552d20cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:33.155608 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-90c57431-6573-4489-92d5-70b5552d20cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:33.157168 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1449/2875] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:37:32 2022] DELETE /identity/v3/projects/e5004959010c481faa3b470007a172d2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:33.163754 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a15ded-bc38-4d57-b1f4-58b7958605dc None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.164033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a15ded-bc38-4d57-b1f4-58b7958605dc None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.164316 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a15ded-bc38-4d57-b1f4-58b7958605dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.182998 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f1a15ded-bc38-4d57-b1f4-58b7958605dc None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:33.184213 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f1a15ded-bc38-4d57-b1f4-58b7958605dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:33.221611 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:33.244800 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1427/2876] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:33.253204 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f300fc-9d6d-48e6-82e7-881fb16048ad None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.253499 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f300fc-9d6d-48e6-82e7-881fb16048ad None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.253781 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f300fc-9d6d-48e6-82e7-881fb16048ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.272222 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d1f300fc-9d6d-48e6-82e7-881fb16048ad None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:33.273467 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d1f300fc-9d6d-48e6-82e7-881fb16048ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:33.281406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1450/2877] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:33.286173 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a15ded-bc38-4d57-b1f4-58b7958605dc None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:33.296410 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a15ded-bc38-4d57-b1f4-58b7958605dc None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:33.301856 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d4e0d-0b50-438d-90dd-25d0923daf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:33.302519 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d4e0d-0b50-438d-90dd-25d0923daf91 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.302806 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d4e0d-0b50-438d-90dd-25d0923daf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.303109 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d4e0d-0b50-438d-90dd-25d0923daf91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.303840 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d4e0d-0b50-438d-90dd-25d0923daf91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:37:33.304149 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d4e0d-0b50-438d-90dd-25d0923daf91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:33.305794 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d4e0d-0b50-438d-90dd-25d0923daf91 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:33.317663 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1428/2878] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:37:33.322156 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f300fc-9d6d-48e6-82e7-881fb16048ad None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:33.331410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f300fc-9d6d-48e6-82e7-881fb16048ad None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:33.336012 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23715c96-5a3f-4a90-8ece-58bd6533b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:33.336657 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23715c96-5a3f-4a90-8ece-58bd6533b686 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.336939 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23715c96-5a3f-4a90-8ece-58bd6533b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.337253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23715c96-5a3f-4a90-8ece-58bd6533b686 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.338001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23715c96-5a3f-4a90-8ece-58bd6533b686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:33.339899 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23715c96-5a3f-4a90-8ece-58bd6533b686 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:33.366831 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1451/2879] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:37:33 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:33.371282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d4e0d-0b50-438d-90dd-25d0923daf91 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:33.381658 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d4e0d-0b50-438d-90dd-25d0923daf91 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:33.438246 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad6b46-4adc-40e3-857d-f86ad25c9641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:33.438917 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad6b46-4adc-40e3-857d-f86ad25c9641 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.439200 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad6b46-4adc-40e3-857d-f86ad25c9641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.439478 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad6b46-4adc-40e3-857d-f86ad25c9641 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.440177 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad6b46-4adc-40e3-857d-f86ad25c9641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:33.442128 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad6b46-4adc-40e3-857d-f86ad25c9641 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:33.463310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1429/2880] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:37:33 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:33.467584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23715c96-5a3f-4a90-8ece-58bd6533b686 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:33.480537 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23715c96-5a3f-4a90-8ece-58bd6533b686 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:33.488341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606138fd-1bd8-4e06-99df-75416ca0d6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:33.489127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606138fd-1bd8-4e06-99df-75416ca0d6cb admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.489417 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606138fd-1bd8-4e06-99df-75416ca0d6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.489697 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606138fd-1bd8-4e06-99df-75416ca0d6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.490430 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606138fd-1bd8-4e06-99df-75416ca0d6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:33.492045 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606138fd-1bd8-4e06-99df-75416ca0d6cb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:33.502767 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1452/2881] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:33.506884 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad6b46-4adc-40e3-857d-f86ad25c9641 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:33.517876 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad6b46-4adc-40e3-857d-f86ad25c9641 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:33.523170 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ddf98-1811-4dc1-bb0a-6526e6c86e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:33.523841 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ddf98-1811-4dc1-bb0a-6526e6c86e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.524132 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ddf98-1811-4dc1-bb0a-6526e6c86e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.524413 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ddf98-1811-4dc1-bb0a-6526e6c86e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.525182 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ddf98-1811-4dc1-bb0a-6526e6c86e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:33.526803 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ddf98-1811-4dc1-bb0a-6526e6c86e8c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:33.537701 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1430/2882] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:33.541972 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606138fd-1bd8-4e06-99df-75416ca0d6cb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:33.552122 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606138fd-1bd8-4e06-99df-75416ca0d6cb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:33.557217 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759fab2-3c63-4eab-9965-02de8d2243af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:33.558125 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759fab2-3c63-4eab-9965-02de8d2243af admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.558406 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759fab2-3c63-4eab-9965-02de8d2243af admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.558708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759fab2-3c63-4eab-9965-02de8d2243af admin admin] PATH_INFO: `/v3/projects/423480882d2a49f88f2fede109f3cd43/users/fcbe5cd3360f45fcba591ecfdecf7dff/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.573279 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759fab2-3c63-4eab-9965-02de8d2243af admin admin] RBAC: Authorizing `identity:create_grant(project_id=423480882d2a49f88f2fede109f3cd43, user_id=fcbe5cd3360f45fcba591ecfdecf7dff, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:33.575931 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759fab2-3c63-4eab-9965-02de8d2243af admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:33.589214 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1453/2883] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:37:33 2022] PUT /identity/v3/projects/423480882d2a49f88f2fede109f3cd43/users/fcbe5cd3360f45fcba591ecfdecf7dff/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:33.602096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7565ba5-1f4d-4eab-b165-87d1b6e8f470 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.602878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7565ba5-1f4d-4eab-b165-87d1b6e8f470 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.602878 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7565ba5-1f4d-4eab-b165-87d1b6e8f470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.630650 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b7565ba5-1f4d-4eab-b165-87d1b6e8f470 None None] MFA Rules not processed for user `fcbe5cd3360f45fcba591ecfdecf7dff`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:33.631894 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b7565ba5-1f4d-4eab-b165-87d1b6e8f470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:33.702455 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1431/2884] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:33.709352 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759fab2-3c63-4eab-9965-02de8d2243af admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:33.759400 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:33.790746 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759fab2-3c63-4eab-9965-02de8d2243af admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:33.798509 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f5fe6-d8f8-4fdf-b6c3-8df15298fd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:33.799667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f5fe6-d8f8-4fdf-b6c3-8df15298fd73 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.800226 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f5fe6-d8f8-4fdf-b6c3-8df15298fd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.800749 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f5fe6-d8f8-4fdf-b6c3-8df15298fd73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.802127 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f5fe6-d8f8-4fdf-b6c3-8df15298fd73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:33.806190 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f5fe6-d8f8-4fdf-b6c3-8df15298fd73 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:33.844751 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1454/2885] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:37:33 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:33.850550 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7565ba5-1f4d-4eab-b165-87d1b6e8f470 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:33.862320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7565ba5-1f4d-4eab-b165-87d1b6e8f470 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:33.898404 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:33.924129 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de79f75-95f7-4f0f-9fd7-b95c5c810ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:33.924798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de79f75-95f7-4f0f-9fd7-b95c5c810ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.925123 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de79f75-95f7-4f0f-9fd7-b95c5c810ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.925413 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de79f75-95f7-4f0f-9fd7-b95c5c810ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.926145 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de79f75-95f7-4f0f-9fd7-b95c5c810ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:33.928086 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de79f75-95f7-4f0f-9fd7-b95c5c810ec0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:33.949400 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1432/2886] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:37:33 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:33.953619 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f5fe6-d8f8-4fdf-b6c3-8df15298fd73 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:33.965280 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f5fe6-d8f8-4fdf-b6c3-8df15298fd73 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:33.970182 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54807bf-2ced-4cd1-bc59-60802f0d556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:33.971023 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54807bf-2ced-4cd1-bc59-60802f0d556c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:33.971314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54807bf-2ced-4cd1-bc59-60802f0d556c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:33.971609 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54807bf-2ced-4cd1-bc59-60802f0d556c admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:33.972373 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54807bf-2ced-4cd1-bc59-60802f0d556c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:33.974093 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54807bf-2ced-4cd1-bc59-60802f0d556c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:33.986737 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1455/2887] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:33.991398 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de79f75-95f7-4f0f-9fd7-b95c5c810ec0 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:34.002529 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de79f75-95f7-4f0f-9fd7-b95c5c810ec0 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:34.008896 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f8d83-5a8b-4e5c-b652-1290d5c310c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:34.009926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f8d83-5a8b-4e5c-b652-1290d5c310c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:34.010215 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f8d83-5a8b-4e5c-b652-1290d5c310c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:34.010501 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f8d83-5a8b-4e5c-b652-1290d5c310c8 admin admin] PATH_INFO: `/v3/projects/58c5220cb71c4f2187c8f5085a88a7e3/users/4822c04810f4463b9abd5befb8604405/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:34.028289 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f8d83-5a8b-4e5c-b652-1290d5c310c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c5220cb71c4f2187c8f5085a88a7e3, user_id=4822c04810f4463b9abd5befb8604405, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:34.031032 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f8d83-5a8b-4e5c-b652-1290d5c310c8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:34.044995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1433/2888] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:37:33 2022] PUT /identity/v3/projects/58c5220cb71c4f2187c8f5085a88a7e3/users/4822c04810f4463b9abd5befb8604405/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:34.049220 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54807bf-2ced-4cd1-bc59-60802f0d556c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:34.059946 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54807bf-2ced-4cd1-bc59-60802f0d556c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:34.246739 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fa451-4e8d-4ca0-a5eb-b522c08998ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:34.247309 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fa451-4e8d-4ca0-a5eb-b522c08998ba admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:34.247596 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fa451-4e8d-4ca0-a5eb-b522c08998ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:34.247879 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fa451-4e8d-4ca0-a5eb-b522c08998ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:34.248622 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fa451-4e8d-4ca0-a5eb-b522c08998ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:34.250292 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fa451-4e8d-4ca0-a5eb-b522c08998ba admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:34.261366 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1456/2889] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:34.265610 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f8d83-5a8b-4e5c-b652-1290d5c310c8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:34.276613 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f8d83-5a8b-4e5c-b652-1290d5c310c8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:34.281197 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf560b-6ff6-4f0f-a99f-d6fa972b398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:34.282088 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf560b-6ff6-4f0f-a99f-d6fa972b398a admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:34.282375 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf560b-6ff6-4f0f-a99f-d6fa972b398a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:34.282659 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf560b-6ff6-4f0f-a99f-d6fa972b398a admin admin] PATH_INFO: `/v3/projects/58c5220cb71c4f2187c8f5085a88a7e3/users/4822c04810f4463b9abd5befb8604405/roles/87593f63c4744eac870c07b006022e77` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:34.284635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf560b-6ff6-4f0f-a99f-d6fa972b398a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c5220cb71c4f2187c8f5085a88a7e3, user_id=4822c04810f4463b9abd5befb8604405, role_id=87593f63c4744eac870c07b006022e77)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:34.287362 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf560b-6ff6-4f0f-a99f-d6fa972b398a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:34.297785 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1434/2890] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:37:34 2022] PUT /identity/v3/projects/58c5220cb71c4f2187c8f5085a88a7e3/users/4822c04810f4463b9abd5befb8604405/roles/87593f63c4744eac870c07b006022e77 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:34.308887 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332041b7-9e32-4bd3-ac1e-7ee3dd6302f8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:34.309228 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332041b7-9e32-4bd3-ac1e-7ee3dd6302f8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:34.309492 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332041b7-9e32-4bd3-ac1e-7ee3dd6302f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:34.336821 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-332041b7-9e32-4bd3-ac1e-7ee3dd6302f8 None None] MFA Rules not processed for user `4822c04810f4463b9abd5befb8604405`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:34.338149 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-332041b7-9e32-4bd3-ac1e-7ee3dd6302f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:34.406952 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1457/2891] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:34.417768 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf560b-6ff6-4f0f-a99f-d6fa972b398a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:34.419451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-36cf560b-6ff6-4f0f-a99f-d6fa972b398a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:34.478493 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf560b-6ff6-4f0f-a99f-d6fa972b398a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:34.482187 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccab34-a755-4e21-93c9-60f700ad9de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:34.482841 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccab34-a755-4e21-93c9-60f700ad9de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:34.483131 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccab34-a755-4e21-93c9-60f700ad9de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:34.483417 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccab34-a755-4e21-93c9-60f700ad9de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:34.493728 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccab34-a755-4e21-93c9-60f700ad9de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:34.495194 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccab34-a755-4e21-93c9-60f700ad9de7 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:34.505868 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1435/2892] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:34.551284 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332041b7-9e32-4bd3-ac1e-7ee3dd6302f8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:34.552712 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-332041b7-9e32-4bd3-ac1e-7ee3dd6302f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:34.577988 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332041b7-9e32-4bd3-ac1e-7ee3dd6302f8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:34.581660 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecacce-14bd-4b37-9ebc-0680f017d699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:34.582386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecacce-14bd-4b37-9ebc-0680f017d699 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:34.582667 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecacce-14bd-4b37-9ebc-0680f017d699 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:34.582943 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecacce-14bd-4b37-9ebc-0680f017d699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:34.619376 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:34.648027 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecacce-14bd-4b37-9ebc-0680f017d699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:34.649535 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecacce-14bd-4b37-9ebc-0680f017d699 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:34.659321 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1458/2893] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:38.030272 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccab34-a755-4e21-93c9-60f700ad9de7 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:38.100855 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccab34-a755-4e21-93c9-60f700ad9de7 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:38.106243 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:38.108087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:38.108087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:38.108087 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] PATH_INFO: `/v3/users/fcbe5cd3360f45fcba591ecfdecf7dff` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:38.109168 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcbe5cd3360f45fcba591ecfdecf7dff)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:38.111115 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:38.158788 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:38.171722 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcbe5cd3360f45fcba591ecfdecf7dff'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.186229 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcbe5cd3360f45fcba591ecfdecf7dff'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.195489 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcbe5cd3360f45fcba591ecfdecf7dff'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.203286 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcbe5cd3360f45fcba591ecfdecf7dff'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.204011 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcbe5cd3360f45fcba591ecfdecf7dff'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.211565 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1436/2894] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:37:38 2022] DELETE /identity/v3/users/fcbe5cd3360f45fcba591ecfdecf7dff => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:38.216296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6824aa-1bb9-4d21-8bc8-e914a344f25e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:38.216812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6824aa-1bb9-4d21-8bc8-e914a344f25e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:38.216925 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6824aa-1bb9-4d21-8bc8-e914a344f25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:38.238503 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5b6824aa-1bb9-4d21-8bc8-e914a344f25e None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:38.240640 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5b6824aa-1bb9-4d21-8bc8-e914a344f25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:38.311170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1459/2895] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:38.324560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:38.326216 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:38.386159 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d807ec9-05c7-4d25-8620-0b34619ee43a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:38.390204 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0be238-330d-41af-a500-39a36623fb84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:38.390870 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0be238-330d-41af-a500-39a36623fb84 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:38.391165 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0be238-330d-41af-a500-39a36623fb84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:38.391434 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0be238-330d-41af-a500-39a36623fb84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:38.402528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0be238-330d-41af-a500-39a36623fb84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:38.404228 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0be238-330d-41af-a500-39a36623fb84 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:38.414362 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1437/2896] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:38.713364 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6824aa-1bb9-4d21-8bc8-e914a344f25e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:38.714810 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5b6824aa-1bb9-4d21-8bc8-e914a344f25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:38.726798 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6824aa-1bb9-4d21-8bc8-e914a344f25e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:38.731504 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:38.732405 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:38.732689 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:38.732982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] PATH_INFO: `/v3/projects/423480882d2a49f88f2fede109f3cd43` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:38.734313 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=423480882d2a49f88f2fede109f3cd43)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:38.736239 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:38.788314 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '423480882d2a49f88f2fede109f3cd43', 'request_id': 'req-977694ba-d783-4a45-858d-956d217adbc3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.796878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '423480882d2a49f88f2fede109f3cd43', 'request_id': 'req-977694ba-d783-4a45-858d-956d217adbc3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.805814 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '423480882d2a49f88f2fede109f3cd43', 'request_id': 'req-977694ba-d783-4a45-858d-956d217adbc3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.817032 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] The token cache is being invalidate because project 423480882d2a49f88f2fede109f3cd43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:37:38.817360 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.818001 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.819551 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1460/2897] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:37:38 2022] DELETE /identity/v3/projects/423480882d2a49f88f2fede109f3cd43 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:38.823676 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0be238-330d-41af-a500-39a36623fb84 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:38.833516 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0be238-330d-41af-a500-39a36623fb84 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:38.896645 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162d53b-c763-4d79-a8ed-0f4d86e9f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:38.897886 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162d53b-c763-4d79-a8ed-0f4d86e9f0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:38.898175 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162d53b-c763-4d79-a8ed-0f4d86e9f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:38.898472 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162d53b-c763-4d79-a8ed-0f4d86e9f0b8 admin admin] PATH_INFO: `/v3/users/4822c04810f4463b9abd5befb8604405` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:38.899644 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162d53b-c763-4d79-a8ed-0f4d86e9f0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4822c04810f4463b9abd5befb8604405)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:38.901596 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162d53b-c763-4d79-a8ed-0f4d86e9f0b8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:38.952497 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d162d53b-c763-4d79-a8ed-0f4d86e9f0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4822c04810f4463b9abd5befb8604405'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.959528 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:38.965939 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d162d53b-c763-4d79-a8ed-0f4d86e9f0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4822c04810f4463b9abd5befb8604405'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.974019 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d162d53b-c763-4d79-a8ed-0f4d86e9f0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4822c04810f4463b9abd5befb8604405'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.982240 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d162d53b-c763-4d79-a8ed-0f4d86e9f0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4822c04810f4463b9abd5befb8604405'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.982926 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d162d53b-c763-4d79-a8ed-0f4d86e9f0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4822c04810f4463b9abd5befb8604405'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:38.989674 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1438/2898] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:37:38 2022] DELETE /identity/v3/users/4822c04810f4463b9abd5befb8604405 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:39.284627 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:39.287378 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:39.302170 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977694ba-d783-4a45-858d-956d217adbc3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:39.356213 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:39.363743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f9b18-e18d-443d-8d86-24c14b53e710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:39.364954 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f9b18-e18d-443d-8d86-24c14b53e710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:39.365458 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f9b18-e18d-443d-8d86-24c14b53e710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:39.365769 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f9b18-e18d-443d-8d86-24c14b53e710 admin admin] PATH_INFO: `/v3/projects/58c5220cb71c4f2187c8f5085a88a7e3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:39.367114 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f9b18-e18d-443d-8d86-24c14b53e710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c5220cb71c4f2187c8f5085a88a7e3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:39.369258 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f9b18-e18d-443d-8d86-24c14b53e710 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:39.420593 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c58f9b18-e18d-443d-8d86-24c14b53e710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c5220cb71c4f2187c8f5085a88a7e3', 'request_id': 'req-c58f9b18-e18d-443d-8d86-24c14b53e710'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:39.427346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c58f9b18-e18d-443d-8d86-24c14b53e710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c5220cb71c4f2187c8f5085a88a7e3', 'request_id': 'req-c58f9b18-e18d-443d-8d86-24c14b53e710'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:39.435457 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c58f9b18-e18d-443d-8d86-24c14b53e710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c5220cb71c4f2187c8f5085a88a7e3', 'request_id': 'req-c58f9b18-e18d-443d-8d86-24c14b53e710'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:39.446594 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c58f9b18-e18d-443d-8d86-24c14b53e710 admin admin] The token cache is being invalidate because project 58c5220cb71c4f2187c8f5085a88a7e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:37:39.446880 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c58f9b18-e18d-443d-8d86-24c14b53e710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:39.447524 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c58f9b18-e18d-443d-8d86-24c14b53e710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:39.449085 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1461/2899] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:37:39 2022] DELETE /identity/v3/projects/58c5220cb71c4f2187c8f5085a88a7e3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:39.454310 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ff45a-d3ac-467f-be41-9dd704bd2682 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:39.454824 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ff45a-d3ac-467f-be41-9dd704bd2682 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:39.454932 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ff45a-d3ac-467f-be41-9dd704bd2682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:39.476096 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-bf0ff45a-d3ac-467f-be41-9dd704bd2682 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:39.478038 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bf0ff45a-d3ac-467f-be41-9dd704bd2682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:39.545458 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1439/2900] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:39.553629 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb8e3c-deeb-4b23-befe-8fc8990660fc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:39.554210 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb8e3c-deeb-4b23-befe-8fc8990660fc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:39.554708 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb8e3c-deeb-4b23-befe-8fc8990660fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:39.575772 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-23cb8e3c-deeb-4b23-befe-8fc8990660fc None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:39.576992 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-23cb8e3c-deeb-4b23-befe-8fc8990660fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:39.587878 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1462/2901] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:39.596798 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ff45a-d3ac-467f-be41-9dd704bd2682 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:39.608282 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ff45a-d3ac-467f-be41-9dd704bd2682 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:39.613892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869cf35-73bc-4e54-87b6-78139cc44cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:39.614621 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869cf35-73bc-4e54-87b6-78139cc44cec admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:39.614918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869cf35-73bc-4e54-87b6-78139cc44cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:39.615225 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869cf35-73bc-4e54-87b6-78139cc44cec admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:39.615995 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869cf35-73bc-4e54-87b6-78139cc44cec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:37:39.616306 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869cf35-73bc-4e54-87b6-78139cc44cec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:39.617988 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869cf35-73bc-4e54-87b6-78139cc44cec admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:39.630708 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1440/2902] 10.222.0.64 () {58 vars in 1152 bytes} [Fri Jul 15 15:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:37:39.635186 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb8e3c-deeb-4b23-befe-8fc8990660fc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:39.646426 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb8e3c-deeb-4b23-befe-8fc8990660fc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:39.652563 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080faa0f-5f3e-40a0-b79e-0b092dda42e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:39.653273 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080faa0f-5f3e-40a0-b79e-0b092dda42e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:39.653554 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080faa0f-5f3e-40a0-b79e-0b092dda42e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:39.653827 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080faa0f-5f3e-40a0-b79e-0b092dda42e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:39.654547 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080faa0f-5f3e-40a0-b79e-0b092dda42e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:39.656463 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080faa0f-5f3e-40a0-b79e-0b092dda42e0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:39.686937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1463/2903] 10.222.0.64 () {60 vars in 1152 bytes} [Fri Jul 15 15:37:39 2022] POST /identity/v3/projects => generated 359 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:39.691104 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869cf35-73bc-4e54-87b6-78139cc44cec admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:39.702320 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869cf35-73bc-4e54-87b6-78139cc44cec admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:39.773379 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b04d6-04ff-4e50-9637-2dcaafdc4be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:39.774072 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b04d6-04ff-4e50-9637-2dcaafdc4be7 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:39.774356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b04d6-04ff-4e50-9637-2dcaafdc4be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:39.774635 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b04d6-04ff-4e50-9637-2dcaafdc4be7 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:39.775356 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b04d6-04ff-4e50-9637-2dcaafdc4be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:39.777331 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b04d6-04ff-4e50-9637-2dcaafdc4be7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:39.800132 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1441/2904] 10.222.0.64 () {60 vars in 1143 bytes} [Fri Jul 15 15:37:39 2022] POST /identity/v3/users => generated 280 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:37:39.804555 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080faa0f-5f3e-40a0-b79e-0b092dda42e0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:39.815019 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080faa0f-5f3e-40a0-b79e-0b092dda42e0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:39.821743 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1c1f6-ecbc-405a-b3e5-b04f6c08b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:39.822341 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1c1f6-ecbc-405a-b3e5-b04f6c08b837 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:39.822632 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1c1f6-ecbc-405a-b3e5-b04f6c08b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:39.822906 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1c1f6-ecbc-405a-b3e5-b04f6c08b837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:39.823647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1c1f6-ecbc-405a-b3e5-b04f6c08b837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:39.825296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1c1f6-ecbc-405a-b3e5-b04f6c08b837 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:39.837268 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1464/2905] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:39.841543 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b04d6-04ff-4e50-9637-2dcaafdc4be7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:39.854220 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b04d6-04ff-4e50-9637-2dcaafdc4be7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:39.859378 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785a3eb-f64a-4927-996f-8c5211bb3524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:39.860072 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785a3eb-f64a-4927-996f-8c5211bb3524 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:39.860366 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785a3eb-f64a-4927-996f-8c5211bb3524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:39.860618 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785a3eb-f64a-4927-996f-8c5211bb3524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:39.861390 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785a3eb-f64a-4927-996f-8c5211bb3524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:39.863006 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785a3eb-f64a-4927-996f-8c5211bb3524 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:39.873673 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1442/2906] 10.222.0.64 () {58 vars in 1121 bytes} [Fri Jul 15 15:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:39.877907 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1c1f6-ecbc-405a-b3e5-b04f6c08b837 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:39.889556 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1c1f6-ecbc-405a-b3e5-b04f6c08b837 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:39.899166 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1e928-3a55-4023-b318-c54a0817529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:39.900077 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1e928-3a55-4023-b318-c54a0817529b admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:39.900355 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1e928-3a55-4023-b318-c54a0817529b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:39.900658 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1e928-3a55-4023-b318-c54a0817529b admin admin] PATH_INFO: `/v3/projects/8b2afdb16c4146fbad5be850a6d4d895/users/8b69603d512b4fafbc96b98b8a64ea55/roles/b670784e829b4bffb77b03422132634a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:39.920346 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1e928-3a55-4023-b318-c54a0817529b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2afdb16c4146fbad5be850a6d4d895, user_id=8b69603d512b4fafbc96b98b8a64ea55, role_id=b670784e829b4bffb77b03422132634a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:39.923128 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1e928-3a55-4023-b318-c54a0817529b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:39.936888 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1465/2907] 10.222.0.64 () {60 vars in 1482 bytes} [Fri Jul 15 15:37:39 2022] PUT /identity/v3/projects/8b2afdb16c4146fbad5be850a6d4d895/users/8b69603d512b4fafbc96b98b8a64ea55/roles/b670784e829b4bffb77b03422132634a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:39.949775 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfb357-2c86-44f9-8040-d2974b314ec3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:39.950120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfb357-2c86-44f9-8040-d2974b314ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:39.950120 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfb357-2c86-44f9-8040-d2974b314ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:39.991801 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-79dfb357-2c86-44f9-8040-d2974b314ec3 None None] MFA Rules not processed for user `8b69603d512b4fafbc96b98b8a64ea55`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:39.993388 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-79dfb357-2c86-44f9-8040-d2974b314ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:40.036789 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:40.077860 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1443/2908] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:40.110612 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1e928-3a55-4023-b318-c54a0817529b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:40.112646 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-05d1e928-3a55-4023-b318-c54a0817529b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:40.180653 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1e928-3a55-4023-b318-c54a0817529b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:40.184386 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f33031-ca77-4b72-b57a-78d73739d5b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43cfdc27dbdb45c49f50e7bb3f93c260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:40.185040 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f33031-ca77-4b72-b57a-78d73739d5b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:40.185363 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f33031-ca77-4b72-b57a-78d73739d5b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:40.185647 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f33031-ca77-4b72-b57a-78d73739d5b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:40.196104 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f33031-ca77-4b72-b57a-78d73739d5b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:40.197639 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f33031-ca77-4b72-b57a-78d73739d5b7 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:40.207725 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1466/2909] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:40 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:40.224496 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfb357-2c86-44f9-8040-d2974b314ec3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:40.301689 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfb357-2c86-44f9-8040-d2974b314ec3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:40.306976 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:40.307888 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:40.308171 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:40.308441 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] PATH_INFO: `/v3/users/8b69603d512b4fafbc96b98b8a64ea55` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:40.309763 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b69603d512b4fafbc96b98b8a64ea55)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:40.311778 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:40.366270 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b69603d512b4fafbc96b98b8a64ea55'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:40.380196 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b69603d512b4fafbc96b98b8a64ea55'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:40.388372 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b69603d512b4fafbc96b98b8a64ea55'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:40.406066 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b69603d512b4fafbc96b98b8a64ea55'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:40.406924 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b69603d512b4fafbc96b98b8a64ea55'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:40.414507 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1444/2910] 10.222.0.64 () {58 vars in 1223 bytes} [Fri Jul 15 15:37:40 2022] DELETE /identity/v3/users/8b69603d512b4fafbc96b98b8a64ea55 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:40.419436 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b62802-3b45-4dee-b98a-ef79a609b5e9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:40.419982 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b62802-3b45-4dee-b98a-ef79a609b5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:40.420089 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b62802-3b45-4dee-b98a-ef79a609b5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:40.438584 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c9b62802-3b45-4dee-b98a-ef79a609b5e9 None None] MFA Rules not processed for user `635c975960e84510ab325ac63758c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:40.440147 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c9b62802-3b45-4dee-b98a-ef79a609b5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:40.462502 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:40.512601 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1467/2911] 10.222.0.64 () {58 vars in 957 bytes} [Fri Jul 15 15:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:40.523527 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:40.525001 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:40.586781 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:40.590774 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5828b3f-b21e-4ef4-a12d-12e3be21a4d7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:40.596955 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da2b09-5e7b-41bf-b2eb-81f3ae78fb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88518fe83a7c4fbdb3088bb2daf04239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:40.598918 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da2b09-5e7b-41bf-b2eb-81f3ae78fb8b service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:40.599524 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da2b09-5e7b-41bf-b2eb-81f3ae78fb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:40.599992 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da2b09-5e7b-41bf-b2eb-81f3ae78fb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:40.613451 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da2b09-5e7b-41bf-b2eb-81f3ae78fb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:40.615560 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da2b09-5e7b-41bf-b2eb-81f3ae78fb8b service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:40.625368 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1445/2912] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:40.933581 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b62802-3b45-4dee-b98a-ef79a609b5e9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:40.935296 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c9b62802-3b45-4dee-b98a-ef79a609b5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:40.952680 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b62802-3b45-4dee-b98a-ef79a609b5e9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:40.958374 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbce7f-3139-401a-a211-4fdf17acdcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635c975960e84510ab325ac63758c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71c3490c70ac4566897a6b15fddccf92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:40.959253 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbce7f-3139-401a-a211-4fdf17acdcd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:40.959536 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbce7f-3139-401a-a211-4fdf17acdcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:40.959812 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbce7f-3139-401a-a211-4fdf17acdcd2 admin admin] PATH_INFO: `/v3/projects/8b2afdb16c4146fbad5be850a6d4d895` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:40.961165 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbce7f-3139-401a-a211-4fdf17acdcd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b2afdb16c4146fbad5be850a6d4d895)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:40.963052 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbce7f-3139-401a-a211-4fdf17acdcd2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:41.014429 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4fcbce7f-3139-401a-a211-4fdf17acdcd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b2afdb16c4146fbad5be850a6d4d895', 'request_id': 'req-4fcbce7f-3139-401a-a211-4fdf17acdcd2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:41.021652 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4fcbce7f-3139-401a-a211-4fdf17acdcd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b2afdb16c4146fbad5be850a6d4d895', 'request_id': 'req-4fcbce7f-3139-401a-a211-4fdf17acdcd2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:41.030410 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4fcbce7f-3139-401a-a211-4fdf17acdcd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b2afdb16c4146fbad5be850a6d4d895', 'request_id': 'req-4fcbce7f-3139-401a-a211-4fdf17acdcd2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:41.043650 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4fcbce7f-3139-401a-a211-4fdf17acdcd2 admin admin] The token cache is being invalidate because project 8b2afdb16c4146fbad5be850a6d4d895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:37:41.043937 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4fcbce7f-3139-401a-a211-4fdf17acdcd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:41.044595 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4fcbce7f-3139-401a-a211-4fdf17acdcd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:37:41.046197 dv-cinder-850015-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1468/2913] 10.222.0.64 () {58 vars in 1232 bytes} [Fri Jul 15 15:37:40 2022] DELETE /identity/v3/projects/8b2afdb16c4146fbad5be850a6d4d895 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:37:50.620892 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:51.040264 dv-cinder-850015-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:38:45.634506 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da2b09-5e7b-41bf-b2eb-81f3ae78fb8b service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:38:45.636518 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c4da2b09-5e7b-41bf-b2eb-81f3ae78fb8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:38:45.713999 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da2b09-5e7b-41bf-b2eb-81f3ae78fb8b service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:38:45.777974 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe806d2-ed20-4129-b69c-468751f41f2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba61318896f43e5a68e80f38ae5f3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee0acc3e7b64dbab9113284b46f38ff', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:38:45.778627 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe806d2-ed20-4129-b69c-468751f41f2f service placement] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:38:45.778910 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe806d2-ed20-4129-b69c-468751f41f2f service placement] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:38:45.779184 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe806d2-ed20-4129-b69c-468751f41f2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:38:45.780993 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-dfe806d2-ed20-4129-b69c-468751f41f2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:38:45.793033 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe806d2-ed20-4129-b69c-468751f41f2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:38:45.794665 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe806d2-ed20-4129-b69c-468751f41f2f service placement] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:38:45.808271 dv-cinder-850015-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1446/2914] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Jul 15 15:38:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:38:55.802395 dv-cinder-850015-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=58 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}